00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v23.11" build number 1003 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3670 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.112 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.113 The recommended git tool is: git 00:00:00.113 using credential 00000000-0000-0000-0000-000000000002 00:00:00.115 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.150 Fetching changes from the remote Git repository 00:00:00.153 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.190 Using shallow fetch with depth 1 00:00:00.190 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.190 > git --version # timeout=10 00:00:00.221 > git --version # 'git version 2.39.2' 00:00:00.221 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.239 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.239 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.001 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.011 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.022 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:06.022 > git config core.sparsecheckout # timeout=10 00:00:06.032 > git read-tree -mu HEAD # timeout=10 00:00:06.047 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:06.067 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:06.067 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:06.190 [Pipeline] Start of Pipeline 00:00:06.205 [Pipeline] library 00:00:06.206 Loading library shm_lib@master 00:00:06.206 Library shm_lib@master is cached. Copying from home. 00:00:06.222 [Pipeline] node 00:00:06.229 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.231 [Pipeline] { 00:00:06.239 [Pipeline] catchError 00:00:06.240 [Pipeline] { 00:00:06.250 [Pipeline] wrap 00:00:06.256 [Pipeline] { 00:00:06.261 [Pipeline] stage 00:00:06.262 [Pipeline] { (Prologue) 00:00:06.444 [Pipeline] sh 00:00:06.729 + logger -p user.info -t JENKINS-CI 00:00:06.743 [Pipeline] echo 00:00:06.744 Node: GP11 00:00:06.749 [Pipeline] sh 00:00:07.046 [Pipeline] setCustomBuildProperty 00:00:07.059 [Pipeline] echo 00:00:07.061 Cleanup processes 00:00:07.066 [Pipeline] sh 00:00:07.350 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.350 2242462 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.364 [Pipeline] sh 00:00:07.652 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.652 ++ grep -v 'sudo pgrep' 00:00:07.652 ++ awk '{print $1}' 00:00:07.652 + sudo kill -9 00:00:07.652 + true 00:00:07.664 [Pipeline] cleanWs 00:00:07.673 [WS-CLEANUP] Deleting project workspace... 00:00:07.673 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.679 [WS-CLEANUP] done 00:00:07.682 [Pipeline] setCustomBuildProperty 00:00:07.693 [Pipeline] sh 00:00:07.973 + sudo git config --global --replace-all safe.directory '*' 00:00:08.073 [Pipeline] httpRequest 00:00:08.448 [Pipeline] echo 00:00:08.450 Sorcerer 10.211.164.20 is alive 00:00:08.459 [Pipeline] retry 00:00:08.460 [Pipeline] { 00:00:08.475 [Pipeline] httpRequest 00:00:08.480 HttpMethod: GET 00:00:08.481 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.482 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.499 Response Code: HTTP/1.1 200 OK 00:00:08.499 Success: Status code 200 is in the accepted range: 200,404 00:00:08.500 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:11.052 [Pipeline] } 00:00:11.070 [Pipeline] // retry 00:00:11.077 [Pipeline] sh 00:00:11.363 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:11.380 [Pipeline] httpRequest 00:00:12.776 [Pipeline] echo 00:00:12.778 Sorcerer 10.211.164.20 is alive 00:00:12.787 [Pipeline] retry 00:00:12.789 [Pipeline] { 00:00:12.803 [Pipeline] httpRequest 00:00:12.808 HttpMethod: GET 00:00:12.808 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:12.809 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:12.812 Response Code: HTTP/1.1 200 OK 00:00:12.813 Success: Status code 200 is in the accepted range: 200,404 00:00:12.813 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:29.890 [Pipeline] } 00:00:29.908 [Pipeline] // retry 00:00:29.916 [Pipeline] sh 00:00:30.200 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:33.500 [Pipeline] sh 00:00:33.809 + git -C spdk log --oneline -n5 00:00:33.809 c13c99a5e test: Various fixes for Fedora40 00:00:33.809 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:33.809 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:33.809 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:33.809 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:33.828 [Pipeline] withCredentials 00:00:33.839 > git --version # timeout=10 00:00:33.852 > git --version # 'git version 2.39.2' 00:00:33.870 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:00:33.873 [Pipeline] { 00:00:33.882 [Pipeline] retry 00:00:33.884 [Pipeline] { 00:00:33.900 [Pipeline] sh 00:00:34.185 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:00:34.459 [Pipeline] } 00:00:34.478 [Pipeline] // retry 00:00:34.484 [Pipeline] } 00:00:34.500 [Pipeline] // withCredentials 00:00:34.511 [Pipeline] httpRequest 00:00:34.898 [Pipeline] echo 00:00:34.900 Sorcerer 10.211.164.20 is alive 00:00:34.913 [Pipeline] retry 00:00:34.916 [Pipeline] { 00:00:34.934 [Pipeline] httpRequest 00:00:34.939 HttpMethod: GET 00:00:34.939 URL: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:34.940 Sending request to url: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:34.954 Response Code: HTTP/1.1 200 OK 00:00:34.954 Success: Status code 200 is in the accepted range: 200,404 00:00:34.954 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:55.970 [Pipeline] } 00:00:55.986 [Pipeline] // retry 00:00:55.993 [Pipeline] sh 00:00:56.276 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:57.663 [Pipeline] sh 00:00:57.949 + git -C dpdk log --oneline -n5 00:00:57.949 eeb0605f11 version: 23.11.0 00:00:57.949 238778122a doc: update release notes for 23.11 00:00:57.949 46aa6b3cfc doc: fix description of RSS features 00:00:57.949 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:00:57.949 7e421ae345 devtools: support skipping forbid rule check 00:00:57.959 [Pipeline] } 00:00:57.974 [Pipeline] // stage 00:00:57.983 [Pipeline] stage 00:00:57.986 [Pipeline] { (Prepare) 00:00:58.008 [Pipeline] writeFile 00:00:58.023 [Pipeline] sh 00:00:58.309 + logger -p user.info -t JENKINS-CI 00:00:58.323 [Pipeline] sh 00:00:58.610 + logger -p user.info -t JENKINS-CI 00:00:58.623 [Pipeline] sh 00:00:58.909 + cat autorun-spdk.conf 00:00:58.909 SPDK_RUN_FUNCTIONAL_TEST=1 00:00:58.909 SPDK_TEST_NVMF=1 00:00:58.909 SPDK_TEST_NVME_CLI=1 00:00:58.909 SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:58.909 SPDK_TEST_NVMF_NICS=e810 00:00:58.909 SPDK_TEST_VFIOUSER=1 00:00:58.909 SPDK_RUN_UBSAN=1 00:00:58.909 NET_TYPE=phy 00:00:58.909 SPDK_TEST_NATIVE_DPDK=v23.11 00:00:58.909 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:00:58.917 RUN_NIGHTLY=1 00:00:58.922 [Pipeline] readFile 00:00:58.946 [Pipeline] withEnv 00:00:58.948 [Pipeline] { 00:00:58.961 [Pipeline] sh 00:00:59.247 + set -ex 00:00:59.247 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:00:59.247 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:00:59.247 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:00:59.247 ++ SPDK_TEST_NVMF=1 00:00:59.247 ++ SPDK_TEST_NVME_CLI=1 00:00:59.247 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:00:59.247 ++ SPDK_TEST_NVMF_NICS=e810 00:00:59.247 ++ SPDK_TEST_VFIOUSER=1 00:00:59.247 ++ SPDK_RUN_UBSAN=1 00:00:59.247 ++ NET_TYPE=phy 00:00:59.247 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:00:59.247 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:00:59.247 ++ RUN_NIGHTLY=1 00:00:59.247 + case $SPDK_TEST_NVMF_NICS in 00:00:59.247 + DRIVERS=ice 00:00:59.247 + [[ tcp == \r\d\m\a ]] 00:00:59.247 + [[ -n ice ]] 00:00:59.247 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:00:59.247 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:00:59.247 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:00:59.247 rmmod: ERROR: Module irdma is not currently loaded 00:00:59.248 rmmod: ERROR: Module i40iw is not currently loaded 00:00:59.248 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:00:59.248 + true 00:00:59.248 + for D in $DRIVERS 00:00:59.248 + sudo modprobe ice 00:00:59.248 + exit 0 00:00:59.257 [Pipeline] } 00:00:59.272 [Pipeline] // withEnv 00:00:59.276 [Pipeline] } 00:00:59.289 [Pipeline] // stage 00:00:59.298 [Pipeline] catchError 00:00:59.300 [Pipeline] { 00:00:59.312 [Pipeline] timeout 00:00:59.312 Timeout set to expire in 1 hr 0 min 00:00:59.314 [Pipeline] { 00:00:59.326 [Pipeline] stage 00:00:59.328 [Pipeline] { (Tests) 00:00:59.342 [Pipeline] sh 00:00:59.627 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:59.627 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:59.627 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:59.627 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:00:59.627 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:59.627 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:59.627 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:00:59.627 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:59.627 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:00:59.627 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:00:59.627 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:00:59.627 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:59.627 + source /etc/os-release 00:00:59.627 ++ NAME='Fedora Linux' 00:00:59.627 ++ VERSION='39 (Cloud Edition)' 00:00:59.627 ++ ID=fedora 00:00:59.627 ++ VERSION_ID=39 00:00:59.627 ++ VERSION_CODENAME= 00:00:59.627 ++ PLATFORM_ID=platform:f39 00:00:59.627 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:00:59.627 ++ ANSI_COLOR='0;38;2;60;110;180' 00:00:59.627 ++ LOGO=fedora-logo-icon 00:00:59.627 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:00:59.627 ++ HOME_URL=https://fedoraproject.org/ 00:00:59.627 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:00:59.627 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:00:59.627 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:00:59.627 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:00:59.627 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:00:59.627 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:00:59.627 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:00:59.627 ++ SUPPORT_END=2024-11-12 00:00:59.627 ++ VARIANT='Cloud Edition' 00:00:59.627 ++ VARIANT_ID=cloud 00:00:59.627 + uname -a 00:00:59.627 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:00:59.627 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:00.566 Hugepages 00:01:00.566 node hugesize free / total 00:01:00.566 node0 1048576kB 0 / 0 00:01:00.566 node0 2048kB 0 / 0 00:01:00.566 node1 1048576kB 0 / 0 00:01:00.566 node1 2048kB 0 / 0 00:01:00.566 00:01:00.566 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:00.566 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:00.566 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:00.566 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:00.566 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:00.566 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:00.566 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:00.566 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:00.566 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:00.566 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:00.566 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:00.566 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:00.566 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:00.566 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:00.566 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:00.566 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:00.566 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:00.566 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:00.566 + rm -f /tmp/spdk-ld-path 00:01:00.566 + source autorun-spdk.conf 00:01:00.566 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:00.566 ++ SPDK_TEST_NVMF=1 00:01:00.566 ++ SPDK_TEST_NVME_CLI=1 00:01:00.566 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:00.566 ++ SPDK_TEST_NVMF_NICS=e810 00:01:00.566 ++ SPDK_TEST_VFIOUSER=1 00:01:00.566 ++ SPDK_RUN_UBSAN=1 00:01:00.566 ++ NET_TYPE=phy 00:01:00.566 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:00.566 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:00.566 ++ RUN_NIGHTLY=1 00:01:00.566 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:00.566 + [[ -n '' ]] 00:01:00.566 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:00.566 + for M in /var/spdk/build-*-manifest.txt 00:01:00.566 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:00.566 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:00.566 + for M in /var/spdk/build-*-manifest.txt 00:01:00.566 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:00.566 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:00.566 + for M in /var/spdk/build-*-manifest.txt 00:01:00.566 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:00.566 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:00.566 ++ uname 00:01:00.566 + [[ Linux == \L\i\n\u\x ]] 00:01:00.566 + sudo dmesg -T 00:01:00.566 + sudo dmesg --clear 00:01:00.566 + dmesg_pid=2243160 00:01:00.566 + [[ Fedora Linux == FreeBSD ]] 00:01:00.566 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:00.566 + sudo dmesg -Tw 00:01:00.566 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:00.566 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:00.566 + [[ -x /usr/src/fio-static/fio ]] 00:01:00.566 + export FIO_BIN=/usr/src/fio-static/fio 00:01:00.566 + FIO_BIN=/usr/src/fio-static/fio 00:01:00.566 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:00.566 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:00.566 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:00.566 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:00.566 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:00.566 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:00.566 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:00.566 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:00.566 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:00.566 Test configuration: 00:01:00.566 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:00.566 SPDK_TEST_NVMF=1 00:01:00.566 SPDK_TEST_NVME_CLI=1 00:01:00.566 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:00.566 SPDK_TEST_NVMF_NICS=e810 00:01:00.566 SPDK_TEST_VFIOUSER=1 00:01:00.566 SPDK_RUN_UBSAN=1 00:01:00.566 NET_TYPE=phy 00:01:00.566 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:00.566 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:00.826 RUN_NIGHTLY=1 02:56:03 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:00.826 02:56:03 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:00.826 02:56:03 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:00.826 02:56:03 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:00.826 02:56:03 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:00.826 02:56:03 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:00.827 02:56:03 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:00.827 02:56:03 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:00.827 02:56:03 -- paths/export.sh@5 -- $ export PATH 00:01:00.827 02:56:03 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:00.827 02:56:03 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:00.827 02:56:03 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:00.827 02:56:03 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732672563.XXXXXX 00:01:00.827 02:56:03 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732672563.v5VyUp 00:01:00.827 02:56:03 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:00.827 02:56:03 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:01:00.827 02:56:03 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:00.827 02:56:03 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:00.827 02:56:03 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:00.827 02:56:03 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:00.827 02:56:03 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:00.827 02:56:03 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:00.827 02:56:03 -- common/autotest_common.sh@10 -- $ set +x 00:01:00.827 02:56:03 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:00.827 02:56:03 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:00.827 02:56:03 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:00.827 02:56:03 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:00.827 02:56:03 -- spdk/autobuild.sh@16 -- $ date -u 00:01:00.827 Wed Nov 27 01:56:03 AM UTC 2024 00:01:00.827 02:56:03 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:00.827 LTS-67-gc13c99a5e 00:01:00.827 02:56:03 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:00.827 02:56:03 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:00.827 02:56:03 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:00.827 02:56:03 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:00.827 02:56:03 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:00.827 02:56:03 -- common/autotest_common.sh@10 -- $ set +x 00:01:00.827 ************************************ 00:01:00.827 START TEST ubsan 00:01:00.827 ************************************ 00:01:00.827 02:56:03 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:00.827 using ubsan 00:01:00.827 00:01:00.827 real 0m0.000s 00:01:00.827 user 0m0.000s 00:01:00.827 sys 0m0.000s 00:01:00.827 02:56:03 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:00.827 02:56:03 -- common/autotest_common.sh@10 -- $ set +x 00:01:00.827 ************************************ 00:01:00.827 END TEST ubsan 00:01:00.827 ************************************ 00:01:00.827 02:56:03 -- spdk/autobuild.sh@27 -- $ '[' -n v23.11 ']' 00:01:00.827 02:56:03 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:00.827 02:56:03 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:00.827 02:56:03 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:00.827 02:56:03 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:00.827 02:56:03 -- common/autotest_common.sh@10 -- $ set +x 00:01:00.827 ************************************ 00:01:00.827 START TEST build_native_dpdk 00:01:00.827 ************************************ 00:01:00.827 02:56:03 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:00.827 02:56:03 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:00.827 02:56:03 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:00.827 02:56:03 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:00.827 02:56:03 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:00.827 02:56:03 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:00.827 02:56:03 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:00.827 02:56:03 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:00.827 02:56:03 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:00.827 02:56:03 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:00.827 02:56:03 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:00.827 02:56:03 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:00.827 02:56:03 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:00.827 02:56:03 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:00.827 02:56:03 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:00.827 02:56:03 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:00.827 02:56:03 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:00.827 02:56:03 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:00.827 02:56:03 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:00.827 02:56:03 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:00.827 02:56:03 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:00.827 eeb0605f11 version: 23.11.0 00:01:00.827 238778122a doc: update release notes for 23.11 00:01:00.827 46aa6b3cfc doc: fix description of RSS features 00:01:00.827 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:00.827 7e421ae345 devtools: support skipping forbid rule check 00:01:00.827 02:56:03 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:00.827 02:56:03 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:00.827 02:56:03 -- common/autobuild_common.sh@87 -- $ dpdk_ver=23.11.0 00:01:00.827 02:56:03 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:00.827 02:56:03 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:00.827 02:56:03 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:00.827 02:56:03 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:00.827 02:56:03 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:00.827 02:56:03 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:00.827 02:56:03 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:00.827 02:56:03 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:00.827 02:56:03 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:00.828 02:56:03 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:00.828 02:56:03 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:00.828 02:56:03 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:00.828 02:56:03 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:00.828 02:56:03 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:00.828 02:56:03 -- common/autobuild_common.sh@169 -- $ lt 23.11.0 21.11.0 00:01:00.828 02:56:03 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 21.11.0 00:01:00.828 02:56:03 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:00.828 02:56:03 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:00.828 02:56:03 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:00.828 02:56:03 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:00.828 02:56:03 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:00.828 02:56:03 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:00.828 02:56:03 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:00.828 02:56:03 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:00.828 02:56:03 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:00.828 02:56:03 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:00.828 02:56:03 -- scripts/common.sh@343 -- $ case "$op" in 00:01:00.828 02:56:03 -- scripts/common.sh@344 -- $ : 1 00:01:00.828 02:56:03 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:00.828 02:56:03 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:00.828 02:56:03 -- scripts/common.sh@364 -- $ decimal 23 00:01:00.828 02:56:03 -- scripts/common.sh@352 -- $ local d=23 00:01:00.828 02:56:03 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:00.828 02:56:03 -- scripts/common.sh@354 -- $ echo 23 00:01:00.828 02:56:03 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:00.828 02:56:03 -- scripts/common.sh@365 -- $ decimal 21 00:01:00.828 02:56:03 -- scripts/common.sh@352 -- $ local d=21 00:01:00.828 02:56:03 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:00.828 02:56:03 -- scripts/common.sh@354 -- $ echo 21 00:01:00.828 02:56:03 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:00.828 02:56:03 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:00.828 02:56:03 -- scripts/common.sh@366 -- $ return 1 00:01:00.828 02:56:03 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:00.828 patching file config/rte_config.h 00:01:00.828 Hunk #1 succeeded at 60 (offset 1 line). 00:01:00.828 02:56:03 -- common/autobuild_common.sh@176 -- $ lt 23.11.0 24.07.0 00:01:00.828 02:56:03 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 24.07.0 00:01:00.828 02:56:03 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:00.828 02:56:03 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:00.828 02:56:03 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:00.828 02:56:03 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:00.828 02:56:03 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:00.828 02:56:03 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:00.828 02:56:03 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:00.828 02:56:03 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:00.828 02:56:03 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:00.828 02:56:03 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:00.828 02:56:03 -- scripts/common.sh@343 -- $ case "$op" in 00:01:00.828 02:56:03 -- scripts/common.sh@344 -- $ : 1 00:01:00.828 02:56:03 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:00.828 02:56:03 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:00.828 02:56:03 -- scripts/common.sh@364 -- $ decimal 23 00:01:00.828 02:56:03 -- scripts/common.sh@352 -- $ local d=23 00:01:00.828 02:56:03 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:00.828 02:56:03 -- scripts/common.sh@354 -- $ echo 23 00:01:00.828 02:56:03 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:00.828 02:56:03 -- scripts/common.sh@365 -- $ decimal 24 00:01:00.828 02:56:03 -- scripts/common.sh@352 -- $ local d=24 00:01:00.828 02:56:03 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:00.828 02:56:03 -- scripts/common.sh@354 -- $ echo 24 00:01:00.828 02:56:03 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:00.828 02:56:03 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:00.828 02:56:03 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:00.828 02:56:03 -- scripts/common.sh@367 -- $ return 0 00:01:00.828 02:56:03 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:00.828 patching file lib/pcapng/rte_pcapng.c 00:01:00.828 02:56:03 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:00.828 02:56:03 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:00.828 02:56:03 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:00.828 02:56:03 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:00.828 02:56:03 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:06.102 The Meson build system 00:01:06.102 Version: 1.5.0 00:01:06.102 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:06.102 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:06.102 Build type: native build 00:01:06.102 Program cat found: YES (/usr/bin/cat) 00:01:06.102 Project name: DPDK 00:01:06.102 Project version: 23.11.0 00:01:06.102 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:06.102 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:06.102 Host machine cpu family: x86_64 00:01:06.102 Host machine cpu: x86_64 00:01:06.102 Message: ## Building in Developer Mode ## 00:01:06.102 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:06.102 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:06.102 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:06.102 Program python3 found: YES (/usr/bin/python3) 00:01:06.102 Program cat found: YES (/usr/bin/cat) 00:01:06.102 config/meson.build:113: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:06.102 Compiler for C supports arguments -march=native: YES 00:01:06.102 Checking for size of "void *" : 8 00:01:06.102 Checking for size of "void *" : 8 (cached) 00:01:06.102 Library m found: YES 00:01:06.102 Library numa found: YES 00:01:06.102 Has header "numaif.h" : YES 00:01:06.102 Library fdt found: NO 00:01:06.102 Library execinfo found: NO 00:01:06.102 Has header "execinfo.h" : YES 00:01:06.102 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:06.102 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:06.102 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:06.102 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:06.102 Run-time dependency openssl found: YES 3.1.1 00:01:06.102 Run-time dependency libpcap found: YES 1.10.4 00:01:06.102 Has header "pcap.h" with dependency libpcap: YES 00:01:06.102 Compiler for C supports arguments -Wcast-qual: YES 00:01:06.102 Compiler for C supports arguments -Wdeprecated: YES 00:01:06.102 Compiler for C supports arguments -Wformat: YES 00:01:06.102 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:06.102 Compiler for C supports arguments -Wformat-security: NO 00:01:06.102 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:06.102 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:06.102 Compiler for C supports arguments -Wnested-externs: YES 00:01:06.102 Compiler for C supports arguments -Wold-style-definition: YES 00:01:06.102 Compiler for C supports arguments -Wpointer-arith: YES 00:01:06.102 Compiler for C supports arguments -Wsign-compare: YES 00:01:06.102 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:06.102 Compiler for C supports arguments -Wundef: YES 00:01:06.102 Compiler for C supports arguments -Wwrite-strings: YES 00:01:06.102 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:06.102 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:06.102 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:06.102 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:06.102 Program objdump found: YES (/usr/bin/objdump) 00:01:06.102 Compiler for C supports arguments -mavx512f: YES 00:01:06.102 Checking if "AVX512 checking" compiles: YES 00:01:06.102 Fetching value of define "__SSE4_2__" : 1 00:01:06.102 Fetching value of define "__AES__" : 1 00:01:06.102 Fetching value of define "__AVX__" : 1 00:01:06.102 Fetching value of define "__AVX2__" : (undefined) 00:01:06.102 Fetching value of define "__AVX512BW__" : (undefined) 00:01:06.102 Fetching value of define "__AVX512CD__" : (undefined) 00:01:06.102 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:06.102 Fetching value of define "__AVX512F__" : (undefined) 00:01:06.102 Fetching value of define "__AVX512VL__" : (undefined) 00:01:06.102 Fetching value of define "__PCLMUL__" : 1 00:01:06.102 Fetching value of define "__RDRND__" : 1 00:01:06.102 Fetching value of define "__RDSEED__" : (undefined) 00:01:06.102 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:06.102 Fetching value of define "__znver1__" : (undefined) 00:01:06.102 Fetching value of define "__znver2__" : (undefined) 00:01:06.102 Fetching value of define "__znver3__" : (undefined) 00:01:06.102 Fetching value of define "__znver4__" : (undefined) 00:01:06.102 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:06.102 Message: lib/log: Defining dependency "log" 00:01:06.102 Message: lib/kvargs: Defining dependency "kvargs" 00:01:06.102 Message: lib/telemetry: Defining dependency "telemetry" 00:01:06.102 Checking for function "getentropy" : NO 00:01:06.102 Message: lib/eal: Defining dependency "eal" 00:01:06.102 Message: lib/ring: Defining dependency "ring" 00:01:06.102 Message: lib/rcu: Defining dependency "rcu" 00:01:06.102 Message: lib/mempool: Defining dependency "mempool" 00:01:06.102 Message: lib/mbuf: Defining dependency "mbuf" 00:01:06.102 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:06.102 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:06.102 Compiler for C supports arguments -mpclmul: YES 00:01:06.102 Compiler for C supports arguments -maes: YES 00:01:06.102 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:06.102 Compiler for C supports arguments -mavx512bw: YES 00:01:06.102 Compiler for C supports arguments -mavx512dq: YES 00:01:06.102 Compiler for C supports arguments -mavx512vl: YES 00:01:06.102 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:06.102 Compiler for C supports arguments -mavx2: YES 00:01:06.102 Compiler for C supports arguments -mavx: YES 00:01:06.102 Message: lib/net: Defining dependency "net" 00:01:06.102 Message: lib/meter: Defining dependency "meter" 00:01:06.102 Message: lib/ethdev: Defining dependency "ethdev" 00:01:06.102 Message: lib/pci: Defining dependency "pci" 00:01:06.102 Message: lib/cmdline: Defining dependency "cmdline" 00:01:06.102 Message: lib/metrics: Defining dependency "metrics" 00:01:06.102 Message: lib/hash: Defining dependency "hash" 00:01:06.102 Message: lib/timer: Defining dependency "timer" 00:01:06.102 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:06.102 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:06.102 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:06.102 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:06.102 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:06.102 Message: lib/acl: Defining dependency "acl" 00:01:06.102 Message: lib/bbdev: Defining dependency "bbdev" 00:01:06.102 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:06.102 Run-time dependency libelf found: YES 0.191 00:01:06.102 Message: lib/bpf: Defining dependency "bpf" 00:01:06.102 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:06.102 Message: lib/compressdev: Defining dependency "compressdev" 00:01:06.102 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:06.102 Message: lib/distributor: Defining dependency "distributor" 00:01:06.102 Message: lib/dmadev: Defining dependency "dmadev" 00:01:06.102 Message: lib/efd: Defining dependency "efd" 00:01:06.102 Message: lib/eventdev: Defining dependency "eventdev" 00:01:06.102 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:06.102 Message: lib/gpudev: Defining dependency "gpudev" 00:01:06.102 Message: lib/gro: Defining dependency "gro" 00:01:06.102 Message: lib/gso: Defining dependency "gso" 00:01:06.102 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:06.102 Message: lib/jobstats: Defining dependency "jobstats" 00:01:06.102 Message: lib/latencystats: Defining dependency "latencystats" 00:01:06.102 Message: lib/lpm: Defining dependency "lpm" 00:01:06.102 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:06.102 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:06.102 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:06.102 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:06.102 Message: lib/member: Defining dependency "member" 00:01:06.102 Message: lib/pcapng: Defining dependency "pcapng" 00:01:06.102 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:06.102 Message: lib/power: Defining dependency "power" 00:01:06.102 Message: lib/rawdev: Defining dependency "rawdev" 00:01:06.102 Message: lib/regexdev: Defining dependency "regexdev" 00:01:06.102 Message: lib/mldev: Defining dependency "mldev" 00:01:06.102 Message: lib/rib: Defining dependency "rib" 00:01:06.102 Message: lib/reorder: Defining dependency "reorder" 00:01:06.103 Message: lib/sched: Defining dependency "sched" 00:01:06.103 Message: lib/security: Defining dependency "security" 00:01:06.103 Message: lib/stack: Defining dependency "stack" 00:01:06.103 Has header "linux/userfaultfd.h" : YES 00:01:06.103 Has header "linux/vduse.h" : YES 00:01:06.103 Message: lib/vhost: Defining dependency "vhost" 00:01:06.103 Message: lib/ipsec: Defining dependency "ipsec" 00:01:06.103 Message: lib/pdcp: Defining dependency "pdcp" 00:01:06.103 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:06.103 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:06.103 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:06.103 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:06.103 Message: lib/fib: Defining dependency "fib" 00:01:06.103 Message: lib/port: Defining dependency "port" 00:01:06.103 Message: lib/pdump: Defining dependency "pdump" 00:01:06.103 Message: lib/table: Defining dependency "table" 00:01:06.103 Message: lib/pipeline: Defining dependency "pipeline" 00:01:06.103 Message: lib/graph: Defining dependency "graph" 00:01:06.103 Message: lib/node: Defining dependency "node" 00:01:07.479 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:07.479 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:07.479 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:07.479 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:07.479 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:07.479 Compiler for C supports arguments -Wno-unused-value: YES 00:01:07.479 Compiler for C supports arguments -Wno-format: YES 00:01:07.479 Compiler for C supports arguments -Wno-format-security: YES 00:01:07.479 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:07.479 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:07.479 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:07.479 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:07.479 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:07.479 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:07.479 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:07.479 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:07.479 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:07.479 Has header "sys/epoll.h" : YES 00:01:07.479 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:07.479 Configuring doxy-api-html.conf using configuration 00:01:07.479 Configuring doxy-api-man.conf using configuration 00:01:07.479 Program mandb found: YES (/usr/bin/mandb) 00:01:07.479 Program sphinx-build found: NO 00:01:07.479 Configuring rte_build_config.h using configuration 00:01:07.479 Message: 00:01:07.479 ================= 00:01:07.479 Applications Enabled 00:01:07.479 ================= 00:01:07.479 00:01:07.479 apps: 00:01:07.479 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:07.479 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:07.479 test-pmd, test-regex, test-sad, test-security-perf, 00:01:07.479 00:01:07.479 Message: 00:01:07.479 ================= 00:01:07.479 Libraries Enabled 00:01:07.479 ================= 00:01:07.479 00:01:07.479 libs: 00:01:07.479 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:07.479 net, meter, ethdev, pci, cmdline, metrics, hash, timer, 00:01:07.479 acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, 00:01:07.479 dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, ip_frag, 00:01:07.479 jobstats, latencystats, lpm, member, pcapng, power, rawdev, regexdev, 00:01:07.479 mldev, rib, reorder, sched, security, stack, vhost, ipsec, 00:01:07.479 pdcp, fib, port, pdump, table, pipeline, graph, node, 00:01:07.479 00:01:07.479 00:01:07.479 Message: 00:01:07.479 =============== 00:01:07.479 Drivers Enabled 00:01:07.479 =============== 00:01:07.479 00:01:07.479 common: 00:01:07.479 00:01:07.479 bus: 00:01:07.479 pci, vdev, 00:01:07.479 mempool: 00:01:07.479 ring, 00:01:07.479 dma: 00:01:07.479 00:01:07.479 net: 00:01:07.479 i40e, 00:01:07.479 raw: 00:01:07.479 00:01:07.479 crypto: 00:01:07.479 00:01:07.479 compress: 00:01:07.479 00:01:07.479 regex: 00:01:07.479 00:01:07.479 ml: 00:01:07.479 00:01:07.479 vdpa: 00:01:07.479 00:01:07.479 event: 00:01:07.479 00:01:07.479 baseband: 00:01:07.479 00:01:07.479 gpu: 00:01:07.479 00:01:07.479 00:01:07.479 Message: 00:01:07.479 ================= 00:01:07.479 Content Skipped 00:01:07.479 ================= 00:01:07.479 00:01:07.479 apps: 00:01:07.479 00:01:07.479 libs: 00:01:07.479 00:01:07.479 drivers: 00:01:07.479 common/cpt: not in enabled drivers build config 00:01:07.479 common/dpaax: not in enabled drivers build config 00:01:07.479 common/iavf: not in enabled drivers build config 00:01:07.479 common/idpf: not in enabled drivers build config 00:01:07.479 common/mvep: not in enabled drivers build config 00:01:07.479 common/octeontx: not in enabled drivers build config 00:01:07.479 bus/auxiliary: not in enabled drivers build config 00:01:07.479 bus/cdx: not in enabled drivers build config 00:01:07.479 bus/dpaa: not in enabled drivers build config 00:01:07.479 bus/fslmc: not in enabled drivers build config 00:01:07.479 bus/ifpga: not in enabled drivers build config 00:01:07.479 bus/platform: not in enabled drivers build config 00:01:07.479 bus/vmbus: not in enabled drivers build config 00:01:07.479 common/cnxk: not in enabled drivers build config 00:01:07.479 common/mlx5: not in enabled drivers build config 00:01:07.479 common/nfp: not in enabled drivers build config 00:01:07.480 common/qat: not in enabled drivers build config 00:01:07.480 common/sfc_efx: not in enabled drivers build config 00:01:07.480 mempool/bucket: not in enabled drivers build config 00:01:07.480 mempool/cnxk: not in enabled drivers build config 00:01:07.480 mempool/dpaa: not in enabled drivers build config 00:01:07.480 mempool/dpaa2: not in enabled drivers build config 00:01:07.480 mempool/octeontx: not in enabled drivers build config 00:01:07.480 mempool/stack: not in enabled drivers build config 00:01:07.480 dma/cnxk: not in enabled drivers build config 00:01:07.480 dma/dpaa: not in enabled drivers build config 00:01:07.480 dma/dpaa2: not in enabled drivers build config 00:01:07.480 dma/hisilicon: not in enabled drivers build config 00:01:07.480 dma/idxd: not in enabled drivers build config 00:01:07.480 dma/ioat: not in enabled drivers build config 00:01:07.480 dma/skeleton: not in enabled drivers build config 00:01:07.480 net/af_packet: not in enabled drivers build config 00:01:07.480 net/af_xdp: not in enabled drivers build config 00:01:07.480 net/ark: not in enabled drivers build config 00:01:07.480 net/atlantic: not in enabled drivers build config 00:01:07.480 net/avp: not in enabled drivers build config 00:01:07.480 net/axgbe: not in enabled drivers build config 00:01:07.480 net/bnx2x: not in enabled drivers build config 00:01:07.480 net/bnxt: not in enabled drivers build config 00:01:07.480 net/bonding: not in enabled drivers build config 00:01:07.480 net/cnxk: not in enabled drivers build config 00:01:07.480 net/cpfl: not in enabled drivers build config 00:01:07.480 net/cxgbe: not in enabled drivers build config 00:01:07.480 net/dpaa: not in enabled drivers build config 00:01:07.480 net/dpaa2: not in enabled drivers build config 00:01:07.480 net/e1000: not in enabled drivers build config 00:01:07.480 net/ena: not in enabled drivers build config 00:01:07.480 net/enetc: not in enabled drivers build config 00:01:07.480 net/enetfec: not in enabled drivers build config 00:01:07.480 net/enic: not in enabled drivers build config 00:01:07.480 net/failsafe: not in enabled drivers build config 00:01:07.480 net/fm10k: not in enabled drivers build config 00:01:07.480 net/gve: not in enabled drivers build config 00:01:07.480 net/hinic: not in enabled drivers build config 00:01:07.480 net/hns3: not in enabled drivers build config 00:01:07.480 net/iavf: not in enabled drivers build config 00:01:07.480 net/ice: not in enabled drivers build config 00:01:07.480 net/idpf: not in enabled drivers build config 00:01:07.480 net/igc: not in enabled drivers build config 00:01:07.480 net/ionic: not in enabled drivers build config 00:01:07.480 net/ipn3ke: not in enabled drivers build config 00:01:07.480 net/ixgbe: not in enabled drivers build config 00:01:07.480 net/mana: not in enabled drivers build config 00:01:07.480 net/memif: not in enabled drivers build config 00:01:07.480 net/mlx4: not in enabled drivers build config 00:01:07.480 net/mlx5: not in enabled drivers build config 00:01:07.480 net/mvneta: not in enabled drivers build config 00:01:07.480 net/mvpp2: not in enabled drivers build config 00:01:07.480 net/netvsc: not in enabled drivers build config 00:01:07.480 net/nfb: not in enabled drivers build config 00:01:07.480 net/nfp: not in enabled drivers build config 00:01:07.480 net/ngbe: not in enabled drivers build config 00:01:07.480 net/null: not in enabled drivers build config 00:01:07.480 net/octeontx: not in enabled drivers build config 00:01:07.480 net/octeon_ep: not in enabled drivers build config 00:01:07.480 net/pcap: not in enabled drivers build config 00:01:07.480 net/pfe: not in enabled drivers build config 00:01:07.480 net/qede: not in enabled drivers build config 00:01:07.480 net/ring: not in enabled drivers build config 00:01:07.480 net/sfc: not in enabled drivers build config 00:01:07.480 net/softnic: not in enabled drivers build config 00:01:07.480 net/tap: not in enabled drivers build config 00:01:07.480 net/thunderx: not in enabled drivers build config 00:01:07.480 net/txgbe: not in enabled drivers build config 00:01:07.480 net/vdev_netvsc: not in enabled drivers build config 00:01:07.480 net/vhost: not in enabled drivers build config 00:01:07.480 net/virtio: not in enabled drivers build config 00:01:07.480 net/vmxnet3: not in enabled drivers build config 00:01:07.480 raw/cnxk_bphy: not in enabled drivers build config 00:01:07.480 raw/cnxk_gpio: not in enabled drivers build config 00:01:07.480 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:07.480 raw/ifpga: not in enabled drivers build config 00:01:07.480 raw/ntb: not in enabled drivers build config 00:01:07.480 raw/skeleton: not in enabled drivers build config 00:01:07.480 crypto/armv8: not in enabled drivers build config 00:01:07.480 crypto/bcmfs: not in enabled drivers build config 00:01:07.480 crypto/caam_jr: not in enabled drivers build config 00:01:07.480 crypto/ccp: not in enabled drivers build config 00:01:07.480 crypto/cnxk: not in enabled drivers build config 00:01:07.480 crypto/dpaa_sec: not in enabled drivers build config 00:01:07.480 crypto/dpaa2_sec: not in enabled drivers build config 00:01:07.480 crypto/ipsec_mb: not in enabled drivers build config 00:01:07.480 crypto/mlx5: not in enabled drivers build config 00:01:07.480 crypto/mvsam: not in enabled drivers build config 00:01:07.480 crypto/nitrox: not in enabled drivers build config 00:01:07.480 crypto/null: not in enabled drivers build config 00:01:07.480 crypto/octeontx: not in enabled drivers build config 00:01:07.480 crypto/openssl: not in enabled drivers build config 00:01:07.480 crypto/scheduler: not in enabled drivers build config 00:01:07.480 crypto/uadk: not in enabled drivers build config 00:01:07.480 crypto/virtio: not in enabled drivers build config 00:01:07.480 compress/isal: not in enabled drivers build config 00:01:07.480 compress/mlx5: not in enabled drivers build config 00:01:07.480 compress/octeontx: not in enabled drivers build config 00:01:07.480 compress/zlib: not in enabled drivers build config 00:01:07.480 regex/mlx5: not in enabled drivers build config 00:01:07.480 regex/cn9k: not in enabled drivers build config 00:01:07.480 ml/cnxk: not in enabled drivers build config 00:01:07.480 vdpa/ifc: not in enabled drivers build config 00:01:07.480 vdpa/mlx5: not in enabled drivers build config 00:01:07.480 vdpa/nfp: not in enabled drivers build config 00:01:07.480 vdpa/sfc: not in enabled drivers build config 00:01:07.480 event/cnxk: not in enabled drivers build config 00:01:07.480 event/dlb2: not in enabled drivers build config 00:01:07.480 event/dpaa: not in enabled drivers build config 00:01:07.480 event/dpaa2: not in enabled drivers build config 00:01:07.480 event/dsw: not in enabled drivers build config 00:01:07.480 event/opdl: not in enabled drivers build config 00:01:07.480 event/skeleton: not in enabled drivers build config 00:01:07.480 event/sw: not in enabled drivers build config 00:01:07.480 event/octeontx: not in enabled drivers build config 00:01:07.480 baseband/acc: not in enabled drivers build config 00:01:07.480 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:07.480 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:07.480 baseband/la12xx: not in enabled drivers build config 00:01:07.480 baseband/null: not in enabled drivers build config 00:01:07.480 baseband/turbo_sw: not in enabled drivers build config 00:01:07.480 gpu/cuda: not in enabled drivers build config 00:01:07.480 00:01:07.480 00:01:07.480 Build targets in project: 220 00:01:07.480 00:01:07.480 DPDK 23.11.0 00:01:07.480 00:01:07.480 User defined options 00:01:07.480 libdir : lib 00:01:07.480 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:07.480 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:07.480 c_link_args : 00:01:07.480 enable_docs : false 00:01:07.480 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:07.480 enable_kmods : false 00:01:07.480 machine : native 00:01:07.480 tests : false 00:01:07.480 00:01:07.480 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:07.480 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:07.480 02:56:09 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:07.480 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:07.480 [1/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:07.480 [2/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:07.481 [3/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:07.481 [4/710] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:07.481 [5/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:07.481 [6/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:07.481 [7/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:07.481 [8/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:07.481 [9/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:07.481 [10/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:07.481 [11/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:07.481 [12/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:07.481 [13/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:07.481 [14/710] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:07.481 [15/710] Linking static target lib/librte_kvargs.a 00:01:07.739 [16/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:07.739 [17/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:07.739 [18/710] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:07.739 [19/710] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:07.739 [20/710] Linking static target lib/librte_log.a 00:01:07.739 [21/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:08.000 [22/710] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:08.571 [23/710] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:08.571 [24/710] Linking target lib/librte_log.so.24.0 00:01:08.571 [25/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:08.571 [26/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:08.571 [27/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:08.571 [28/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:08.571 [29/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:08.571 [30/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:08.571 [31/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:08.571 [32/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:08.571 [33/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:08.571 [34/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:08.571 [35/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:08.571 [36/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:08.571 [37/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:08.571 [38/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:08.571 [39/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:08.571 [40/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:08.571 [41/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:08.571 [42/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:08.571 [43/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:08.571 [44/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:08.571 [45/710] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:08.571 [46/710] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:08.836 [47/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:08.836 [48/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:08.836 [49/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:08.836 [50/710] Linking target lib/librte_kvargs.so.24.0 00:01:08.836 [51/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:08.836 [52/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:08.836 [53/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:08.836 [54/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:08.836 [55/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:08.836 [56/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:08.836 [57/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:08.836 [58/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:08.836 [59/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:08.836 [60/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:08.836 [61/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:08.836 [62/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:08.836 [63/710] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:09.097 [64/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:09.097 [65/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:09.097 [66/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:09.097 [67/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:09.359 [68/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:09.359 [69/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:09.359 [70/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:09.359 [71/710] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:09.359 [72/710] Linking static target lib/librte_pci.a 00:01:09.359 [73/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:09.359 [74/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:09.359 [75/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:09.618 [76/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:09.618 [77/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:09.618 [78/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:09.618 [79/710] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:09.618 [80/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:09.618 [81/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:09.618 [82/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:09.618 [83/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:09.618 [84/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:09.618 [85/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:09.618 [86/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:09.879 [87/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:09.879 [88/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:09.879 [89/710] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:09.879 [90/710] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:09.879 [91/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:09.879 [92/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:09.879 [93/710] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:09.879 [94/710] Linking static target lib/librte_ring.a 00:01:09.879 [95/710] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:09.879 [96/710] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:09.879 [97/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:09.879 [98/710] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:09.879 [99/710] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:09.879 [100/710] Linking static target lib/librte_meter.a 00:01:10.139 [101/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:10.139 [102/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:10.139 [103/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:10.139 [104/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:10.139 [105/710] Linking static target lib/librte_telemetry.a 00:01:10.139 [106/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:10.139 [107/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:10.139 [108/710] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:10.139 [109/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:10.139 [110/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:10.139 [111/710] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:10.139 [112/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:10.139 [113/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:10.401 [114/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:10.401 [115/710] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.401 [116/710] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.401 [117/710] Linking static target lib/librte_eal.a 00:01:10.401 [118/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:10.401 [119/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:10.401 [120/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:10.401 [121/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:10.401 [122/710] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:10.401 [123/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:10.401 [124/710] Linking static target lib/librte_net.a 00:01:10.401 [125/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:10.661 [126/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:10.662 [127/710] Linking static target lib/librte_cmdline.a 00:01:10.662 [128/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:10.662 [129/710] Linking static target lib/librte_mempool.a 00:01:10.662 [130/710] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.662 [131/710] Linking target lib/librte_telemetry.so.24.0 00:01:10.924 [132/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:10.924 [133/710] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:10.924 [134/710] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:10.924 [135/710] Linking static target lib/librte_cfgfile.a 00:01:10.924 [136/710] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:10.924 [137/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:10.924 [138/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:10.924 [139/710] Linking static target lib/librte_metrics.a 00:01:10.924 [140/710] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:10.924 [141/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:10.924 [142/710] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:11.186 [143/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:11.186 [144/710] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:11.186 [145/710] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:11.448 [146/710] Linking static target lib/librte_rcu.a 00:01:11.448 [147/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:11.448 [148/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:11.448 [149/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:11.448 [150/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:11.448 [151/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:11.448 [152/710] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:11.448 [153/710] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.448 [154/710] Linking static target lib/librte_bitratestats.a 00:01:11.448 [155/710] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:11.448 [156/710] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:11.448 [157/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:11.448 [158/710] Linking static target lib/librte_timer.a 00:01:11.709 [159/710] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.709 [160/710] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.709 [161/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:11.709 [162/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:11.709 [163/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:11.709 [164/710] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.709 [165/710] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.709 [166/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:11.709 [167/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:11.970 [168/710] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:11.970 [169/710] Linking static target lib/librte_bbdev.a 00:01:11.970 [170/710] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:11.970 [171/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:12.234 [172/710] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.234 [173/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:12.234 [174/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:12.234 [175/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:12.234 [176/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:12.234 [177/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:12.234 [178/710] Linking static target lib/librte_compressdev.a 00:01:12.234 [179/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:12.234 [180/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:12.500 [181/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:12.500 [182/710] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:12.500 [183/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:12.767 [184/710] Linking static target lib/librte_distributor.a 00:01:12.767 [185/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:12.767 [186/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:12.767 [187/710] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:12.767 [188/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:12.767 [189/710] Linking static target lib/librte_bpf.a 00:01:13.031 [190/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:13.031 [191/710] Linking static target lib/librte_dmadev.a 00:01:13.031 [192/710] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.031 [193/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:13.031 [194/710] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:13.031 [195/710] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.031 [196/710] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:01:13.031 [197/710] Linking static target lib/librte_dispatcher.a 00:01:13.031 [198/710] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:13.031 [199/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:13.031 [200/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:13.295 [201/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:01:13.295 [202/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:13.295 [203/710] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:13.295 [204/710] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:13.295 [205/710] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:13.295 [206/710] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:13.295 [207/710] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.295 [208/710] Linking static target lib/librte_gpudev.a 00:01:13.295 [209/710] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:13.295 [210/710] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:13.295 [211/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:13.295 [212/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:13.560 [213/710] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:13.560 [214/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:13.560 [215/710] Linking static target lib/librte_gro.a 00:01:13.560 [216/710] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.560 [217/710] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:13.560 [218/710] Linking static target lib/librte_jobstats.a 00:01:13.560 [219/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:13.560 [220/710] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:13.822 [221/710] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.822 [222/710] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:13.822 [223/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:01:13.822 [224/710] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:13.822 [225/710] Linking static target lib/librte_latencystats.a 00:01:14.085 [226/710] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.085 [227/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:14.085 [228/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:14.085 [229/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:14.085 [230/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:14.085 [231/710] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:14.085 [232/710] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:14.085 [233/710] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:14.348 [234/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:14.348 [235/710] Linking static target lib/librte_ip_frag.a 00:01:14.348 [236/710] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.348 [237/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:14.348 [238/710] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:14.348 [239/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:14.631 [240/710] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:14.631 [241/710] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:14.631 [242/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:01:14.631 [243/710] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:14.631 [244/710] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.898 [245/710] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:14.898 [246/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:14.898 [247/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:01:14.898 [248/710] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:14.898 [249/710] Linking static target lib/librte_gso.a 00:01:14.898 [250/710] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:14.898 [251/710] Linking static target lib/librte_regexdev.a 00:01:14.899 [252/710] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:14.899 [253/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:15.162 [254/710] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:15.162 [255/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:01:15.162 [256/710] Linking static target lib/librte_rawdev.a 00:01:15.162 [257/710] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:15.162 [258/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:01:15.162 [259/710] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:15.162 [260/710] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.162 [261/710] Linking static target lib/librte_efd.a 00:01:15.162 [262/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:01:15.162 [263/710] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:15.162 [264/710] Linking static target lib/librte_mldev.a 00:01:15.421 [265/710] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:15.421 [266/710] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:15.421 [267/710] Linking static target lib/librte_pcapng.a 00:01:15.421 [268/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:15.421 [269/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:15.421 [270/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:15.421 [271/710] Linking static target lib/librte_stack.a 00:01:15.421 [272/710] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:15.421 [273/710] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:15.421 [274/710] Linking static target lib/acl/libavx2_tmp.a 00:01:15.684 [275/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:15.684 [276/710] Linking static target lib/librte_lpm.a 00:01:15.684 [277/710] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:15.684 [278/710] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.684 [279/710] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:15.684 [280/710] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.684 [281/710] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:15.684 [282/710] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:15.684 [283/710] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.684 [284/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:15.945 [285/710] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:15.945 [286/710] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:15.945 [287/710] Linking static target lib/librte_hash.a 00:01:15.945 [288/710] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:15.945 [289/710] Linking static target lib/acl/libavx512_tmp.a 00:01:15.945 [290/710] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:15.945 [291/710] Linking static target lib/librte_acl.a 00:01:15.945 [292/710] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:15.945 [293/710] Linking static target lib/librte_power.a 00:01:15.945 [294/710] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:15.945 [295/710] Linking static target lib/librte_reorder.a 00:01:16.212 [296/710] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.212 [297/710] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:16.212 [298/710] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.212 [299/710] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:16.212 [300/710] Linking static target lib/librte_security.a 00:01:16.475 [301/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:16.475 [302/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:16.475 [303/710] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:16.475 [304/710] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:16.475 [305/710] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.475 [306/710] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.475 [307/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:16.475 [308/710] Linking static target lib/librte_rib.a 00:01:16.475 [309/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:16.765 [310/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:01:16.766 [311/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:16.766 [312/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:01:16.766 [313/710] Linking static target lib/librte_mbuf.a 00:01:16.766 [314/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:01:16.766 [315/710] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:16.766 [316/710] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:16.766 [317/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:01:16.766 [318/710] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.035 [319/710] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:17.035 [320/710] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:17.035 [321/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:17.035 [322/710] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:17.035 [323/710] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:17.035 [324/710] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.035 [325/710] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:17.035 [326/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:17.294 [327/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:17.294 [328/710] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.294 [329/710] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.294 [330/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:17.294 [331/710] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:17.553 [332/710] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:01:17.553 [333/710] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:17.553 [334/710] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:17.553 [335/710] Linking static target lib/librte_member.a 00:01:17.814 [336/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:17.814 [337/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:17.814 [338/710] Linking static target lib/librte_eventdev.a 00:01:17.814 [339/710] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:17.814 [340/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:17.814 [341/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:18.078 [342/710] Linking static target lib/librte_cryptodev.a 00:01:18.078 [343/710] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:18.078 [344/710] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:18.078 [345/710] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.078 [346/710] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:18.078 [347/710] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:18.078 [348/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:18.078 [349/710] Linking static target lib/librte_sched.a 00:01:18.078 [350/710] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:18.078 [351/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:18.339 [352/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:18.339 [353/710] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:18.339 [354/710] Linking static target lib/librte_ethdev.a 00:01:18.339 [355/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:18.339 [356/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:18.339 [357/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:18.339 [358/710] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:18.339 [359/710] Linking static target lib/librte_fib.a 00:01:18.339 [360/710] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:18.339 [361/710] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:18.598 [362/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:18.598 [363/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:18.598 [364/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:18.598 [365/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:18.598 [366/710] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:18.861 [367/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:18.861 [368/710] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.861 [369/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:18.861 [370/710] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:18.861 [371/710] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:18.861 [372/710] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:18.861 [373/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:19.126 [374/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:19.126 [375/710] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:19.126 [376/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:19.126 [377/710] Linking static target lib/librte_pdump.a 00:01:19.389 [378/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:19.389 [379/710] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:19.389 [380/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:19.389 [381/710] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:19.389 [382/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:01:19.389 [383/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:19.389 [384/710] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:19.657 [385/710] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:19.657 [386/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:19.657 [387/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:19.657 [388/710] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:19.657 [389/710] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:01:19.657 [390/710] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.919 [391/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:19.919 [392/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:19.919 [393/710] Linking static target lib/librte_table.a 00:01:19.919 [394/710] Linking static target lib/librte_ipsec.a 00:01:19.919 [395/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:19.919 [396/710] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:19.919 [397/710] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:19.919 [398/710] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:20.182 [399/710] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:20.182 [400/710] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:01:20.454 [401/710] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.454 [402/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:20.713 [403/710] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:20.713 [404/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:20.714 [405/710] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:20.714 [406/710] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:20.974 [407/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:20.974 [408/710] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.974 [409/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:20.974 [410/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:20.974 [411/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:20.974 [412/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:20.974 [413/710] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:20.974 [414/710] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:20.974 [415/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:01:20.974 [416/710] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:20.974 [417/710] Linking target lib/librte_eal.so.24.0 00:01:20.974 [418/710] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:21.235 [419/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:21.235 [420/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:21.235 [421/710] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:21.235 [422/710] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:21.235 [423/710] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:21.235 [424/710] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:21.235 [425/710] Linking target lib/librte_ring.so.24.0 00:01:21.235 [426/710] Linking target lib/librte_meter.so.24.0 00:01:21.235 [427/710] Linking target lib/librte_pci.so.24.0 00:01:21.505 [428/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:21.505 [429/710] Linking target lib/librte_timer.so.24.0 00:01:21.505 [430/710] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:21.505 [431/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:21.505 [432/710] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:21.505 [433/710] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:21.505 [434/710] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:21.505 [435/710] Linking target lib/librte_rcu.so.24.0 00:01:21.505 [436/710] Linking target lib/librte_mempool.so.24.0 00:01:21.765 [437/710] Linking target lib/librte_acl.so.24.0 00:01:21.765 [438/710] Linking target lib/librte_dmadev.so.24.0 00:01:21.765 [439/710] Linking target lib/librte_cfgfile.so.24.0 00:01:21.765 [440/710] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:21.765 [441/710] Linking target lib/librte_jobstats.so.24.0 00:01:21.765 [442/710] Linking target lib/librte_stack.so.24.0 00:01:21.765 [443/710] Linking target lib/librte_rawdev.so.24.0 00:01:21.765 [444/710] Linking static target lib/librte_port.a 00:01:21.765 [445/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:01:21.765 [446/710] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:21.765 [447/710] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:21.765 [448/710] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:21.765 [449/710] Linking static target drivers/librte_bus_pci.a 00:01:21.765 [450/710] Linking static target lib/librte_graph.a 00:01:21.765 [451/710] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:21.765 [452/710] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:01:21.765 [453/710] Generating symbol file lib/librte_acl.so.24.0.p/librte_acl.so.24.0.symbols 00:01:22.028 [454/710] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:22.028 [455/710] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:22.028 [456/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:22.028 [457/710] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:22.028 [458/710] Linking static target drivers/librte_bus_vdev.a 00:01:22.028 [459/710] Linking target lib/librte_rib.so.24.0 00:01:22.028 [460/710] Linking target lib/librte_mbuf.so.24.0 00:01:22.028 [461/710] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:01:22.028 [462/710] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:22.028 [463/710] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:01:22.028 [464/710] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:22.028 [465/710] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:22.290 [466/710] Generating symbol file lib/librte_rib.so.24.0.p/librte_rib.so.24.0.symbols 00:01:22.290 [467/710] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:01:22.290 [468/710] Linking target lib/librte_bbdev.so.24.0 00:01:22.290 [469/710] Linking target lib/librte_net.so.24.0 00:01:22.290 [470/710] Linking target lib/librte_compressdev.so.24.0 00:01:22.290 [471/710] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:01:22.290 [472/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:22.290 [473/710] Linking target lib/librte_cryptodev.so.24.0 00:01:22.290 [474/710] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.290 [475/710] Linking target lib/librte_distributor.so.24.0 00:01:22.290 [476/710] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:01:22.290 [477/710] Linking target lib/librte_gpudev.so.24.0 00:01:22.290 [478/710] Linking target lib/librte_regexdev.so.24.0 00:01:22.290 [479/710] Linking target lib/librte_mldev.so.24.0 00:01:22.557 [480/710] Linking target lib/librte_reorder.so.24.0 00:01:22.557 [481/710] Linking target lib/librte_sched.so.24.0 00:01:22.557 [482/710] Linking target lib/librte_fib.so.24.0 00:01:22.557 [483/710] Linking target drivers/librte_bus_vdev.so.24.0 00:01:22.557 [484/710] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:22.557 [485/710] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:22.557 [486/710] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:22.557 [487/710] Linking target lib/librte_cmdline.so.24.0 00:01:22.557 [488/710] Linking target lib/librte_hash.so.24.0 00:01:22.557 [489/710] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:22.557 [490/710] Linking static target drivers/librte_mempool_ring.a 00:01:22.557 [491/710] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:01:22.557 [492/710] Linking target lib/librte_security.so.24.0 00:01:22.557 [493/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:22.557 [494/710] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:01:22.557 [495/710] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:22.557 [496/710] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.557 [497/710] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.820 [498/710] Generating symbol file lib/librte_reorder.so.24.0.p/librte_reorder.so.24.0.symbols 00:01:22.821 [499/710] Generating symbol file lib/librte_sched.so.24.0.p/librte_sched.so.24.0.symbols 00:01:22.821 [500/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:22.821 [501/710] Generating symbol file drivers/librte_bus_vdev.so.24.0.p/librte_bus_vdev.so.24.0.symbols 00:01:22.821 [502/710] Linking target drivers/librte_mempool_ring.so.24.0 00:01:22.821 [503/710] Linking target drivers/librte_bus_pci.so.24.0 00:01:22.821 [504/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:22.821 [505/710] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:22.821 [506/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:22.821 [507/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:22.821 [508/710] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:22.821 [509/710] Generating symbol file lib/librte_security.so.24.0.p/librte_security.so.24.0.symbols 00:01:22.821 [510/710] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:22.821 [511/710] Linking target lib/librte_efd.so.24.0 00:01:23.083 [512/710] Linking target lib/librte_lpm.so.24.0 00:01:23.083 [513/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:01:23.083 [514/710] Linking target lib/librte_member.so.24.0 00:01:23.083 [515/710] Linking target lib/librte_ipsec.so.24.0 00:01:23.083 [516/710] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:01:23.083 [517/710] Generating symbol file drivers/librte_bus_pci.so.24.0.p/librte_bus_pci.so.24.0.symbols 00:01:23.083 [518/710] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:01:23.083 [519/710] Generating symbol file lib/librte_lpm.so.24.0.p/librte_lpm.so.24.0.symbols 00:01:23.083 [520/710] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:01:23.346 [521/710] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:01:23.346 [522/710] Generating symbol file lib/librte_ipsec.so.24.0.p/librte_ipsec.so.24.0.symbols 00:01:23.346 [523/710] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:01:23.609 [524/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:23.609 [525/710] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:01:23.872 [526/710] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:01:23.872 [527/710] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:23.872 [528/710] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:23.872 [529/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:23.872 [530/710] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:01:23.872 [531/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:23.872 [532/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:24.135 [533/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:24.405 [534/710] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:24.405 [535/710] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:24.405 [536/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:24.405 [537/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:24.405 [538/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:24.405 [539/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:24.405 [540/710] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:24.405 [541/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:24.671 [542/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:24.671 [543/710] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:24.935 [544/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:24.935 [545/710] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:24.935 [546/710] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:01:24.935 [547/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:24.935 [548/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:24.935 [549/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:25.198 [550/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:01:25.198 [551/710] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:25.198 [552/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:25.463 [553/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:01:25.463 [554/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:25.463 [555/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:25.463 [556/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:25.463 [557/710] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:25.463 [558/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:25.724 [559/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:01:25.724 [560/710] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:25.724 [561/710] Linking target lib/librte_ethdev.so.24.0 00:01:25.984 [562/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:25.984 [563/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:25.984 [564/710] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:26.247 [565/710] Linking target lib/librte_metrics.so.24.0 00:01:26.247 [566/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:26.247 [567/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:26.247 [568/710] Linking target lib/librte_bpf.so.24.0 00:01:26.247 [569/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:01:26.247 [570/710] Linking target lib/librte_eventdev.so.24.0 00:01:26.247 [571/710] Linking target lib/librte_gro.so.24.0 00:01:26.247 [572/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:26.247 [573/710] Generating symbol file lib/librte_metrics.so.24.0.p/librte_metrics.so.24.0.symbols 00:01:26.509 [574/710] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:26.509 [575/710] Linking target lib/librte_gso.so.24.0 00:01:26.509 [576/710] Linking target lib/librte_bitratestats.so.24.0 00:01:26.509 [577/710] Linking target lib/librte_ip_frag.so.24.0 00:01:26.509 [578/710] Generating symbol file lib/librte_bpf.so.24.0.p/librte_bpf.so.24.0.symbols 00:01:26.509 [579/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:01:26.509 [580/710] Linking target lib/librte_latencystats.so.24.0 00:01:26.509 [581/710] Linking target lib/librte_pcapng.so.24.0 00:01:26.509 [582/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:26.509 [583/710] Linking target lib/librte_power.so.24.0 00:01:26.509 [584/710] Generating symbol file lib/librte_eventdev.so.24.0.p/librte_eventdev.so.24.0.symbols 00:01:26.509 [585/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:26.509 [586/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:01:26.509 [587/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:01:26.509 [588/710] Linking target lib/librte_dispatcher.so.24.0 00:01:26.769 [589/710] Generating symbol file lib/librte_ip_frag.so.24.0.p/librte_ip_frag.so.24.0.symbols 00:01:26.769 [590/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:01:26.769 [591/710] Generating symbol file lib/librte_pcapng.so.24.0.p/librte_pcapng.so.24.0.symbols 00:01:26.769 [592/710] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:26.769 [593/710] Linking target lib/librte_port.so.24.0 00:01:26.769 [594/710] Linking target lib/librte_pdump.so.24.0 00:01:26.769 [595/710] Linking target lib/librte_graph.so.24.0 00:01:26.769 [596/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:01:26.769 [597/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:01:27.031 [598/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:01:27.031 [599/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:01:27.031 [600/710] Linking static target lib/librte_pdcp.a 00:01:27.031 [601/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:27.031 [602/710] Generating symbol file lib/librte_port.so.24.0.p/librte_port.so.24.0.symbols 00:01:27.031 [603/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:27.031 [604/710] Generating symbol file lib/librte_graph.so.24.0.p/librte_graph.so.24.0.symbols 00:01:27.031 [605/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:01:27.031 [606/710] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:27.031 [607/710] Linking target lib/librte_table.so.24.0 00:01:27.290 [608/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:27.290 [609/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:27.290 [610/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:27.290 [611/710] Generating symbol file lib/librte_table.so.24.0.p/librte_table.so.24.0.symbols 00:01:27.553 [612/710] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:01:27.553 [613/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:01:27.553 [614/710] Linking target lib/librte_pdcp.so.24.0 00:01:27.819 [615/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:27.819 [616/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:27.819 [617/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:27.819 [618/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:27.819 [619/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:27.819 [620/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:27.819 [621/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:27.819 [622/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:27.819 [623/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:28.079 [624/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:28.079 [625/710] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:28.079 [626/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:01:28.342 [627/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:28.342 [628/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:28.342 [629/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:28.603 [630/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:28.603 [631/710] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:28.603 [632/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:28.603 [633/710] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:28.863 [634/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:28.863 [635/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:28.863 [636/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:28.863 [637/710] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:01:28.863 [638/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:28.863 [639/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:29.123 [640/710] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:29.123 [641/710] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:29.123 [642/710] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:29.123 [643/710] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:29.381 [644/710] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:29.381 [645/710] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:29.381 [646/710] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:29.640 [647/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:29.640 [648/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:29.640 [649/710] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:29.640 [650/710] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:29.899 [651/710] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:29.899 [652/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:29.899 [653/710] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:29.899 [654/710] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:30.157 [655/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:30.157 [656/710] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:30.157 [657/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:30.157 [658/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:30.416 [659/710] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:30.416 [660/710] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:30.416 [661/710] Compiling C object drivers/librte_net_i40e.so.24.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:30.416 [662/710] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:30.416 [663/710] Linking static target drivers/librte_net_i40e.a 00:01:30.416 [664/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:30.674 [665/710] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:30.674 [666/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:30.932 [667/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:30.932 [668/710] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.190 [669/710] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:31.190 [670/710] Linking target drivers/librte_net_i40e.so.24.0 00:01:31.448 [671/710] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:31.448 [672/710] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:01:31.448 [673/710] Linking static target lib/librte_node.a 00:01:31.705 [674/710] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.963 [675/710] Linking target lib/librte_node.so.24.0 00:01:32.221 [676/710] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:33.155 [677/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:01:33.720 [678/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:33.721 [679/710] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:35.093 [680/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:01:35.659 [681/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:01:42.219 [682/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:14.345 [683/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:14.345 [684/710] Linking static target lib/librte_vhost.a 00:02:14.345 [685/710] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:14.345 [686/710] Linking target lib/librte_vhost.so.24.0 00:02:22.461 [687/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:22.462 [688/710] Linking static target lib/librte_pipeline.a 00:02:23.030 [689/710] Linking target app/dpdk-dumpcap 00:02:23.030 [690/710] Linking target app/dpdk-proc-info 00:02:23.030 [691/710] Linking target app/dpdk-pdump 00:02:23.030 [692/710] Linking target app/dpdk-test-dma-perf 00:02:23.030 [693/710] Linking target app/dpdk-test-fib 00:02:23.030 [694/710] Linking target app/dpdk-test-acl 00:02:23.030 [695/710] Linking target app/dpdk-test-regex 00:02:23.030 [696/710] Linking target app/dpdk-test-cmdline 00:02:23.030 [697/710] Linking target app/dpdk-test-gpudev 00:02:23.030 [698/710] Linking target app/dpdk-test-security-perf 00:02:23.030 [699/710] Linking target app/dpdk-test-flow-perf 00:02:23.030 [700/710] Linking target app/dpdk-test-pipeline 00:02:23.030 [701/710] Linking target app/dpdk-test-bbdev 00:02:23.030 [702/710] Linking target app/dpdk-graph 00:02:23.030 [703/710] Linking target app/dpdk-test-mldev 00:02:23.030 [704/710] Linking target app/dpdk-test-crypto-perf 00:02:23.030 [705/710] Linking target app/dpdk-test-compress-perf 00:02:23.030 [706/710] Linking target app/dpdk-test-sad 00:02:23.030 [707/710] Linking target app/dpdk-testpmd 00:02:23.030 [708/710] Linking target app/dpdk-test-eventdev 00:02:25.565 [709/710] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:25.565 [710/710] Linking target lib/librte_pipeline.so.24.0 00:02:25.565 02:57:27 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:25.565 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:25.565 [0/1] Installing files. 00:02:25.565 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.565 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.566 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.567 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.568 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:25.828 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.829 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:25.830 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:25.831 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:25.831 Installing lib/librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing lib/librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing drivers/librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:26.402 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing drivers/librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:26.402 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing drivers/librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:26.402 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.402 Installing drivers/librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:26.402 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.402 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.403 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.404 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.405 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:26.406 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.407 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:26.407 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:26.407 Installing symlink pointing to librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:02:26.407 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:02:26.407 Installing symlink pointing to librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:02:26.407 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:26.407 Installing symlink pointing to librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:02:26.407 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:26.407 Installing symlink pointing to librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:02:26.407 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:26.407 Installing symlink pointing to librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:02:26.407 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:26.407 Installing symlink pointing to librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:02:26.407 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:26.407 Installing symlink pointing to librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:02:26.407 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:26.407 Installing symlink pointing to librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:02:26.407 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:26.407 Installing symlink pointing to librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:02:26.407 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:26.407 Installing symlink pointing to librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:02:26.407 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:26.407 Installing symlink pointing to librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:02:26.407 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:26.407 Installing symlink pointing to librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:02:26.407 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:26.407 Installing symlink pointing to librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:02:26.407 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:26.407 Installing symlink pointing to librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:02:26.407 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:26.407 Installing symlink pointing to librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:02:26.407 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:26.407 Installing symlink pointing to librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:02:26.407 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:26.407 Installing symlink pointing to librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:02:26.407 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:26.407 Installing symlink pointing to librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:02:26.407 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:26.407 Installing symlink pointing to librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:02:26.407 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:26.407 Installing symlink pointing to librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:02:26.407 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:26.407 Installing symlink pointing to librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:02:26.407 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:26.407 Installing symlink pointing to librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:02:26.407 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:26.407 Installing symlink pointing to librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:02:26.407 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:26.407 Installing symlink pointing to librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:02:26.407 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:26.407 Installing symlink pointing to librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:02:26.407 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:26.407 Installing symlink pointing to librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:02:26.407 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:26.407 Installing symlink pointing to librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:02:26.407 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:26.407 Installing symlink pointing to librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:02:26.407 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:02:26.407 Installing symlink pointing to librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:02:26.407 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:26.407 Installing symlink pointing to librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:02:26.407 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:26.407 Installing symlink pointing to librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:02:26.407 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:26.407 Installing symlink pointing to librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:02:26.407 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:26.407 Installing symlink pointing to librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:02:26.407 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:26.407 Installing symlink pointing to librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:02:26.407 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:26.407 Installing symlink pointing to librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:02:26.407 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:26.407 Installing symlink pointing to librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:02:26.407 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:26.407 Installing symlink pointing to librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:02:26.407 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:26.408 Installing symlink pointing to librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:02:26.408 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:26.408 Installing symlink pointing to librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:02:26.408 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:26.408 Installing symlink pointing to librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:02:26.408 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:26.408 './librte_bus_pci.so' -> 'dpdk/pmds-24.0/librte_bus_pci.so' 00:02:26.408 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24' 00:02:26.408 './librte_bus_pci.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24.0' 00:02:26.408 './librte_bus_vdev.so' -> 'dpdk/pmds-24.0/librte_bus_vdev.so' 00:02:26.408 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24' 00:02:26.408 './librte_bus_vdev.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24.0' 00:02:26.408 './librte_mempool_ring.so' -> 'dpdk/pmds-24.0/librte_mempool_ring.so' 00:02:26.408 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24' 00:02:26.408 './librte_mempool_ring.so.24.0' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24.0' 00:02:26.408 './librte_net_i40e.so' -> 'dpdk/pmds-24.0/librte_net_i40e.so' 00:02:26.408 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24' 00:02:26.408 './librte_net_i40e.so.24.0' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24.0' 00:02:26.408 Installing symlink pointing to librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:02:26.408 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:02:26.408 Installing symlink pointing to librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:02:26.408 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:26.408 Installing symlink pointing to librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:02:26.408 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:26.408 Installing symlink pointing to librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:02:26.408 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:26.408 Installing symlink pointing to librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:02:26.408 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:26.408 Installing symlink pointing to librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:02:26.408 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:26.408 Installing symlink pointing to librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:02:26.408 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:26.408 Installing symlink pointing to librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:02:26.408 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:26.408 Installing symlink pointing to librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:02:26.408 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:02:26.408 Installing symlink pointing to librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:02:26.408 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:26.408 Installing symlink pointing to librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:02:26.408 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:26.408 Installing symlink pointing to librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:02:26.408 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:26.408 Installing symlink pointing to librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:02:26.408 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:26.408 Installing symlink pointing to librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:02:26.408 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:26.408 Installing symlink pointing to librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:02:26.408 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:26.408 Installing symlink pointing to librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:02:26.408 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:26.408 Installing symlink pointing to librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24 00:02:26.408 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:02:26.408 Installing symlink pointing to librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24 00:02:26.408 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:02:26.408 Installing symlink pointing to librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24 00:02:26.408 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:02:26.408 Installing symlink pointing to librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24 00:02:26.408 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:02:26.408 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.0' 00:02:26.667 02:57:29 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:26.667 02:57:29 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:26.667 02:57:29 -- common/autobuild_common.sh@203 -- $ cat 00:02:26.667 02:57:29 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:26.667 00:02:26.667 real 1m25.788s 00:02:26.667 user 18m1.775s 00:02:26.667 sys 2m8.842s 00:02:26.667 02:57:29 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:26.667 02:57:29 -- common/autotest_common.sh@10 -- $ set +x 00:02:26.667 ************************************ 00:02:26.667 END TEST build_native_dpdk 00:02:26.667 ************************************ 00:02:26.667 02:57:29 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:26.667 02:57:29 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:26.667 02:57:29 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:26.667 02:57:29 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:26.667 02:57:29 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:26.667 02:57:29 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:26.667 02:57:29 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:26.667 02:57:29 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:26.667 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:26.667 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:26.667 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:26.667 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:26.926 Using 'verbs' RDMA provider 00:02:37.477 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:02:45.603 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:02:45.862 Creating mk/config.mk...done. 00:02:45.862 Creating mk/cc.flags.mk...done. 00:02:45.862 Type 'make' to build. 00:02:45.862 02:57:48 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:02:45.862 02:57:48 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:02:45.862 02:57:48 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:02:45.862 02:57:48 -- common/autotest_common.sh@10 -- $ set +x 00:02:45.862 ************************************ 00:02:45.862 START TEST make 00:02:45.862 ************************************ 00:02:45.862 02:57:48 -- common/autotest_common.sh@1114 -- $ make -j48 00:02:45.862 make[1]: Nothing to be done for 'all'. 00:02:47.783 The Meson build system 00:02:47.783 Version: 1.5.0 00:02:47.783 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:02:47.783 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:47.783 Build type: native build 00:02:47.783 Project name: libvfio-user 00:02:47.783 Project version: 0.0.1 00:02:47.783 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:02:47.783 C linker for the host machine: gcc ld.bfd 2.40-14 00:02:47.783 Host machine cpu family: x86_64 00:02:47.783 Host machine cpu: x86_64 00:02:47.783 Run-time dependency threads found: YES 00:02:47.783 Library dl found: YES 00:02:47.783 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:02:47.783 Run-time dependency json-c found: YES 0.17 00:02:47.783 Run-time dependency cmocka found: YES 1.1.7 00:02:47.783 Program pytest-3 found: NO 00:02:47.783 Program flake8 found: NO 00:02:47.783 Program misspell-fixer found: NO 00:02:47.783 Program restructuredtext-lint found: NO 00:02:47.783 Program valgrind found: YES (/usr/bin/valgrind) 00:02:47.783 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:02:47.783 Compiler for C supports arguments -Wmissing-declarations: YES 00:02:47.783 Compiler for C supports arguments -Wwrite-strings: YES 00:02:47.783 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:47.783 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:02:47.783 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:02:47.783 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:02:47.783 Build targets in project: 8 00:02:47.783 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:02:47.783 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:02:47.783 00:02:47.783 libvfio-user 0.0.1 00:02:47.783 00:02:47.783 User defined options 00:02:47.783 buildtype : debug 00:02:47.783 default_library: shared 00:02:47.783 libdir : /usr/local/lib 00:02:47.783 00:02:47.783 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:02:48.732 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:02:48.732 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:02:48.732 [2/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:02:48.732 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:02:48.732 [4/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:02:48.732 [5/37] Compiling C object samples/lspci.p/lspci.c.o 00:02:48.732 [6/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:02:48.732 [7/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:02:48.732 [8/37] Compiling C object samples/null.p/null.c.o 00:02:48.993 [9/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:02:48.993 [10/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:02:48.993 [11/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:02:48.993 [12/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:02:48.993 [13/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:02:48.993 [14/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:02:48.993 [15/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:02:48.993 [16/37] Compiling C object test/unit_tests.p/mocks.c.o 00:02:48.993 [17/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:02:48.993 [18/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:02:48.993 [19/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:02:48.993 [20/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:02:48.993 [21/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:02:48.993 [22/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:02:48.993 [23/37] Compiling C object samples/server.p/server.c.o 00:02:48.993 [24/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:02:48.993 [25/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:02:48.993 [26/37] Compiling C object samples/client.p/client.c.o 00:02:48.993 [27/37] Linking target samples/client 00:02:48.993 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:02:48.993 [29/37] Linking target lib/libvfio-user.so.0.0.1 00:02:49.260 [30/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:02:49.260 [31/37] Linking target test/unit_tests 00:02:49.260 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:02:49.260 [33/37] Linking target samples/lspci 00:02:49.260 [34/37] Linking target samples/gpio-pci-idio-16 00:02:49.260 [35/37] Linking target samples/shadow_ioeventfd_server 00:02:49.520 [36/37] Linking target samples/server 00:02:49.520 [37/37] Linking target samples/null 00:02:49.520 INFO: autodetecting backend as ninja 00:02:49.520 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:49.520 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:02:50.467 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:02:50.467 ninja: no work to do. 00:03:02.734 CC lib/log/log.o 00:03:02.734 CC lib/log/log_flags.o 00:03:02.734 CC lib/log/log_deprecated.o 00:03:02.734 CC lib/ut_mock/mock.o 00:03:02.734 CC lib/ut/ut.o 00:03:02.734 LIB libspdk_ut_mock.a 00:03:02.734 SO libspdk_ut_mock.so.5.0 00:03:02.734 LIB libspdk_log.a 00:03:02.734 LIB libspdk_ut.a 00:03:02.734 SO libspdk_ut.so.1.0 00:03:02.734 SO libspdk_log.so.6.1 00:03:02.734 SYMLINK libspdk_ut_mock.so 00:03:02.734 SYMLINK libspdk_ut.so 00:03:02.734 SYMLINK libspdk_log.so 00:03:02.734 CC lib/dma/dma.o 00:03:02.734 CC lib/util/base64.o 00:03:02.734 CC lib/util/bit_array.o 00:03:02.734 CXX lib/trace_parser/trace.o 00:03:02.734 CC lib/util/cpuset.o 00:03:02.734 CC lib/ioat/ioat.o 00:03:02.734 CC lib/util/crc16.o 00:03:02.734 CC lib/util/crc32.o 00:03:02.734 CC lib/util/crc32c.o 00:03:02.734 CC lib/util/crc32_ieee.o 00:03:02.734 CC lib/util/crc64.o 00:03:02.734 CC lib/util/dif.o 00:03:02.734 CC lib/util/fd.o 00:03:02.734 CC lib/util/file.o 00:03:02.734 CC lib/util/hexlify.o 00:03:02.734 CC lib/util/iov.o 00:03:02.734 CC lib/util/math.o 00:03:02.734 CC lib/util/pipe.o 00:03:02.734 CC lib/util/strerror_tls.o 00:03:02.734 CC lib/util/string.o 00:03:02.734 CC lib/util/uuid.o 00:03:02.734 CC lib/util/fd_group.o 00:03:02.734 CC lib/util/xor.o 00:03:02.734 CC lib/util/zipf.o 00:03:02.734 CC lib/vfio_user/host/vfio_user_pci.o 00:03:02.734 CC lib/vfio_user/host/vfio_user.o 00:03:02.734 LIB libspdk_dma.a 00:03:02.734 SO libspdk_dma.so.3.0 00:03:02.734 SYMLINK libspdk_dma.so 00:03:02.734 LIB libspdk_ioat.a 00:03:02.734 SO libspdk_ioat.so.6.0 00:03:02.734 LIB libspdk_vfio_user.a 00:03:02.734 SO libspdk_vfio_user.so.4.0 00:03:02.734 SYMLINK libspdk_ioat.so 00:03:02.734 SYMLINK libspdk_vfio_user.so 00:03:02.734 LIB libspdk_util.a 00:03:02.734 SO libspdk_util.so.8.0 00:03:02.734 SYMLINK libspdk_util.so 00:03:02.734 CC lib/vmd/vmd.o 00:03:02.734 CC lib/conf/conf.o 00:03:02.734 CC lib/json/json_parse.o 00:03:02.734 CC lib/vmd/led.o 00:03:02.734 CC lib/env_dpdk/env.o 00:03:02.734 CC lib/json/json_util.o 00:03:02.734 CC lib/env_dpdk/memory.o 00:03:02.734 CC lib/json/json_write.o 00:03:02.734 CC lib/env_dpdk/pci.o 00:03:02.734 CC lib/env_dpdk/init.o 00:03:02.734 CC lib/env_dpdk/threads.o 00:03:02.734 CC lib/idxd/idxd.o 00:03:02.734 CC lib/env_dpdk/pci_ioat.o 00:03:02.734 CC lib/idxd/idxd_user.o 00:03:02.734 CC lib/env_dpdk/pci_virtio.o 00:03:02.734 CC lib/rdma/common.o 00:03:02.734 CC lib/idxd/idxd_kernel.o 00:03:02.734 CC lib/env_dpdk/pci_vmd.o 00:03:02.734 CC lib/rdma/rdma_verbs.o 00:03:02.734 CC lib/env_dpdk/pci_idxd.o 00:03:02.734 CC lib/env_dpdk/pci_event.o 00:03:02.734 CC lib/env_dpdk/sigbus_handler.o 00:03:02.734 CC lib/env_dpdk/pci_dpdk.o 00:03:02.734 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:02.734 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:02.734 LIB libspdk_trace_parser.a 00:03:02.734 SO libspdk_trace_parser.so.4.0 00:03:02.734 LIB libspdk_conf.a 00:03:02.734 SYMLINK libspdk_trace_parser.so 00:03:02.734 SO libspdk_conf.so.5.0 00:03:02.734 LIB libspdk_json.a 00:03:02.734 SYMLINK libspdk_conf.so 00:03:02.734 SO libspdk_json.so.5.1 00:03:02.734 SYMLINK libspdk_json.so 00:03:02.734 LIB libspdk_rdma.a 00:03:02.734 SO libspdk_rdma.so.5.0 00:03:02.734 SYMLINK libspdk_rdma.so 00:03:02.734 CC lib/jsonrpc/jsonrpc_server.o 00:03:02.734 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:02.734 CC lib/jsonrpc/jsonrpc_client.o 00:03:02.734 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:02.734 LIB libspdk_idxd.a 00:03:02.734 SO libspdk_idxd.so.11.0 00:03:02.734 SYMLINK libspdk_idxd.so 00:03:02.734 LIB libspdk_vmd.a 00:03:02.734 SO libspdk_vmd.so.5.0 00:03:02.734 SYMLINK libspdk_vmd.so 00:03:02.734 LIB libspdk_jsonrpc.a 00:03:02.734 SO libspdk_jsonrpc.so.5.1 00:03:02.734 SYMLINK libspdk_jsonrpc.so 00:03:02.992 CC lib/rpc/rpc.o 00:03:02.992 LIB libspdk_rpc.a 00:03:02.992 SO libspdk_rpc.so.5.0 00:03:03.251 SYMLINK libspdk_rpc.so 00:03:03.251 CC lib/trace/trace.o 00:03:03.251 CC lib/trace/trace_flags.o 00:03:03.251 CC lib/trace/trace_rpc.o 00:03:03.251 CC lib/notify/notify.o 00:03:03.251 CC lib/notify/notify_rpc.o 00:03:03.251 CC lib/sock/sock.o 00:03:03.251 CC lib/sock/sock_rpc.o 00:03:03.509 LIB libspdk_notify.a 00:03:03.509 SO libspdk_notify.so.5.0 00:03:03.509 LIB libspdk_trace.a 00:03:03.509 SYMLINK libspdk_notify.so 00:03:03.509 SO libspdk_trace.so.9.0 00:03:03.509 SYMLINK libspdk_trace.so 00:03:03.509 LIB libspdk_sock.a 00:03:03.768 SO libspdk_sock.so.8.0 00:03:03.768 CC lib/thread/thread.o 00:03:03.768 CC lib/thread/iobuf.o 00:03:03.768 SYMLINK libspdk_sock.so 00:03:03.768 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:03.768 CC lib/nvme/nvme_ctrlr.o 00:03:03.768 CC lib/nvme/nvme_fabric.o 00:03:03.768 CC lib/nvme/nvme_ns_cmd.o 00:03:03.768 CC lib/nvme/nvme_ns.o 00:03:03.768 CC lib/nvme/nvme_pcie_common.o 00:03:03.768 CC lib/nvme/nvme_pcie.o 00:03:03.768 CC lib/nvme/nvme_qpair.o 00:03:03.768 CC lib/nvme/nvme.o 00:03:03.768 CC lib/nvme/nvme_quirks.o 00:03:03.768 CC lib/nvme/nvme_transport.o 00:03:03.768 CC lib/nvme/nvme_discovery.o 00:03:03.768 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:03.768 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:03.768 CC lib/nvme/nvme_tcp.o 00:03:03.768 CC lib/nvme/nvme_opal.o 00:03:03.768 CC lib/nvme/nvme_io_msg.o 00:03:03.768 CC lib/nvme/nvme_poll_group.o 00:03:03.768 CC lib/nvme/nvme_zns.o 00:03:03.768 CC lib/nvme/nvme_cuse.o 00:03:03.768 CC lib/nvme/nvme_vfio_user.o 00:03:03.768 CC lib/nvme/nvme_rdma.o 00:03:04.027 LIB libspdk_env_dpdk.a 00:03:04.027 SO libspdk_env_dpdk.so.13.0 00:03:04.027 SYMLINK libspdk_env_dpdk.so 00:03:05.402 LIB libspdk_thread.a 00:03:05.402 SO libspdk_thread.so.9.0 00:03:05.402 SYMLINK libspdk_thread.so 00:03:05.402 CC lib/virtio/virtio.o 00:03:05.402 CC lib/blob/blobstore.o 00:03:05.402 CC lib/virtio/virtio_vhost_user.o 00:03:05.402 CC lib/init/json_config.o 00:03:05.402 CC lib/vfu_tgt/tgt_endpoint.o 00:03:05.402 CC lib/virtio/virtio_vfio_user.o 00:03:05.402 CC lib/accel/accel.o 00:03:05.402 CC lib/blob/request.o 00:03:05.402 CC lib/init/subsystem.o 00:03:05.402 CC lib/virtio/virtio_pci.o 00:03:05.402 CC lib/vfu_tgt/tgt_rpc.o 00:03:05.402 CC lib/init/subsystem_rpc.o 00:03:05.402 CC lib/blob/zeroes.o 00:03:05.402 CC lib/accel/accel_rpc.o 00:03:05.402 CC lib/init/rpc.o 00:03:05.402 CC lib/accel/accel_sw.o 00:03:05.402 CC lib/blob/blob_bs_dev.o 00:03:05.662 LIB libspdk_init.a 00:03:05.662 SO libspdk_init.so.4.0 00:03:05.920 SYMLINK libspdk_init.so 00:03:05.920 LIB libspdk_virtio.a 00:03:05.920 LIB libspdk_vfu_tgt.a 00:03:05.920 SO libspdk_virtio.so.6.0 00:03:05.920 SO libspdk_vfu_tgt.so.2.0 00:03:05.920 SYMLINK libspdk_vfu_tgt.so 00:03:05.920 SYMLINK libspdk_virtio.so 00:03:05.920 CC lib/event/app.o 00:03:05.920 CC lib/event/reactor.o 00:03:05.920 CC lib/event/log_rpc.o 00:03:05.920 CC lib/event/app_rpc.o 00:03:05.920 CC lib/event/scheduler_static.o 00:03:06.178 LIB libspdk_nvme.a 00:03:06.437 SO libspdk_nvme.so.12.0 00:03:06.437 LIB libspdk_event.a 00:03:06.437 SO libspdk_event.so.12.0 00:03:06.437 SYMLINK libspdk_event.so 00:03:06.437 SYMLINK libspdk_nvme.so 00:03:06.700 LIB libspdk_accel.a 00:03:06.700 SO libspdk_accel.so.14.0 00:03:06.700 SYMLINK libspdk_accel.so 00:03:06.700 CC lib/bdev/bdev.o 00:03:06.700 CC lib/bdev/bdev_rpc.o 00:03:06.700 CC lib/bdev/bdev_zone.o 00:03:06.700 CC lib/bdev/part.o 00:03:06.700 CC lib/bdev/scsi_nvme.o 00:03:08.601 LIB libspdk_blob.a 00:03:08.601 SO libspdk_blob.so.10.1 00:03:08.601 SYMLINK libspdk_blob.so 00:03:08.601 CC lib/blobfs/blobfs.o 00:03:08.601 CC lib/blobfs/tree.o 00:03:08.601 CC lib/lvol/lvol.o 00:03:09.189 LIB libspdk_blobfs.a 00:03:09.189 SO libspdk_blobfs.so.9.0 00:03:09.448 SYMLINK libspdk_blobfs.so 00:03:09.448 LIB libspdk_bdev.a 00:03:09.448 SO libspdk_bdev.so.14.0 00:03:09.448 LIB libspdk_lvol.a 00:03:09.448 SO libspdk_lvol.so.9.1 00:03:09.448 SYMLINK libspdk_bdev.so 00:03:09.448 SYMLINK libspdk_lvol.so 00:03:09.448 CC lib/scsi/dev.o 00:03:09.448 CC lib/nbd/nbd.o 00:03:09.448 CC lib/nvmf/ctrlr.o 00:03:09.448 CC lib/scsi/lun.o 00:03:09.448 CC lib/ublk/ublk.o 00:03:09.448 CC lib/nbd/nbd_rpc.o 00:03:09.448 CC lib/scsi/port.o 00:03:09.448 CC lib/nvmf/ctrlr_discovery.o 00:03:09.448 CC lib/ublk/ublk_rpc.o 00:03:09.448 CC lib/nvmf/ctrlr_bdev.o 00:03:09.448 CC lib/scsi/scsi.o 00:03:09.448 CC lib/ftl/ftl_core.o 00:03:09.448 CC lib/nvmf/subsystem.o 00:03:09.448 CC lib/scsi/scsi_bdev.o 00:03:09.448 CC lib/scsi/scsi_pr.o 00:03:09.448 CC lib/ftl/ftl_init.o 00:03:09.448 CC lib/nvmf/nvmf.o 00:03:09.448 CC lib/ftl/ftl_layout.o 00:03:09.448 CC lib/scsi/scsi_rpc.o 00:03:09.448 CC lib/nvmf/nvmf_rpc.o 00:03:09.448 CC lib/ftl/ftl_debug.o 00:03:09.448 CC lib/scsi/task.o 00:03:09.448 CC lib/nvmf/transport.o 00:03:09.448 CC lib/ftl/ftl_io.o 00:03:09.448 CC lib/ftl/ftl_sb.o 00:03:09.448 CC lib/nvmf/tcp.o 00:03:09.448 CC lib/ftl/ftl_l2p.o 00:03:09.448 CC lib/nvmf/vfio_user.o 00:03:09.712 CC lib/ftl/ftl_l2p_flat.o 00:03:09.712 CC lib/nvmf/rdma.o 00:03:09.712 CC lib/ftl/ftl_nv_cache.o 00:03:09.712 CC lib/ftl/ftl_band.o 00:03:09.712 CC lib/ftl/ftl_band_ops.o 00:03:09.712 CC lib/ftl/ftl_writer.o 00:03:09.712 CC lib/ftl/ftl_rq.o 00:03:09.712 CC lib/ftl/ftl_reloc.o 00:03:09.712 CC lib/ftl/ftl_l2p_cache.o 00:03:09.712 CC lib/ftl/ftl_p2l.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:09.712 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:09.973 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:09.973 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:09.973 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:09.973 CC lib/ftl/utils/ftl_conf.o 00:03:09.973 CC lib/ftl/utils/ftl_md.o 00:03:09.973 CC lib/ftl/utils/ftl_mempool.o 00:03:09.973 CC lib/ftl/utils/ftl_bitmap.o 00:03:09.973 CC lib/ftl/utils/ftl_property.o 00:03:09.973 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:09.973 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:09.973 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:09.973 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:09.973 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:09.973 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:09.973 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:09.973 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:09.973 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:09.973 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:09.973 CC lib/ftl/base/ftl_base_dev.o 00:03:10.231 CC lib/ftl/base/ftl_base_bdev.o 00:03:10.231 CC lib/ftl/ftl_trace.o 00:03:10.489 LIB libspdk_nbd.a 00:03:10.489 SO libspdk_nbd.so.6.0 00:03:10.489 SYMLINK libspdk_nbd.so 00:03:10.489 LIB libspdk_scsi.a 00:03:10.489 SO libspdk_scsi.so.8.0 00:03:10.489 SYMLINK libspdk_scsi.so 00:03:10.747 LIB libspdk_ublk.a 00:03:10.747 SO libspdk_ublk.so.2.0 00:03:10.747 CC lib/iscsi/conn.o 00:03:10.747 CC lib/vhost/vhost.o 00:03:10.747 CC lib/iscsi/init_grp.o 00:03:10.747 CC lib/vhost/vhost_rpc.o 00:03:10.747 CC lib/iscsi/iscsi.o 00:03:10.747 CC lib/iscsi/md5.o 00:03:10.747 CC lib/vhost/vhost_scsi.o 00:03:10.747 CC lib/iscsi/param.o 00:03:10.747 CC lib/vhost/vhost_blk.o 00:03:10.747 CC lib/iscsi/portal_grp.o 00:03:10.747 CC lib/vhost/rte_vhost_user.o 00:03:10.747 CC lib/iscsi/tgt_node.o 00:03:10.747 CC lib/iscsi/iscsi_subsystem.o 00:03:10.747 CC lib/iscsi/iscsi_rpc.o 00:03:10.747 CC lib/iscsi/task.o 00:03:10.747 SYMLINK libspdk_ublk.so 00:03:11.006 LIB libspdk_ftl.a 00:03:11.006 SO libspdk_ftl.so.8.0 00:03:11.265 SYMLINK libspdk_ftl.so 00:03:11.831 LIB libspdk_vhost.a 00:03:11.831 SO libspdk_vhost.so.7.1 00:03:12.090 SYMLINK libspdk_vhost.so 00:03:12.090 LIB libspdk_nvmf.a 00:03:12.090 SO libspdk_nvmf.so.17.0 00:03:12.090 LIB libspdk_iscsi.a 00:03:12.348 SO libspdk_iscsi.so.7.0 00:03:12.348 SYMLINK libspdk_nvmf.so 00:03:12.348 SYMLINK libspdk_iscsi.so 00:03:12.606 CC module/env_dpdk/env_dpdk_rpc.o 00:03:12.606 CC module/vfu_device/vfu_virtio.o 00:03:12.606 CC module/vfu_device/vfu_virtio_blk.o 00:03:12.606 CC module/vfu_device/vfu_virtio_scsi.o 00:03:12.606 CC module/vfu_device/vfu_virtio_rpc.o 00:03:12.606 CC module/sock/posix/posix.o 00:03:12.606 CC module/accel/dsa/accel_dsa.o 00:03:12.606 CC module/accel/ioat/accel_ioat_rpc.o 00:03:12.606 CC module/accel/error/accel_error.o 00:03:12.606 CC module/scheduler/gscheduler/gscheduler.o 00:03:12.606 CC module/blob/bdev/blob_bdev.o 00:03:12.606 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:12.606 CC module/accel/dsa/accel_dsa_rpc.o 00:03:12.606 CC module/accel/error/accel_error_rpc.o 00:03:12.606 CC module/accel/ioat/accel_ioat.o 00:03:12.606 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:12.606 CC module/accel/iaa/accel_iaa.o 00:03:12.606 CC module/accel/iaa/accel_iaa_rpc.o 00:03:12.606 LIB libspdk_env_dpdk_rpc.a 00:03:12.865 SO libspdk_env_dpdk_rpc.so.5.0 00:03:12.865 SYMLINK libspdk_env_dpdk_rpc.so 00:03:12.865 LIB libspdk_scheduler_dpdk_governor.a 00:03:12.865 LIB libspdk_scheduler_gscheduler.a 00:03:12.865 SO libspdk_scheduler_gscheduler.so.3.0 00:03:12.865 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:12.865 LIB libspdk_accel_error.a 00:03:12.865 LIB libspdk_accel_ioat.a 00:03:12.865 LIB libspdk_scheduler_dynamic.a 00:03:12.865 SO libspdk_accel_error.so.1.0 00:03:12.865 LIB libspdk_accel_iaa.a 00:03:12.865 SO libspdk_accel_ioat.so.5.0 00:03:12.865 SO libspdk_scheduler_dynamic.so.3.0 00:03:12.865 SYMLINK libspdk_scheduler_gscheduler.so 00:03:12.865 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:12.865 SO libspdk_accel_iaa.so.2.0 00:03:12.865 LIB libspdk_accel_dsa.a 00:03:12.865 SYMLINK libspdk_accel_error.so 00:03:12.865 SYMLINK libspdk_scheduler_dynamic.so 00:03:12.865 SYMLINK libspdk_accel_ioat.so 00:03:12.865 LIB libspdk_blob_bdev.a 00:03:12.865 SO libspdk_accel_dsa.so.4.0 00:03:12.865 SYMLINK libspdk_accel_iaa.so 00:03:12.865 SO libspdk_blob_bdev.so.10.1 00:03:12.865 SYMLINK libspdk_accel_dsa.so 00:03:12.865 SYMLINK libspdk_blob_bdev.so 00:03:13.124 CC module/bdev/error/vbdev_error.o 00:03:13.124 CC module/bdev/null/bdev_null.o 00:03:13.124 CC module/bdev/error/vbdev_error_rpc.o 00:03:13.124 CC module/bdev/delay/vbdev_delay.o 00:03:13.124 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:13.124 CC module/bdev/gpt/gpt.o 00:03:13.124 CC module/bdev/null/bdev_null_rpc.o 00:03:13.124 CC module/bdev/lvol/vbdev_lvol.o 00:03:13.124 CC module/blobfs/bdev/blobfs_bdev.o 00:03:13.124 CC module/bdev/nvme/bdev_nvme.o 00:03:13.124 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:13.124 CC module/bdev/gpt/vbdev_gpt.o 00:03:13.124 CC module/bdev/passthru/vbdev_passthru.o 00:03:13.124 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:13.124 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:13.124 CC module/bdev/raid/bdev_raid.o 00:03:13.124 CC module/bdev/ftl/bdev_ftl.o 00:03:13.124 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:13.124 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:13.124 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:13.124 CC module/bdev/nvme/nvme_rpc.o 00:03:13.124 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:13.124 CC module/bdev/raid/bdev_raid_rpc.o 00:03:13.124 CC module/bdev/malloc/bdev_malloc.o 00:03:13.124 CC module/bdev/nvme/bdev_mdns_client.o 00:03:13.124 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:13.124 CC module/bdev/aio/bdev_aio.o 00:03:13.124 CC module/bdev/split/vbdev_split.o 00:03:13.124 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:13.124 CC module/bdev/raid/bdev_raid_sb.o 00:03:13.124 CC module/bdev/nvme/vbdev_opal.o 00:03:13.124 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:13.124 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:13.124 CC module/bdev/split/vbdev_split_rpc.o 00:03:13.124 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:13.124 CC module/bdev/raid/raid0.o 00:03:13.124 CC module/bdev/aio/bdev_aio_rpc.o 00:03:13.124 CC module/bdev/raid/raid1.o 00:03:13.124 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:13.124 CC module/bdev/raid/concat.o 00:03:13.124 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:13.124 CC module/bdev/iscsi/bdev_iscsi.o 00:03:13.382 LIB libspdk_vfu_device.a 00:03:13.382 SO libspdk_vfu_device.so.2.0 00:03:13.382 SYMLINK libspdk_vfu_device.so 00:03:13.640 LIB libspdk_blobfs_bdev.a 00:03:13.640 LIB libspdk_bdev_passthru.a 00:03:13.640 LIB libspdk_sock_posix.a 00:03:13.640 SO libspdk_blobfs_bdev.so.5.0 00:03:13.640 SO libspdk_bdev_passthru.so.5.0 00:03:13.640 SO libspdk_sock_posix.so.5.0 00:03:13.640 LIB libspdk_bdev_gpt.a 00:03:13.640 SO libspdk_bdev_gpt.so.5.0 00:03:13.640 SYMLINK libspdk_blobfs_bdev.so 00:03:13.640 LIB libspdk_bdev_split.a 00:03:13.640 SYMLINK libspdk_bdev_passthru.so 00:03:13.640 SO libspdk_bdev_split.so.5.0 00:03:13.640 SYMLINK libspdk_sock_posix.so 00:03:13.640 LIB libspdk_bdev_null.a 00:03:13.640 SYMLINK libspdk_bdev_gpt.so 00:03:13.640 LIB libspdk_bdev_error.a 00:03:13.640 SO libspdk_bdev_null.so.5.0 00:03:13.640 SO libspdk_bdev_error.so.5.0 00:03:13.640 SYMLINK libspdk_bdev_split.so 00:03:13.640 LIB libspdk_bdev_zone_block.a 00:03:13.640 LIB libspdk_bdev_ftl.a 00:03:13.640 LIB libspdk_bdev_malloc.a 00:03:13.640 SO libspdk_bdev_zone_block.so.5.0 00:03:13.640 SO libspdk_bdev_ftl.so.5.0 00:03:13.640 LIB libspdk_bdev_iscsi.a 00:03:13.640 SYMLINK libspdk_bdev_null.so 00:03:13.640 SYMLINK libspdk_bdev_error.so 00:03:13.640 LIB libspdk_bdev_aio.a 00:03:13.640 SO libspdk_bdev_malloc.so.5.0 00:03:13.640 SO libspdk_bdev_iscsi.so.5.0 00:03:13.640 SO libspdk_bdev_aio.so.5.0 00:03:13.898 SYMLINK libspdk_bdev_zone_block.so 00:03:13.898 SYMLINK libspdk_bdev_ftl.so 00:03:13.898 LIB libspdk_bdev_delay.a 00:03:13.898 SYMLINK libspdk_bdev_malloc.so 00:03:13.898 SYMLINK libspdk_bdev_iscsi.so 00:03:13.898 SO libspdk_bdev_delay.so.5.0 00:03:13.898 SYMLINK libspdk_bdev_aio.so 00:03:13.898 SYMLINK libspdk_bdev_delay.so 00:03:13.898 LIB libspdk_bdev_lvol.a 00:03:13.898 SO libspdk_bdev_lvol.so.5.0 00:03:13.898 LIB libspdk_bdev_virtio.a 00:03:13.898 SYMLINK libspdk_bdev_lvol.so 00:03:13.898 SO libspdk_bdev_virtio.so.5.0 00:03:13.898 SYMLINK libspdk_bdev_virtio.so 00:03:14.156 LIB libspdk_bdev_raid.a 00:03:14.414 SO libspdk_bdev_raid.so.5.0 00:03:14.414 SYMLINK libspdk_bdev_raid.so 00:03:15.786 LIB libspdk_bdev_nvme.a 00:03:15.786 SO libspdk_bdev_nvme.so.6.0 00:03:15.786 SYMLINK libspdk_bdev_nvme.so 00:03:16.045 CC module/event/subsystems/iobuf/iobuf.o 00:03:16.045 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:16.045 CC module/event/subsystems/vmd/vmd.o 00:03:16.045 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:16.045 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:16.045 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:16.045 CC module/event/subsystems/sock/sock.o 00:03:16.045 CC module/event/subsystems/scheduler/scheduler.o 00:03:16.045 LIB libspdk_event_sock.a 00:03:16.045 LIB libspdk_event_vhost_blk.a 00:03:16.045 LIB libspdk_event_vfu_tgt.a 00:03:16.045 LIB libspdk_event_vmd.a 00:03:16.045 LIB libspdk_event_scheduler.a 00:03:16.045 SO libspdk_event_vhost_blk.so.2.0 00:03:16.045 SO libspdk_event_sock.so.4.0 00:03:16.045 LIB libspdk_event_iobuf.a 00:03:16.045 SO libspdk_event_vfu_tgt.so.2.0 00:03:16.045 SO libspdk_event_scheduler.so.3.0 00:03:16.045 SO libspdk_event_vmd.so.5.0 00:03:16.045 SO libspdk_event_iobuf.so.2.0 00:03:16.304 SYMLINK libspdk_event_vhost_blk.so 00:03:16.304 SYMLINK libspdk_event_vfu_tgt.so 00:03:16.304 SYMLINK libspdk_event_sock.so 00:03:16.304 SYMLINK libspdk_event_scheduler.so 00:03:16.304 SYMLINK libspdk_event_vmd.so 00:03:16.304 SYMLINK libspdk_event_iobuf.so 00:03:16.304 CC module/event/subsystems/accel/accel.o 00:03:16.562 LIB libspdk_event_accel.a 00:03:16.562 SO libspdk_event_accel.so.5.0 00:03:16.562 SYMLINK libspdk_event_accel.so 00:03:16.562 CC module/event/subsystems/bdev/bdev.o 00:03:16.819 LIB libspdk_event_bdev.a 00:03:16.819 SO libspdk_event_bdev.so.5.0 00:03:16.819 SYMLINK libspdk_event_bdev.so 00:03:17.077 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:17.077 CC module/event/subsystems/nbd/nbd.o 00:03:17.077 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:17.077 CC module/event/subsystems/scsi/scsi.o 00:03:17.077 CC module/event/subsystems/ublk/ublk.o 00:03:17.077 LIB libspdk_event_ublk.a 00:03:17.077 LIB libspdk_event_nbd.a 00:03:17.077 LIB libspdk_event_scsi.a 00:03:17.077 SO libspdk_event_ublk.so.2.0 00:03:17.077 SO libspdk_event_nbd.so.5.0 00:03:17.335 SO libspdk_event_scsi.so.5.0 00:03:17.335 SYMLINK libspdk_event_nbd.so 00:03:17.335 SYMLINK libspdk_event_ublk.so 00:03:17.335 SYMLINK libspdk_event_scsi.so 00:03:17.335 LIB libspdk_event_nvmf.a 00:03:17.335 SO libspdk_event_nvmf.so.5.0 00:03:17.335 SYMLINK libspdk_event_nvmf.so 00:03:17.335 CC module/event/subsystems/iscsi/iscsi.o 00:03:17.335 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:17.593 LIB libspdk_event_vhost_scsi.a 00:03:17.593 SO libspdk_event_vhost_scsi.so.2.0 00:03:17.593 LIB libspdk_event_iscsi.a 00:03:17.593 SO libspdk_event_iscsi.so.5.0 00:03:17.593 SYMLINK libspdk_event_vhost_scsi.so 00:03:17.593 SYMLINK libspdk_event_iscsi.so 00:03:17.593 SO libspdk.so.5.0 00:03:17.593 SYMLINK libspdk.so 00:03:17.855 CC app/spdk_nvme_perf/perf.o 00:03:17.855 CC app/trace_record/trace_record.o 00:03:17.855 CC app/spdk_lspci/spdk_lspci.o 00:03:17.855 CC app/spdk_top/spdk_top.o 00:03:17.855 CC app/spdk_nvme_discover/discovery_aer.o 00:03:17.855 CC app/spdk_nvme_identify/identify.o 00:03:17.855 CXX app/trace/trace.o 00:03:17.855 CC test/rpc_client/rpc_client_test.o 00:03:17.855 TEST_HEADER include/spdk/accel.h 00:03:17.855 TEST_HEADER include/spdk/accel_module.h 00:03:17.855 TEST_HEADER include/spdk/assert.h 00:03:17.855 TEST_HEADER include/spdk/barrier.h 00:03:17.855 TEST_HEADER include/spdk/base64.h 00:03:17.855 TEST_HEADER include/spdk/bdev.h 00:03:17.855 TEST_HEADER include/spdk/bdev_module.h 00:03:17.855 TEST_HEADER include/spdk/bdev_zone.h 00:03:17.855 TEST_HEADER include/spdk/bit_array.h 00:03:17.855 TEST_HEADER include/spdk/bit_pool.h 00:03:17.855 TEST_HEADER include/spdk/blob_bdev.h 00:03:17.855 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:17.855 TEST_HEADER include/spdk/blobfs.h 00:03:17.855 CC app/spdk_dd/spdk_dd.o 00:03:17.855 TEST_HEADER include/spdk/blob.h 00:03:17.855 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:17.855 TEST_HEADER include/spdk/conf.h 00:03:17.855 TEST_HEADER include/spdk/config.h 00:03:17.855 TEST_HEADER include/spdk/cpuset.h 00:03:17.855 CC app/nvmf_tgt/nvmf_main.o 00:03:17.855 TEST_HEADER include/spdk/crc16.h 00:03:17.855 CC app/iscsi_tgt/iscsi_tgt.o 00:03:17.855 TEST_HEADER include/spdk/crc32.h 00:03:17.855 TEST_HEADER include/spdk/crc64.h 00:03:17.855 TEST_HEADER include/spdk/dif.h 00:03:17.855 CC app/vhost/vhost.o 00:03:17.855 TEST_HEADER include/spdk/dma.h 00:03:17.855 TEST_HEADER include/spdk/endian.h 00:03:17.855 CC app/fio/nvme/fio_plugin.o 00:03:17.855 CC examples/util/zipf/zipf.o 00:03:17.855 CC examples/ioat/perf/perf.o 00:03:17.855 TEST_HEADER include/spdk/env_dpdk.h 00:03:17.855 CC examples/sock/hello_world/hello_sock.o 00:03:17.855 CC examples/idxd/perf/perf.o 00:03:17.855 CC examples/nvme/hello_world/hello_world.o 00:03:17.855 TEST_HEADER include/spdk/env.h 00:03:17.855 CC examples/vmd/lsvmd/lsvmd.o 00:03:17.855 TEST_HEADER include/spdk/event.h 00:03:17.855 CC examples/ioat/verify/verify.o 00:03:17.855 TEST_HEADER include/spdk/fd_group.h 00:03:17.855 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:17.855 CC examples/nvme/arbitration/arbitration.o 00:03:17.855 CC examples/accel/perf/accel_perf.o 00:03:17.855 CC test/event/event_perf/event_perf.o 00:03:17.855 CC test/app/histogram_perf/histogram_perf.o 00:03:17.855 CC test/app/jsoncat/jsoncat.o 00:03:17.855 CC test/event/reactor/reactor.o 00:03:17.855 TEST_HEADER include/spdk/fd.h 00:03:17.855 CC examples/nvme/reconnect/reconnect.o 00:03:17.855 CC test/thread/poller_perf/poller_perf.o 00:03:17.855 TEST_HEADER include/spdk/file.h 00:03:17.855 TEST_HEADER include/spdk/ftl.h 00:03:17.855 CC test/nvme/aer/aer.o 00:03:17.855 TEST_HEADER include/spdk/gpt_spec.h 00:03:17.855 TEST_HEADER include/spdk/hexlify.h 00:03:17.855 CC app/spdk_tgt/spdk_tgt.o 00:03:17.855 TEST_HEADER include/spdk/histogram_data.h 00:03:17.855 TEST_HEADER include/spdk/idxd.h 00:03:18.116 TEST_HEADER include/spdk/idxd_spec.h 00:03:18.116 TEST_HEADER include/spdk/init.h 00:03:18.116 TEST_HEADER include/spdk/ioat.h 00:03:18.116 TEST_HEADER include/spdk/ioat_spec.h 00:03:18.116 TEST_HEADER include/spdk/iscsi_spec.h 00:03:18.116 TEST_HEADER include/spdk/json.h 00:03:18.116 TEST_HEADER include/spdk/jsonrpc.h 00:03:18.116 CC examples/bdev/hello_world/hello_bdev.o 00:03:18.116 TEST_HEADER include/spdk/likely.h 00:03:18.116 TEST_HEADER include/spdk/log.h 00:03:18.116 TEST_HEADER include/spdk/lvol.h 00:03:18.116 CC test/dma/test_dma/test_dma.o 00:03:18.116 CC examples/blob/cli/blobcli.o 00:03:18.116 TEST_HEADER include/spdk/memory.h 00:03:18.116 CC examples/thread/thread/thread_ex.o 00:03:18.116 CC test/bdev/bdevio/bdevio.o 00:03:18.116 CC examples/blob/hello_world/hello_blob.o 00:03:18.116 TEST_HEADER include/spdk/mmio.h 00:03:18.116 CC app/fio/bdev/fio_plugin.o 00:03:18.116 CC examples/bdev/bdevperf/bdevperf.o 00:03:18.116 TEST_HEADER include/spdk/nbd.h 00:03:18.116 CC examples/nvmf/nvmf/nvmf.o 00:03:18.116 TEST_HEADER include/spdk/notify.h 00:03:18.116 CC test/app/bdev_svc/bdev_svc.o 00:03:18.116 TEST_HEADER include/spdk/nvme.h 00:03:18.116 CC test/accel/dif/dif.o 00:03:18.116 CC test/blobfs/mkfs/mkfs.o 00:03:18.116 TEST_HEADER include/spdk/nvme_intel.h 00:03:18.116 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:18.116 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:18.116 TEST_HEADER include/spdk/nvme_spec.h 00:03:18.116 TEST_HEADER include/spdk/nvme_zns.h 00:03:18.116 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:18.116 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:18.116 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:18.116 TEST_HEADER include/spdk/nvmf.h 00:03:18.116 TEST_HEADER include/spdk/nvmf_spec.h 00:03:18.116 TEST_HEADER include/spdk/nvmf_transport.h 00:03:18.116 CC test/env/mem_callbacks/mem_callbacks.o 00:03:18.116 TEST_HEADER include/spdk/opal.h 00:03:18.116 CC test/lvol/esnap/esnap.o 00:03:18.116 TEST_HEADER include/spdk/opal_spec.h 00:03:18.116 TEST_HEADER include/spdk/pci_ids.h 00:03:18.116 TEST_HEADER include/spdk/pipe.h 00:03:18.116 TEST_HEADER include/spdk/queue.h 00:03:18.116 TEST_HEADER include/spdk/reduce.h 00:03:18.116 TEST_HEADER include/spdk/rpc.h 00:03:18.116 TEST_HEADER include/spdk/scheduler.h 00:03:18.116 TEST_HEADER include/spdk/scsi.h 00:03:18.116 TEST_HEADER include/spdk/scsi_spec.h 00:03:18.116 TEST_HEADER include/spdk/sock.h 00:03:18.116 TEST_HEADER include/spdk/stdinc.h 00:03:18.116 TEST_HEADER include/spdk/string.h 00:03:18.116 TEST_HEADER include/spdk/thread.h 00:03:18.116 TEST_HEADER include/spdk/trace.h 00:03:18.116 TEST_HEADER include/spdk/trace_parser.h 00:03:18.116 LINK spdk_lspci 00:03:18.116 TEST_HEADER include/spdk/tree.h 00:03:18.116 TEST_HEADER include/spdk/ublk.h 00:03:18.116 TEST_HEADER include/spdk/util.h 00:03:18.116 TEST_HEADER include/spdk/uuid.h 00:03:18.116 TEST_HEADER include/spdk/version.h 00:03:18.116 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:18.116 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:18.116 TEST_HEADER include/spdk/vhost.h 00:03:18.116 TEST_HEADER include/spdk/vmd.h 00:03:18.116 TEST_HEADER include/spdk/xor.h 00:03:18.116 TEST_HEADER include/spdk/zipf.h 00:03:18.116 CXX test/cpp_headers/accel.o 00:03:18.116 LINK lsvmd 00:03:18.116 LINK rpc_client_test 00:03:18.383 LINK jsoncat 00:03:18.383 LINK spdk_nvme_discover 00:03:18.383 LINK reactor 00:03:18.383 LINK zipf 00:03:18.383 LINK event_perf 00:03:18.383 LINK interrupt_tgt 00:03:18.383 LINK histogram_perf 00:03:18.383 LINK poller_perf 00:03:18.383 LINK nvmf_tgt 00:03:18.383 LINK vhost 00:03:18.383 LINK spdk_trace_record 00:03:18.383 LINK iscsi_tgt 00:03:18.383 LINK ioat_perf 00:03:18.383 LINK hello_world 00:03:18.383 LINK verify 00:03:18.383 LINK spdk_tgt 00:03:18.383 LINK bdev_svc 00:03:18.383 LINK hello_sock 00:03:18.383 LINK mkfs 00:03:18.383 LINK hello_bdev 00:03:18.383 LINK thread 00:03:18.383 LINK hello_blob 00:03:18.647 LINK aer 00:03:18.647 CXX test/cpp_headers/accel_module.o 00:03:18.647 CC examples/nvme/hotplug/hotplug.o 00:03:18.647 CXX test/cpp_headers/assert.o 00:03:18.647 CXX test/cpp_headers/barrier.o 00:03:18.647 LINK nvmf 00:03:18.647 LINK spdk_dd 00:03:18.647 LINK arbitration 00:03:18.647 CXX test/cpp_headers/base64.o 00:03:18.647 CC examples/vmd/led/led.o 00:03:18.647 LINK reconnect 00:03:18.647 LINK idxd_perf 00:03:18.647 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:18.647 CC test/nvme/reset/reset.o 00:03:18.647 CC test/env/vtophys/vtophys.o 00:03:18.647 CC test/event/reactor_perf/reactor_perf.o 00:03:18.647 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:18.647 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:18.647 CXX test/cpp_headers/bdev.o 00:03:18.647 LINK spdk_trace 00:03:18.647 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:18.647 CC test/nvme/sgl/sgl.o 00:03:18.647 LINK dif 00:03:18.647 LINK test_dma 00:03:18.647 LINK bdevio 00:03:18.913 CC test/event/app_repeat/app_repeat.o 00:03:18.913 CXX test/cpp_headers/bdev_module.o 00:03:18.913 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:18.913 CC test/app/stub/stub.o 00:03:18.913 LINK accel_perf 00:03:18.913 LINK nvme_fuzz 00:03:18.913 CC test/nvme/e2edp/nvme_dp.o 00:03:18.913 CXX test/cpp_headers/bdev_zone.o 00:03:18.913 LINK nvme_manage 00:03:18.913 CC test/event/scheduler/scheduler.o 00:03:18.913 CC test/env/memory/memory_ut.o 00:03:18.913 CC examples/nvme/abort/abort.o 00:03:18.913 LINK led 00:03:18.913 CXX test/cpp_headers/bit_array.o 00:03:18.913 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:18.913 LINK blobcli 00:03:18.913 LINK spdk_bdev 00:03:18.913 LINK reactor_perf 00:03:18.913 LINK vtophys 00:03:18.913 CXX test/cpp_headers/bit_pool.o 00:03:18.913 CC test/nvme/overhead/overhead.o 00:03:18.913 CC test/env/pci/pci_ut.o 00:03:18.913 CXX test/cpp_headers/blob_bdev.o 00:03:18.913 CC test/nvme/err_injection/err_injection.o 00:03:18.913 LINK hotplug 00:03:18.913 CXX test/cpp_headers/blobfs_bdev.o 00:03:18.913 LINK spdk_nvme 00:03:18.913 CC test/nvme/startup/startup.o 00:03:18.913 CC test/nvme/reserve/reserve.o 00:03:19.176 CC test/nvme/simple_copy/simple_copy.o 00:03:19.176 CC test/nvme/connect_stress/connect_stress.o 00:03:19.176 LINK cmb_copy 00:03:19.176 CC test/nvme/boot_partition/boot_partition.o 00:03:19.176 LINK app_repeat 00:03:19.176 LINK env_dpdk_post_init 00:03:19.176 LINK stub 00:03:19.176 CC test/nvme/compliance/nvme_compliance.o 00:03:19.176 CXX test/cpp_headers/blobfs.o 00:03:19.176 CXX test/cpp_headers/blob.o 00:03:19.176 CXX test/cpp_headers/conf.o 00:03:19.176 CXX test/cpp_headers/config.o 00:03:19.176 LINK reset 00:03:19.176 CC test/nvme/fused_ordering/fused_ordering.o 00:03:19.176 CXX test/cpp_headers/cpuset.o 00:03:19.176 CXX test/cpp_headers/crc16.o 00:03:19.176 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:19.176 CXX test/cpp_headers/crc32.o 00:03:19.176 CXX test/cpp_headers/crc64.o 00:03:19.176 CXX test/cpp_headers/dif.o 00:03:19.176 CC test/nvme/cuse/cuse.o 00:03:19.176 LINK sgl 00:03:19.176 CC test/nvme/fdp/fdp.o 00:03:19.176 CXX test/cpp_headers/dma.o 00:03:19.176 CXX test/cpp_headers/endian.o 00:03:19.438 CXX test/cpp_headers/env_dpdk.o 00:03:19.438 LINK pmr_persistence 00:03:19.438 CXX test/cpp_headers/env.o 00:03:19.438 LINK mem_callbacks 00:03:19.438 CXX test/cpp_headers/event.o 00:03:19.438 CXX test/cpp_headers/fd_group.o 00:03:19.438 LINK scheduler 00:03:19.438 LINK startup 00:03:19.438 CXX test/cpp_headers/fd.o 00:03:19.438 CXX test/cpp_headers/file.o 00:03:19.438 LINK err_injection 00:03:19.438 LINK nvme_dp 00:03:19.438 LINK boot_partition 00:03:19.438 LINK connect_stress 00:03:19.438 CXX test/cpp_headers/ftl.o 00:03:19.438 CXX test/cpp_headers/gpt_spec.o 00:03:19.438 LINK reserve 00:03:19.438 LINK spdk_nvme_perf 00:03:19.438 CXX test/cpp_headers/hexlify.o 00:03:19.438 CXX test/cpp_headers/histogram_data.o 00:03:19.438 LINK spdk_nvme_identify 00:03:19.438 CXX test/cpp_headers/idxd.o 00:03:19.438 LINK spdk_top 00:03:19.438 CXX test/cpp_headers/idxd_spec.o 00:03:19.438 LINK bdevperf 00:03:19.438 LINK overhead 00:03:19.438 CXX test/cpp_headers/init.o 00:03:19.438 CXX test/cpp_headers/ioat.o 00:03:19.438 LINK simple_copy 00:03:19.438 LINK vhost_fuzz 00:03:19.699 CXX test/cpp_headers/ioat_spec.o 00:03:19.699 CXX test/cpp_headers/iscsi_spec.o 00:03:19.699 CXX test/cpp_headers/json.o 00:03:19.699 LINK fused_ordering 00:03:19.699 CXX test/cpp_headers/jsonrpc.o 00:03:19.699 CXX test/cpp_headers/likely.o 00:03:19.699 CXX test/cpp_headers/log.o 00:03:19.699 CXX test/cpp_headers/lvol.o 00:03:19.699 LINK doorbell_aers 00:03:19.699 CXX test/cpp_headers/memory.o 00:03:19.699 CXX test/cpp_headers/mmio.o 00:03:19.699 LINK abort 00:03:19.699 CXX test/cpp_headers/nbd.o 00:03:19.699 CXX test/cpp_headers/notify.o 00:03:19.699 CXX test/cpp_headers/nvme.o 00:03:19.699 CXX test/cpp_headers/nvme_intel.o 00:03:19.699 LINK pci_ut 00:03:19.699 CXX test/cpp_headers/nvme_ocssd.o 00:03:19.699 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:19.699 CXX test/cpp_headers/nvme_spec.o 00:03:19.699 CXX test/cpp_headers/nvme_zns.o 00:03:19.699 CXX test/cpp_headers/nvmf_cmd.o 00:03:19.699 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:19.699 CXX test/cpp_headers/nvmf.o 00:03:19.699 CXX test/cpp_headers/nvmf_spec.o 00:03:19.699 CXX test/cpp_headers/nvmf_transport.o 00:03:19.699 CXX test/cpp_headers/opal.o 00:03:19.699 CXX test/cpp_headers/opal_spec.o 00:03:19.699 CXX test/cpp_headers/pci_ids.o 00:03:19.699 CXX test/cpp_headers/pipe.o 00:03:19.699 CXX test/cpp_headers/queue.o 00:03:19.699 CXX test/cpp_headers/reduce.o 00:03:19.699 LINK nvme_compliance 00:03:19.957 CXX test/cpp_headers/rpc.o 00:03:19.957 CXX test/cpp_headers/scheduler.o 00:03:19.957 CXX test/cpp_headers/scsi.o 00:03:19.957 CXX test/cpp_headers/scsi_spec.o 00:03:19.957 CXX test/cpp_headers/sock.o 00:03:19.957 CXX test/cpp_headers/stdinc.o 00:03:19.957 CXX test/cpp_headers/string.o 00:03:19.957 CXX test/cpp_headers/thread.o 00:03:19.957 CXX test/cpp_headers/trace.o 00:03:19.957 LINK fdp 00:03:19.957 CXX test/cpp_headers/trace_parser.o 00:03:19.957 CXX test/cpp_headers/tree.o 00:03:19.957 CXX test/cpp_headers/ublk.o 00:03:19.957 CXX test/cpp_headers/util.o 00:03:19.957 CXX test/cpp_headers/uuid.o 00:03:19.957 CXX test/cpp_headers/vfio_user_pci.o 00:03:19.957 CXX test/cpp_headers/version.o 00:03:19.957 CXX test/cpp_headers/vfio_user_spec.o 00:03:19.957 CXX test/cpp_headers/vhost.o 00:03:19.957 CXX test/cpp_headers/vmd.o 00:03:19.957 CXX test/cpp_headers/xor.o 00:03:19.957 CXX test/cpp_headers/zipf.o 00:03:20.522 LINK memory_ut 00:03:20.780 LINK cuse 00:03:21.037 LINK iscsi_fuzz 00:03:23.565 LINK esnap 00:03:23.825 00:03:23.825 real 0m38.005s 00:03:23.825 user 7m16.524s 00:03:23.825 sys 1m38.523s 00:03:23.825 02:58:26 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:23.825 02:58:26 -- common/autotest_common.sh@10 -- $ set +x 00:03:23.825 ************************************ 00:03:23.825 END TEST make 00:03:23.825 ************************************ 00:03:23.825 02:58:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:23.825 02:58:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:23.825 02:58:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:23.825 02:58:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:23.825 02:58:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:23.825 02:58:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:23.825 02:58:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:23.825 02:58:26 -- scripts/common.sh@335 -- # IFS=.-: 00:03:23.825 02:58:26 -- scripts/common.sh@335 -- # read -ra ver1 00:03:23.825 02:58:26 -- scripts/common.sh@336 -- # IFS=.-: 00:03:23.825 02:58:26 -- scripts/common.sh@336 -- # read -ra ver2 00:03:23.825 02:58:26 -- scripts/common.sh@337 -- # local 'op=<' 00:03:23.825 02:58:26 -- scripts/common.sh@339 -- # ver1_l=2 00:03:23.825 02:58:26 -- scripts/common.sh@340 -- # ver2_l=1 00:03:23.825 02:58:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:23.825 02:58:26 -- scripts/common.sh@343 -- # case "$op" in 00:03:23.825 02:58:26 -- scripts/common.sh@344 -- # : 1 00:03:23.825 02:58:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:23.825 02:58:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:23.825 02:58:26 -- scripts/common.sh@364 -- # decimal 1 00:03:23.825 02:58:26 -- scripts/common.sh@352 -- # local d=1 00:03:23.825 02:58:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:23.825 02:58:26 -- scripts/common.sh@354 -- # echo 1 00:03:23.825 02:58:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:23.825 02:58:26 -- scripts/common.sh@365 -- # decimal 2 00:03:23.825 02:58:26 -- scripts/common.sh@352 -- # local d=2 00:03:23.825 02:58:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:23.825 02:58:26 -- scripts/common.sh@354 -- # echo 2 00:03:23.825 02:58:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:23.825 02:58:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:23.825 02:58:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:23.825 02:58:26 -- scripts/common.sh@367 -- # return 0 00:03:23.825 02:58:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:23.825 02:58:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:23.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.825 --rc genhtml_branch_coverage=1 00:03:23.825 --rc genhtml_function_coverage=1 00:03:23.825 --rc genhtml_legend=1 00:03:23.825 --rc geninfo_all_blocks=1 00:03:23.825 --rc geninfo_unexecuted_blocks=1 00:03:23.825 00:03:23.825 ' 00:03:23.825 02:58:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:23.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.825 --rc genhtml_branch_coverage=1 00:03:23.825 --rc genhtml_function_coverage=1 00:03:23.825 --rc genhtml_legend=1 00:03:23.825 --rc geninfo_all_blocks=1 00:03:23.825 --rc geninfo_unexecuted_blocks=1 00:03:23.825 00:03:23.825 ' 00:03:23.825 02:58:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:23.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.825 --rc genhtml_branch_coverage=1 00:03:23.825 --rc genhtml_function_coverage=1 00:03:23.825 --rc genhtml_legend=1 00:03:23.825 --rc geninfo_all_blocks=1 00:03:23.825 --rc geninfo_unexecuted_blocks=1 00:03:23.825 00:03:23.825 ' 00:03:23.825 02:58:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:23.825 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:23.825 --rc genhtml_branch_coverage=1 00:03:23.825 --rc genhtml_function_coverage=1 00:03:23.825 --rc genhtml_legend=1 00:03:23.825 --rc geninfo_all_blocks=1 00:03:23.825 --rc geninfo_unexecuted_blocks=1 00:03:23.825 00:03:23.825 ' 00:03:23.825 02:58:26 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:23.825 02:58:26 -- nvmf/common.sh@7 -- # uname -s 00:03:23.825 02:58:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:23.825 02:58:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:23.825 02:58:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:23.825 02:58:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:23.825 02:58:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:23.825 02:58:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:23.825 02:58:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:23.825 02:58:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:23.825 02:58:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:23.825 02:58:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:23.825 02:58:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:23.825 02:58:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:23.825 02:58:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:23.825 02:58:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:23.825 02:58:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:23.825 02:58:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:23.825 02:58:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:23.825 02:58:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:23.825 02:58:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:23.825 02:58:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:23.825 02:58:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:23.825 02:58:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:23.825 02:58:26 -- paths/export.sh@5 -- # export PATH 00:03:23.825 02:58:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:23.825 02:58:26 -- nvmf/common.sh@46 -- # : 0 00:03:23.825 02:58:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:23.825 02:58:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:23.825 02:58:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:23.825 02:58:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:23.825 02:58:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:23.825 02:58:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:23.825 02:58:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:23.825 02:58:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:23.825 02:58:26 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:23.825 02:58:26 -- spdk/autotest.sh@32 -- # uname -s 00:03:23.825 02:58:26 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:23.825 02:58:26 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:23.825 02:58:26 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:23.825 02:58:26 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:23.825 02:58:26 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:23.825 02:58:26 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:24.084 02:58:26 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:24.084 02:58:26 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:24.084 02:58:26 -- spdk/autotest.sh@48 -- # udevadm_pid=2298255 00:03:24.084 02:58:26 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:24.084 02:58:26 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:24.084 02:58:26 -- spdk/autotest.sh@54 -- # echo 2298257 00:03:24.084 02:58:26 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:24.084 02:58:26 -- spdk/autotest.sh@56 -- # echo 2298258 00:03:24.084 02:58:26 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:24.084 02:58:26 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:24.084 02:58:26 -- spdk/autotest.sh@60 -- # echo 2298259 00:03:24.084 02:58:26 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:24.084 02:58:26 -- spdk/autotest.sh@62 -- # echo 2298260 00:03:24.084 02:58:26 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:24.084 02:58:26 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:24.084 02:58:26 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:24.084 02:58:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:24.084 02:58:26 -- common/autotest_common.sh@10 -- # set +x 00:03:24.084 02:58:26 -- spdk/autotest.sh@70 -- # create_test_list 00:03:24.084 02:58:26 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:24.084 02:58:26 -- common/autotest_common.sh@10 -- # set +x 00:03:24.084 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:24.084 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:24.084 02:58:26 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:24.084 02:58:26 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:24.084 02:58:26 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:24.084 02:58:26 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:24.084 02:58:26 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:24.084 02:58:26 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:24.084 02:58:26 -- common/autotest_common.sh@1450 -- # uname 00:03:24.084 02:58:26 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:24.084 02:58:26 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:24.084 02:58:26 -- common/autotest_common.sh@1470 -- # uname 00:03:24.084 02:58:26 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:24.084 02:58:26 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:24.084 02:58:26 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:24.084 lcov: LCOV version 1.15 00:03:24.084 02:58:26 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:28.271 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:28.271 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:28.271 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:28.271 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:28.271 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:28.271 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:06.999 02:59:04 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:06.999 02:59:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:06.999 02:59:04 -- common/autotest_common.sh@10 -- # set +x 00:04:06.999 02:59:04 -- spdk/autotest.sh@89 -- # rm -f 00:04:06.999 02:59:04 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:06.999 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:06.999 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:06.999 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:06.999 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:06.999 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:06.999 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:06.999 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:06.999 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:06.999 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:06.999 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:06.999 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:06.999 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:06.999 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:06.999 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:06.999 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:06.999 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:06.999 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:06.999 02:59:05 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:06.999 02:59:05 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:07.000 02:59:05 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:07.000 02:59:05 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:07.000 02:59:05 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:07.000 02:59:05 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:07.000 02:59:05 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:07.000 02:59:05 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:07.000 02:59:05 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:07.000 02:59:05 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:07.000 02:59:05 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:07.000 02:59:05 -- spdk/autotest.sh@108 -- # grep -v p 00:04:07.000 02:59:05 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:07.000 02:59:05 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:07.000 02:59:05 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:07.000 02:59:05 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:07.000 02:59:05 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:07.000 No valid GPT data, bailing 00:04:07.000 02:59:05 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:07.000 02:59:05 -- scripts/common.sh@393 -- # pt= 00:04:07.000 02:59:05 -- scripts/common.sh@394 -- # return 1 00:04:07.000 02:59:05 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:07.000 1+0 records in 00:04:07.000 1+0 records out 00:04:07.000 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00234693 s, 447 MB/s 00:04:07.000 02:59:05 -- spdk/autotest.sh@116 -- # sync 00:04:07.000 02:59:05 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:07.000 02:59:05 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:07.000 02:59:05 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:07.000 02:59:07 -- spdk/autotest.sh@122 -- # uname -s 00:04:07.000 02:59:07 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:07.000 02:59:07 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:07.000 02:59:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.000 02:59:07 -- common/autotest_common.sh@10 -- # set +x 00:04:07.000 ************************************ 00:04:07.000 START TEST setup.sh 00:04:07.000 ************************************ 00:04:07.000 02:59:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:07.000 * Looking for test storage... 00:04:07.000 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:07.000 02:59:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:07.000 02:59:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:07.000 02:59:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:07.000 02:59:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:07.000 02:59:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:07.000 02:59:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:07.000 02:59:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:07.000 02:59:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:07.000 02:59:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:07.000 02:59:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:07.000 02:59:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:07.000 02:59:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:07.000 02:59:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:07.000 02:59:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:07.000 02:59:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:07.000 02:59:07 -- scripts/common.sh@344 -- # : 1 00:04:07.000 02:59:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:07.000 02:59:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:07.000 02:59:07 -- scripts/common.sh@364 -- # decimal 1 00:04:07.000 02:59:07 -- scripts/common.sh@352 -- # local d=1 00:04:07.000 02:59:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:07.000 02:59:07 -- scripts/common.sh@354 -- # echo 1 00:04:07.000 02:59:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:07.000 02:59:07 -- scripts/common.sh@365 -- # decimal 2 00:04:07.000 02:59:07 -- scripts/common.sh@352 -- # local d=2 00:04:07.000 02:59:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:07.000 02:59:07 -- scripts/common.sh@354 -- # echo 2 00:04:07.000 02:59:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:07.000 02:59:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:07.000 02:59:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:07.000 02:59:07 -- scripts/common.sh@367 -- # return 0 00:04:07.000 02:59:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:07.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.000 --rc genhtml_branch_coverage=1 00:04:07.000 --rc genhtml_function_coverage=1 00:04:07.000 --rc genhtml_legend=1 00:04:07.000 --rc geninfo_all_blocks=1 00:04:07.000 --rc geninfo_unexecuted_blocks=1 00:04:07.000 00:04:07.000 ' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:07.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.000 --rc genhtml_branch_coverage=1 00:04:07.000 --rc genhtml_function_coverage=1 00:04:07.000 --rc genhtml_legend=1 00:04:07.000 --rc geninfo_all_blocks=1 00:04:07.000 --rc geninfo_unexecuted_blocks=1 00:04:07.000 00:04:07.000 ' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:07.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.000 --rc genhtml_branch_coverage=1 00:04:07.000 --rc genhtml_function_coverage=1 00:04:07.000 --rc genhtml_legend=1 00:04:07.000 --rc geninfo_all_blocks=1 00:04:07.000 --rc geninfo_unexecuted_blocks=1 00:04:07.000 00:04:07.000 ' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:07.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.000 --rc genhtml_branch_coverage=1 00:04:07.000 --rc genhtml_function_coverage=1 00:04:07.000 --rc genhtml_legend=1 00:04:07.000 --rc geninfo_all_blocks=1 00:04:07.000 --rc geninfo_unexecuted_blocks=1 00:04:07.000 00:04:07.000 ' 00:04:07.000 02:59:07 -- setup/test-setup.sh@10 -- # uname -s 00:04:07.000 02:59:07 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:07.000 02:59:07 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:07.000 02:59:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.000 02:59:07 -- common/autotest_common.sh@10 -- # set +x 00:04:07.000 ************************************ 00:04:07.000 START TEST acl 00:04:07.000 ************************************ 00:04:07.000 02:59:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:07.000 * Looking for test storage... 00:04:07.000 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:07.000 02:59:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:07.000 02:59:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:07.000 02:59:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:07.000 02:59:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:07.000 02:59:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:07.000 02:59:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:07.000 02:59:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:07.000 02:59:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:07.000 02:59:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:07.000 02:59:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:07.000 02:59:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:07.000 02:59:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:07.000 02:59:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:07.000 02:59:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:07.000 02:59:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:07.000 02:59:07 -- scripts/common.sh@344 -- # : 1 00:04:07.000 02:59:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:07.000 02:59:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:07.000 02:59:07 -- scripts/common.sh@364 -- # decimal 1 00:04:07.000 02:59:07 -- scripts/common.sh@352 -- # local d=1 00:04:07.000 02:59:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:07.000 02:59:07 -- scripts/common.sh@354 -- # echo 1 00:04:07.000 02:59:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:07.000 02:59:07 -- scripts/common.sh@365 -- # decimal 2 00:04:07.000 02:59:07 -- scripts/common.sh@352 -- # local d=2 00:04:07.000 02:59:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:07.000 02:59:07 -- scripts/common.sh@354 -- # echo 2 00:04:07.000 02:59:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:07.000 02:59:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:07.000 02:59:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:07.000 02:59:07 -- scripts/common.sh@367 -- # return 0 00:04:07.000 02:59:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:07.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.000 --rc genhtml_branch_coverage=1 00:04:07.000 --rc genhtml_function_coverage=1 00:04:07.000 --rc genhtml_legend=1 00:04:07.000 --rc geninfo_all_blocks=1 00:04:07.000 --rc geninfo_unexecuted_blocks=1 00:04:07.000 00:04:07.000 ' 00:04:07.000 02:59:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:07.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.000 --rc genhtml_branch_coverage=1 00:04:07.000 --rc genhtml_function_coverage=1 00:04:07.000 --rc genhtml_legend=1 00:04:07.000 --rc geninfo_all_blocks=1 00:04:07.000 --rc geninfo_unexecuted_blocks=1 00:04:07.000 00:04:07.001 ' 00:04:07.001 02:59:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:07.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.001 --rc genhtml_branch_coverage=1 00:04:07.001 --rc genhtml_function_coverage=1 00:04:07.001 --rc genhtml_legend=1 00:04:07.001 --rc geninfo_all_blocks=1 00:04:07.001 --rc geninfo_unexecuted_blocks=1 00:04:07.001 00:04:07.001 ' 00:04:07.001 02:59:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:07.001 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:07.001 --rc genhtml_branch_coverage=1 00:04:07.001 --rc genhtml_function_coverage=1 00:04:07.001 --rc genhtml_legend=1 00:04:07.001 --rc geninfo_all_blocks=1 00:04:07.001 --rc geninfo_unexecuted_blocks=1 00:04:07.001 00:04:07.001 ' 00:04:07.001 02:59:07 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:07.001 02:59:07 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:07.001 02:59:07 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:07.001 02:59:07 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:07.001 02:59:07 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:07.001 02:59:07 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:07.001 02:59:07 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:07.001 02:59:07 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:07.001 02:59:07 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:07.001 02:59:07 -- setup/acl.sh@12 -- # devs=() 00:04:07.001 02:59:07 -- setup/acl.sh@12 -- # declare -a devs 00:04:07.001 02:59:07 -- setup/acl.sh@13 -- # drivers=() 00:04:07.001 02:59:07 -- setup/acl.sh@13 -- # declare -A drivers 00:04:07.001 02:59:07 -- setup/acl.sh@51 -- # setup reset 00:04:07.001 02:59:07 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:07.001 02:59:07 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:07.001 02:59:09 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:07.001 02:59:09 -- setup/acl.sh@16 -- # local dev driver 00:04:07.001 02:59:09 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.001 02:59:09 -- setup/acl.sh@15 -- # setup output status 00:04:07.001 02:59:09 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:07.001 02:59:09 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:07.935 Hugepages 00:04:07.935 node hugesize free / total 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 00:04:07.935 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # continue 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:07.935 02:59:10 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:07.935 02:59:10 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:07.935 02:59:10 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:07.935 02:59:10 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:07.935 02:59:10 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:07.935 02:59:10 -- setup/acl.sh@54 -- # run_test denied denied 00:04:07.935 02:59:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:07.935 02:59:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:07.935 02:59:10 -- common/autotest_common.sh@10 -- # set +x 00:04:07.935 ************************************ 00:04:07.935 START TEST denied 00:04:07.935 ************************************ 00:04:07.935 02:59:10 -- common/autotest_common.sh@1114 -- # denied 00:04:07.935 02:59:10 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:07.935 02:59:10 -- setup/acl.sh@38 -- # setup output config 00:04:07.935 02:59:10 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:07.935 02:59:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:07.935 02:59:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:09.310 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:09.310 02:59:11 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:09.310 02:59:11 -- setup/acl.sh@28 -- # local dev driver 00:04:09.310 02:59:11 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:09.310 02:59:11 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:09.310 02:59:11 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:09.310 02:59:11 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:09.310 02:59:11 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:09.310 02:59:11 -- setup/acl.sh@41 -- # setup reset 00:04:09.310 02:59:11 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:09.310 02:59:11 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:11.843 00:04:11.843 real 0m4.065s 00:04:11.843 user 0m1.231s 00:04:11.843 sys 0m1.968s 00:04:11.843 02:59:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.843 02:59:14 -- common/autotest_common.sh@10 -- # set +x 00:04:11.843 ************************************ 00:04:11.843 END TEST denied 00:04:11.843 ************************************ 00:04:11.843 02:59:14 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:11.843 02:59:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.843 02:59:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.843 02:59:14 -- common/autotest_common.sh@10 -- # set +x 00:04:11.843 ************************************ 00:04:11.843 START TEST allowed 00:04:11.843 ************************************ 00:04:11.843 02:59:14 -- common/autotest_common.sh@1114 -- # allowed 00:04:11.843 02:59:14 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:11.843 02:59:14 -- setup/acl.sh@45 -- # setup output config 00:04:11.843 02:59:14 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:11.843 02:59:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:11.843 02:59:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:14.374 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:14.375 02:59:16 -- setup/acl.sh@47 -- # verify 00:04:14.375 02:59:16 -- setup/acl.sh@28 -- # local dev driver 00:04:14.375 02:59:16 -- setup/acl.sh@48 -- # setup reset 00:04:14.375 02:59:16 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:14.375 02:59:16 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:15.751 00:04:15.751 real 0m3.865s 00:04:15.751 user 0m0.989s 00:04:15.751 sys 0m1.745s 00:04:15.751 02:59:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.751 02:59:18 -- common/autotest_common.sh@10 -- # set +x 00:04:15.751 ************************************ 00:04:15.751 END TEST allowed 00:04:15.751 ************************************ 00:04:15.751 00:04:15.751 real 0m10.804s 00:04:15.751 user 0m3.356s 00:04:15.751 sys 0m5.548s 00:04:15.751 02:59:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:15.751 02:59:18 -- common/autotest_common.sh@10 -- # set +x 00:04:15.751 ************************************ 00:04:15.751 END TEST acl 00:04:15.751 ************************************ 00:04:15.751 02:59:18 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:15.751 02:59:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:15.751 02:59:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:15.751 02:59:18 -- common/autotest_common.sh@10 -- # set +x 00:04:15.751 ************************************ 00:04:15.751 START TEST hugepages 00:04:15.751 ************************************ 00:04:15.751 02:59:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:16.011 * Looking for test storage... 00:04:16.011 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:16.011 02:59:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:16.011 02:59:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:16.011 02:59:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:16.011 02:59:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:16.011 02:59:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:16.011 02:59:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:16.011 02:59:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:16.011 02:59:18 -- scripts/common.sh@335 -- # IFS=.-: 00:04:16.011 02:59:18 -- scripts/common.sh@335 -- # read -ra ver1 00:04:16.011 02:59:18 -- scripts/common.sh@336 -- # IFS=.-: 00:04:16.011 02:59:18 -- scripts/common.sh@336 -- # read -ra ver2 00:04:16.011 02:59:18 -- scripts/common.sh@337 -- # local 'op=<' 00:04:16.011 02:59:18 -- scripts/common.sh@339 -- # ver1_l=2 00:04:16.011 02:59:18 -- scripts/common.sh@340 -- # ver2_l=1 00:04:16.011 02:59:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:16.011 02:59:18 -- scripts/common.sh@343 -- # case "$op" in 00:04:16.011 02:59:18 -- scripts/common.sh@344 -- # : 1 00:04:16.011 02:59:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:16.011 02:59:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:16.011 02:59:18 -- scripts/common.sh@364 -- # decimal 1 00:04:16.011 02:59:18 -- scripts/common.sh@352 -- # local d=1 00:04:16.011 02:59:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:16.011 02:59:18 -- scripts/common.sh@354 -- # echo 1 00:04:16.011 02:59:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:16.011 02:59:18 -- scripts/common.sh@365 -- # decimal 2 00:04:16.011 02:59:18 -- scripts/common.sh@352 -- # local d=2 00:04:16.011 02:59:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:16.011 02:59:18 -- scripts/common.sh@354 -- # echo 2 00:04:16.011 02:59:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:16.011 02:59:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:16.011 02:59:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:16.011 02:59:18 -- scripts/common.sh@367 -- # return 0 00:04:16.011 02:59:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:16.011 02:59:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:16.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.011 --rc genhtml_branch_coverage=1 00:04:16.011 --rc genhtml_function_coverage=1 00:04:16.011 --rc genhtml_legend=1 00:04:16.011 --rc geninfo_all_blocks=1 00:04:16.011 --rc geninfo_unexecuted_blocks=1 00:04:16.011 00:04:16.011 ' 00:04:16.011 02:59:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:16.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.011 --rc genhtml_branch_coverage=1 00:04:16.011 --rc genhtml_function_coverage=1 00:04:16.011 --rc genhtml_legend=1 00:04:16.011 --rc geninfo_all_blocks=1 00:04:16.011 --rc geninfo_unexecuted_blocks=1 00:04:16.011 00:04:16.011 ' 00:04:16.011 02:59:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:16.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.011 --rc genhtml_branch_coverage=1 00:04:16.011 --rc genhtml_function_coverage=1 00:04:16.011 --rc genhtml_legend=1 00:04:16.011 --rc geninfo_all_blocks=1 00:04:16.011 --rc geninfo_unexecuted_blocks=1 00:04:16.011 00:04:16.011 ' 00:04:16.011 02:59:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:16.011 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:16.011 --rc genhtml_branch_coverage=1 00:04:16.011 --rc genhtml_function_coverage=1 00:04:16.011 --rc genhtml_legend=1 00:04:16.011 --rc geninfo_all_blocks=1 00:04:16.011 --rc geninfo_unexecuted_blocks=1 00:04:16.011 00:04:16.011 ' 00:04:16.011 02:59:18 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:16.011 02:59:18 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:16.011 02:59:18 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:16.011 02:59:18 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:16.011 02:59:18 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:16.011 02:59:18 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:16.011 02:59:18 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:16.011 02:59:18 -- setup/common.sh@18 -- # local node= 00:04:16.011 02:59:18 -- setup/common.sh@19 -- # local var val 00:04:16.011 02:59:18 -- setup/common.sh@20 -- # local mem_f mem 00:04:16.011 02:59:18 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:16.011 02:59:18 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:16.011 02:59:18 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:16.011 02:59:18 -- setup/common.sh@28 -- # mapfile -t mem 00:04:16.011 02:59:18 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:16.011 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.011 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 40923364 kB' 'MemAvailable: 44682176 kB' 'Buffers: 2708 kB' 'Cached: 12948132 kB' 'SwapCached: 0 kB' 'Active: 9637204 kB' 'Inactive: 3757844 kB' 'Active(anon): 9242372 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447620 kB' 'Mapped: 166264 kB' 'Shmem: 8798164 kB' 'KReclaimable: 199432 kB' 'Slab: 699440 kB' 'SReclaimable: 199432 kB' 'SUnreclaim: 500008 kB' 'KernelStack: 12736 kB' 'PageTables: 7780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559276 kB' 'Committed_AS: 10320528 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198136 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.012 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.012 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # continue 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # IFS=': ' 00:04:16.013 02:59:18 -- setup/common.sh@31 -- # read -r var val _ 00:04:16.013 02:59:18 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:16.013 02:59:18 -- setup/common.sh@33 -- # echo 2048 00:04:16.013 02:59:18 -- setup/common.sh@33 -- # return 0 00:04:16.013 02:59:18 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:16.013 02:59:18 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:16.013 02:59:18 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:16.013 02:59:18 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:16.013 02:59:18 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:16.013 02:59:18 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:16.013 02:59:18 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:16.013 02:59:18 -- setup/hugepages.sh@207 -- # get_nodes 00:04:16.013 02:59:18 -- setup/hugepages.sh@27 -- # local node 00:04:16.013 02:59:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:16.013 02:59:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:16.013 02:59:18 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:16.013 02:59:18 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:16.013 02:59:18 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:16.013 02:59:18 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:16.013 02:59:18 -- setup/hugepages.sh@208 -- # clear_hp 00:04:16.013 02:59:18 -- setup/hugepages.sh@37 -- # local node hp 00:04:16.013 02:59:18 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:16.013 02:59:18 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:16.013 02:59:18 -- setup/hugepages.sh@41 -- # echo 0 00:04:16.013 02:59:18 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:16.013 02:59:18 -- setup/hugepages.sh@41 -- # echo 0 00:04:16.013 02:59:18 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:16.013 02:59:18 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:16.013 02:59:18 -- setup/hugepages.sh@41 -- # echo 0 00:04:16.013 02:59:18 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:16.013 02:59:18 -- setup/hugepages.sh@41 -- # echo 0 00:04:16.013 02:59:18 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:16.013 02:59:18 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:16.013 02:59:18 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:16.013 02:59:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:16.013 02:59:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:16.013 02:59:18 -- common/autotest_common.sh@10 -- # set +x 00:04:16.013 ************************************ 00:04:16.013 START TEST default_setup 00:04:16.013 ************************************ 00:04:16.013 02:59:18 -- common/autotest_common.sh@1114 -- # default_setup 00:04:16.013 02:59:18 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:16.013 02:59:18 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:16.013 02:59:18 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:16.013 02:59:18 -- setup/hugepages.sh@51 -- # shift 00:04:16.013 02:59:18 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:16.013 02:59:18 -- setup/hugepages.sh@52 -- # local node_ids 00:04:16.013 02:59:18 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:16.013 02:59:18 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:16.013 02:59:18 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:16.013 02:59:18 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:16.013 02:59:18 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:16.013 02:59:18 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:16.013 02:59:18 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:16.013 02:59:18 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:16.013 02:59:18 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:16.013 02:59:18 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:16.013 02:59:18 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:16.013 02:59:18 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:16.013 02:59:18 -- setup/hugepages.sh@73 -- # return 0 00:04:16.013 02:59:18 -- setup/hugepages.sh@137 -- # setup output 00:04:16.013 02:59:18 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:16.013 02:59:18 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:17.387 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:17.387 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:17.387 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:17.387 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:17.387 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:17.387 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:17.387 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:17.387 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:17.387 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:17.387 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:17.387 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:17.387 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:17.387 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:17.387 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:17.387 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:17.387 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:18.322 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:18.586 02:59:20 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:18.586 02:59:20 -- setup/hugepages.sh@89 -- # local node 00:04:18.586 02:59:20 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:18.586 02:59:20 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:18.586 02:59:20 -- setup/hugepages.sh@92 -- # local surp 00:04:18.586 02:59:20 -- setup/hugepages.sh@93 -- # local resv 00:04:18.586 02:59:20 -- setup/hugepages.sh@94 -- # local anon 00:04:18.586 02:59:20 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:18.586 02:59:20 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:18.586 02:59:20 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:18.586 02:59:20 -- setup/common.sh@18 -- # local node= 00:04:18.586 02:59:20 -- setup/common.sh@19 -- # local var val 00:04:18.586 02:59:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.586 02:59:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.586 02:59:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.586 02:59:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.586 02:59:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.586 02:59:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.586 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.586 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43021268 kB' 'MemAvailable: 46780112 kB' 'Buffers: 2708 kB' 'Cached: 12948220 kB' 'SwapCached: 0 kB' 'Active: 9637736 kB' 'Inactive: 3757844 kB' 'Active(anon): 9242904 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447876 kB' 'Mapped: 165716 kB' 'Shmem: 8798252 kB' 'KReclaimable: 199496 kB' 'Slab: 699288 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499792 kB' 'KernelStack: 12784 kB' 'PageTables: 7940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10325620 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.587 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.587 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:18.588 02:59:20 -- setup/common.sh@33 -- # echo 0 00:04:18.588 02:59:20 -- setup/common.sh@33 -- # return 0 00:04:18.588 02:59:20 -- setup/hugepages.sh@97 -- # anon=0 00:04:18.588 02:59:20 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:18.588 02:59:20 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:18.588 02:59:20 -- setup/common.sh@18 -- # local node= 00:04:18.588 02:59:20 -- setup/common.sh@19 -- # local var val 00:04:18.588 02:59:20 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.588 02:59:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.588 02:59:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.588 02:59:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.588 02:59:20 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.588 02:59:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43022140 kB' 'MemAvailable: 46780984 kB' 'Buffers: 2708 kB' 'Cached: 12948220 kB' 'SwapCached: 0 kB' 'Active: 9638212 kB' 'Inactive: 3757844 kB' 'Active(anon): 9243380 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448336 kB' 'Mapped: 165784 kB' 'Shmem: 8798252 kB' 'KReclaimable: 199496 kB' 'Slab: 699524 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500028 kB' 'KernelStack: 12736 kB' 'PageTables: 7676 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10325632 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198248 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.588 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.588 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:20 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:20 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.589 02:59:21 -- setup/common.sh@33 -- # echo 0 00:04:18.589 02:59:21 -- setup/common.sh@33 -- # return 0 00:04:18.589 02:59:21 -- setup/hugepages.sh@99 -- # surp=0 00:04:18.589 02:59:21 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:18.589 02:59:21 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:18.589 02:59:21 -- setup/common.sh@18 -- # local node= 00:04:18.589 02:59:21 -- setup/common.sh@19 -- # local var val 00:04:18.589 02:59:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.589 02:59:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.589 02:59:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.589 02:59:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.589 02:59:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.589 02:59:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43022796 kB' 'MemAvailable: 46781640 kB' 'Buffers: 2708 kB' 'Cached: 12948236 kB' 'SwapCached: 0 kB' 'Active: 9638068 kB' 'Inactive: 3757844 kB' 'Active(anon): 9243236 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448164 kB' 'Mapped: 165672 kB' 'Shmem: 8798268 kB' 'KReclaimable: 199496 kB' 'Slab: 699516 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500020 kB' 'KernelStack: 12768 kB' 'PageTables: 7668 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10325644 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.589 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.589 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.590 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.590 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:18.590 02:59:21 -- setup/common.sh@33 -- # echo 0 00:04:18.590 02:59:21 -- setup/common.sh@33 -- # return 0 00:04:18.590 02:59:21 -- setup/hugepages.sh@100 -- # resv=0 00:04:18.590 02:59:21 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:18.590 nr_hugepages=1024 00:04:18.590 02:59:21 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:18.590 resv_hugepages=0 00:04:18.590 02:59:21 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:18.591 surplus_hugepages=0 00:04:18.591 02:59:21 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:18.591 anon_hugepages=0 00:04:18.591 02:59:21 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:18.591 02:59:21 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:18.591 02:59:21 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:18.591 02:59:21 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:18.591 02:59:21 -- setup/common.sh@18 -- # local node= 00:04:18.591 02:59:21 -- setup/common.sh@19 -- # local var val 00:04:18.591 02:59:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.591 02:59:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.591 02:59:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:18.591 02:59:21 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:18.591 02:59:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.591 02:59:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43023464 kB' 'MemAvailable: 46782308 kB' 'Buffers: 2708 kB' 'Cached: 12948252 kB' 'SwapCached: 0 kB' 'Active: 9638096 kB' 'Inactive: 3757844 kB' 'Active(anon): 9243264 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448132 kB' 'Mapped: 165672 kB' 'Shmem: 8798284 kB' 'KReclaimable: 199496 kB' 'Slab: 699516 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500020 kB' 'KernelStack: 12752 kB' 'PageTables: 7620 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10325660 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.591 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.591 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:18.592 02:59:21 -- setup/common.sh@33 -- # echo 1024 00:04:18.592 02:59:21 -- setup/common.sh@33 -- # return 0 00:04:18.592 02:59:21 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:18.592 02:59:21 -- setup/hugepages.sh@112 -- # get_nodes 00:04:18.592 02:59:21 -- setup/hugepages.sh@27 -- # local node 00:04:18.592 02:59:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:18.592 02:59:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:18.592 02:59:21 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:18.592 02:59:21 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:18.592 02:59:21 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:18.592 02:59:21 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:18.592 02:59:21 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:18.592 02:59:21 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:18.592 02:59:21 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:18.592 02:59:21 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:18.592 02:59:21 -- setup/common.sh@18 -- # local node=0 00:04:18.592 02:59:21 -- setup/common.sh@19 -- # local var val 00:04:18.592 02:59:21 -- setup/common.sh@20 -- # local mem_f mem 00:04:18.592 02:59:21 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:18.592 02:59:21 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:18.592 02:59:21 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:18.592 02:59:21 -- setup/common.sh@28 -- # mapfile -t mem 00:04:18.592 02:59:21 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26638812 kB' 'MemUsed: 6187044 kB' 'SwapCached: 0 kB' 'Active: 2632684 kB' 'Inactive: 176704 kB' 'Active(anon): 2479816 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2464136 kB' 'Mapped: 74252 kB' 'AnonPages: 348384 kB' 'Shmem: 2134564 kB' 'KernelStack: 7544 kB' 'PageTables: 4468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 107356 kB' 'Slab: 391080 kB' 'SReclaimable: 107356 kB' 'SUnreclaim: 283724 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.592 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.592 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # continue 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # IFS=': ' 00:04:18.593 02:59:21 -- setup/common.sh@31 -- # read -r var val _ 00:04:18.593 02:59:21 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:18.593 02:59:21 -- setup/common.sh@33 -- # echo 0 00:04:18.593 02:59:21 -- setup/common.sh@33 -- # return 0 00:04:18.593 02:59:21 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:18.593 02:59:21 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:18.593 02:59:21 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:18.593 02:59:21 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:18.593 02:59:21 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:18.593 node0=1024 expecting 1024 00:04:18.593 02:59:21 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:18.593 00:04:18.593 real 0m2.551s 00:04:18.593 user 0m0.669s 00:04:18.593 sys 0m0.997s 00:04:18.593 02:59:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:18.593 02:59:21 -- common/autotest_common.sh@10 -- # set +x 00:04:18.593 ************************************ 00:04:18.593 END TEST default_setup 00:04:18.593 ************************************ 00:04:18.593 02:59:21 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:18.593 02:59:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:18.593 02:59:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:18.593 02:59:21 -- common/autotest_common.sh@10 -- # set +x 00:04:18.593 ************************************ 00:04:18.593 START TEST per_node_1G_alloc 00:04:18.593 ************************************ 00:04:18.593 02:59:21 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:18.593 02:59:21 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:18.593 02:59:21 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:18.593 02:59:21 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:18.593 02:59:21 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:18.593 02:59:21 -- setup/hugepages.sh@51 -- # shift 00:04:18.593 02:59:21 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:18.593 02:59:21 -- setup/hugepages.sh@52 -- # local node_ids 00:04:18.593 02:59:21 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:18.593 02:59:21 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:18.593 02:59:21 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:18.593 02:59:21 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:18.593 02:59:21 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:18.593 02:59:21 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:18.593 02:59:21 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:18.593 02:59:21 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:18.593 02:59:21 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:18.593 02:59:21 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:18.593 02:59:21 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:18.593 02:59:21 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:18.593 02:59:21 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:18.593 02:59:21 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:18.593 02:59:21 -- setup/hugepages.sh@73 -- # return 0 00:04:18.593 02:59:21 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:18.593 02:59:21 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:18.593 02:59:21 -- setup/hugepages.sh@146 -- # setup output 00:04:18.593 02:59:21 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:18.593 02:59:21 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:19.974 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:19.974 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:19.974 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:19.974 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:19.974 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:19.974 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:19.974 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:19.974 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:19.974 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:19.974 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:19.974 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:19.974 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:19.974 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:19.974 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:19.974 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:19.974 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:19.974 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:19.974 02:59:22 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:19.974 02:59:22 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:19.974 02:59:22 -- setup/hugepages.sh@89 -- # local node 00:04:19.974 02:59:22 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:19.974 02:59:22 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:19.974 02:59:22 -- setup/hugepages.sh@92 -- # local surp 00:04:19.974 02:59:22 -- setup/hugepages.sh@93 -- # local resv 00:04:19.974 02:59:22 -- setup/hugepages.sh@94 -- # local anon 00:04:19.974 02:59:22 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:19.974 02:59:22 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:19.974 02:59:22 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:19.974 02:59:22 -- setup/common.sh@18 -- # local node= 00:04:19.974 02:59:22 -- setup/common.sh@19 -- # local var val 00:04:19.974 02:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.974 02:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.974 02:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.974 02:59:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.974 02:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.974 02:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43010976 kB' 'MemAvailable: 46769820 kB' 'Buffers: 2708 kB' 'Cached: 12948312 kB' 'SwapCached: 0 kB' 'Active: 9640048 kB' 'Inactive: 3757844 kB' 'Active(anon): 9245216 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450536 kB' 'Mapped: 166204 kB' 'Shmem: 8798344 kB' 'KReclaimable: 199496 kB' 'Slab: 699568 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500072 kB' 'KernelStack: 12736 kB' 'PageTables: 7580 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10328516 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.974 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.974 02:59:22 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:19.975 02:59:22 -- setup/common.sh@33 -- # echo 0 00:04:19.975 02:59:22 -- setup/common.sh@33 -- # return 0 00:04:19.975 02:59:22 -- setup/hugepages.sh@97 -- # anon=0 00:04:19.975 02:59:22 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:19.975 02:59:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:19.975 02:59:22 -- setup/common.sh@18 -- # local node= 00:04:19.975 02:59:22 -- setup/common.sh@19 -- # local var val 00:04:19.975 02:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.975 02:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.975 02:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.975 02:59:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.975 02:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.975 02:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43018344 kB' 'MemAvailable: 46777188 kB' 'Buffers: 2708 kB' 'Cached: 12948312 kB' 'SwapCached: 0 kB' 'Active: 9644568 kB' 'Inactive: 3757844 kB' 'Active(anon): 9249736 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 454648 kB' 'Mapped: 166228 kB' 'Shmem: 8798344 kB' 'KReclaimable: 199496 kB' 'Slab: 699632 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500136 kB' 'KernelStack: 12800 kB' 'PageTables: 7780 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10331972 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198396 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.975 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.975 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.976 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.976 02:59:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.977 02:59:22 -- setup/common.sh@33 -- # echo 0 00:04:19.977 02:59:22 -- setup/common.sh@33 -- # return 0 00:04:19.977 02:59:22 -- setup/hugepages.sh@99 -- # surp=0 00:04:19.977 02:59:22 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:19.977 02:59:22 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:19.977 02:59:22 -- setup/common.sh@18 -- # local node= 00:04:19.977 02:59:22 -- setup/common.sh@19 -- # local var val 00:04:19.977 02:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.977 02:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.977 02:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.977 02:59:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.977 02:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.977 02:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43016760 kB' 'MemAvailable: 46775604 kB' 'Buffers: 2708 kB' 'Cached: 12948324 kB' 'SwapCached: 0 kB' 'Active: 9643672 kB' 'Inactive: 3757844 kB' 'Active(anon): 9248840 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 453724 kB' 'Mapped: 166532 kB' 'Shmem: 8798356 kB' 'KReclaimable: 199496 kB' 'Slab: 699608 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500112 kB' 'KernelStack: 12848 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10331988 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.977 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.977 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:19.978 02:59:22 -- setup/common.sh@33 -- # echo 0 00:04:19.978 02:59:22 -- setup/common.sh@33 -- # return 0 00:04:19.978 02:59:22 -- setup/hugepages.sh@100 -- # resv=0 00:04:19.978 02:59:22 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:19.978 nr_hugepages=1024 00:04:19.978 02:59:22 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:19.978 resv_hugepages=0 00:04:19.978 02:59:22 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:19.978 surplus_hugepages=0 00:04:19.978 02:59:22 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:19.978 anon_hugepages=0 00:04:19.978 02:59:22 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:19.978 02:59:22 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:19.978 02:59:22 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:19.978 02:59:22 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:19.978 02:59:22 -- setup/common.sh@18 -- # local node= 00:04:19.978 02:59:22 -- setup/common.sh@19 -- # local var val 00:04:19.978 02:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.978 02:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.978 02:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:19.978 02:59:22 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:19.978 02:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.978 02:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43012488 kB' 'MemAvailable: 46771332 kB' 'Buffers: 2708 kB' 'Cached: 12948340 kB' 'SwapCached: 0 kB' 'Active: 9641248 kB' 'Inactive: 3757844 kB' 'Active(anon): 9246416 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451364 kB' 'Mapped: 166128 kB' 'Shmem: 8798372 kB' 'KReclaimable: 199496 kB' 'Slab: 699608 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500112 kB' 'KernelStack: 12816 kB' 'PageTables: 7708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10329744 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.978 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.978 02:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.979 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.979 02:59:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:19.980 02:59:22 -- setup/common.sh@33 -- # echo 1024 00:04:19.980 02:59:22 -- setup/common.sh@33 -- # return 0 00:04:19.980 02:59:22 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:19.980 02:59:22 -- setup/hugepages.sh@112 -- # get_nodes 00:04:19.980 02:59:22 -- setup/hugepages.sh@27 -- # local node 00:04:19.980 02:59:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:19.980 02:59:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:19.980 02:59:22 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:19.980 02:59:22 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:19.980 02:59:22 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:19.980 02:59:22 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:19.980 02:59:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:19.980 02:59:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:19.980 02:59:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:19.980 02:59:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:19.980 02:59:22 -- setup/common.sh@18 -- # local node=0 00:04:19.980 02:59:22 -- setup/common.sh@19 -- # local var val 00:04:19.980 02:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.980 02:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.980 02:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:19.980 02:59:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:19.980 02:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.980 02:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27682984 kB' 'MemUsed: 5142872 kB' 'SwapCached: 0 kB' 'Active: 2631672 kB' 'Inactive: 176704 kB' 'Active(anon): 2478804 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2464196 kB' 'Mapped: 74424 kB' 'AnonPages: 347272 kB' 'Shmem: 2134624 kB' 'KernelStack: 7608 kB' 'PageTables: 4448 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 107356 kB' 'Slab: 391004 kB' 'SReclaimable: 107356 kB' 'SUnreclaim: 283648 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.980 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.980 02:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@33 -- # echo 0 00:04:19.981 02:59:22 -- setup/common.sh@33 -- # return 0 00:04:19.981 02:59:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:19.981 02:59:22 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:19.981 02:59:22 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:19.981 02:59:22 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:19.981 02:59:22 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:19.981 02:59:22 -- setup/common.sh@18 -- # local node=1 00:04:19.981 02:59:22 -- setup/common.sh@19 -- # local var val 00:04:19.981 02:59:22 -- setup/common.sh@20 -- # local mem_f mem 00:04:19.981 02:59:22 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:19.981 02:59:22 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:19.981 02:59:22 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:19.981 02:59:22 -- setup/common.sh@28 -- # mapfile -t mem 00:04:19.981 02:59:22 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 15326636 kB' 'MemUsed: 12383156 kB' 'SwapCached: 0 kB' 'Active: 7006660 kB' 'Inactive: 3581140 kB' 'Active(anon): 6764696 kB' 'Inactive(anon): 0 kB' 'Active(file): 241964 kB' 'Inactive(file): 3581140 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10486880 kB' 'Mapped: 91748 kB' 'AnonPages: 101152 kB' 'Shmem: 6663776 kB' 'KernelStack: 5240 kB' 'PageTables: 3328 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 92140 kB' 'Slab: 308604 kB' 'SReclaimable: 92140 kB' 'SUnreclaim: 216464 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.981 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.981 02:59:22 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # continue 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # IFS=': ' 00:04:19.982 02:59:22 -- setup/common.sh@31 -- # read -r var val _ 00:04:19.982 02:59:22 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:19.982 02:59:22 -- setup/common.sh@33 -- # echo 0 00:04:19.982 02:59:22 -- setup/common.sh@33 -- # return 0 00:04:19.982 02:59:22 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:19.982 02:59:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:19.982 02:59:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:19.982 02:59:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:19.982 02:59:22 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:19.982 node0=512 expecting 512 00:04:19.982 02:59:22 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:19.982 02:59:22 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:19.982 02:59:22 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:19.982 02:59:22 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:19.982 node1=512 expecting 512 00:04:19.982 02:59:22 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:19.982 00:04:19.982 real 0m1.447s 00:04:19.982 user 0m0.559s 00:04:19.982 sys 0m0.851s 00:04:19.982 02:59:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.982 02:59:22 -- common/autotest_common.sh@10 -- # set +x 00:04:19.982 ************************************ 00:04:19.982 END TEST per_node_1G_alloc 00:04:19.982 ************************************ 00:04:19.982 02:59:22 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:19.982 02:59:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.982 02:59:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.982 02:59:22 -- common/autotest_common.sh@10 -- # set +x 00:04:19.982 ************************************ 00:04:19.982 START TEST even_2G_alloc 00:04:19.982 ************************************ 00:04:19.982 02:59:22 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:19.982 02:59:22 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:19.982 02:59:22 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:19.982 02:59:22 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:19.982 02:59:22 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:19.982 02:59:22 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:19.982 02:59:22 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:19.982 02:59:22 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:19.982 02:59:22 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:19.982 02:59:22 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:19.982 02:59:22 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:19.982 02:59:22 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:19.982 02:59:22 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:19.982 02:59:22 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:19.982 02:59:22 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:19.982 02:59:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:19.982 02:59:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:19.982 02:59:22 -- setup/hugepages.sh@83 -- # : 512 00:04:19.982 02:59:22 -- setup/hugepages.sh@84 -- # : 1 00:04:19.982 02:59:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:19.982 02:59:22 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:19.982 02:59:22 -- setup/hugepages.sh@83 -- # : 0 00:04:19.982 02:59:22 -- setup/hugepages.sh@84 -- # : 0 00:04:19.982 02:59:22 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:19.982 02:59:22 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:19.982 02:59:22 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:19.982 02:59:22 -- setup/hugepages.sh@153 -- # setup output 00:04:19.982 02:59:22 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:19.982 02:59:22 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:21.361 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:21.361 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:21.361 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:21.361 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:21.361 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:21.361 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:21.361 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:21.361 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:21.361 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:21.361 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:21.361 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:21.361 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:21.361 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:21.361 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:21.361 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:21.361 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:21.361 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:21.361 02:59:23 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:21.361 02:59:23 -- setup/hugepages.sh@89 -- # local node 00:04:21.361 02:59:23 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:21.361 02:59:23 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:21.361 02:59:23 -- setup/hugepages.sh@92 -- # local surp 00:04:21.361 02:59:23 -- setup/hugepages.sh@93 -- # local resv 00:04:21.361 02:59:23 -- setup/hugepages.sh@94 -- # local anon 00:04:21.361 02:59:23 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:21.361 02:59:23 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:21.361 02:59:23 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:21.361 02:59:23 -- setup/common.sh@18 -- # local node= 00:04:21.361 02:59:23 -- setup/common.sh@19 -- # local var val 00:04:21.361 02:59:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.361 02:59:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.361 02:59:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.361 02:59:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.361 02:59:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.361 02:59:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.361 02:59:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43016188 kB' 'MemAvailable: 46775032 kB' 'Buffers: 2708 kB' 'Cached: 12948400 kB' 'SwapCached: 0 kB' 'Active: 9638260 kB' 'Inactive: 3757844 kB' 'Active(anon): 9243428 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448288 kB' 'Mapped: 165728 kB' 'Shmem: 8798432 kB' 'KReclaimable: 199496 kB' 'Slab: 699660 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500164 kB' 'KernelStack: 12816 kB' 'PageTables: 7724 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10325928 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198424 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.361 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.361 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:21.362 02:59:23 -- setup/common.sh@33 -- # echo 0 00:04:21.362 02:59:23 -- setup/common.sh@33 -- # return 0 00:04:21.362 02:59:23 -- setup/hugepages.sh@97 -- # anon=0 00:04:21.362 02:59:23 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:21.362 02:59:23 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.362 02:59:23 -- setup/common.sh@18 -- # local node= 00:04:21.362 02:59:23 -- setup/common.sh@19 -- # local var val 00:04:21.362 02:59:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.362 02:59:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.362 02:59:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.362 02:59:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.362 02:59:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.362 02:59:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.362 02:59:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43016764 kB' 'MemAvailable: 46775608 kB' 'Buffers: 2708 kB' 'Cached: 12948404 kB' 'SwapCached: 0 kB' 'Active: 9638520 kB' 'Inactive: 3757844 kB' 'Active(anon): 9243688 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448556 kB' 'Mapped: 165692 kB' 'Shmem: 8798436 kB' 'KReclaimable: 199496 kB' 'Slab: 699620 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500124 kB' 'KernelStack: 12832 kB' 'PageTables: 7756 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10325940 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.362 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.362 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.363 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.363 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.364 02:59:23 -- setup/common.sh@33 -- # echo 0 00:04:21.364 02:59:23 -- setup/common.sh@33 -- # return 0 00:04:21.364 02:59:23 -- setup/hugepages.sh@99 -- # surp=0 00:04:21.364 02:59:23 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:21.364 02:59:23 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:21.364 02:59:23 -- setup/common.sh@18 -- # local node= 00:04:21.364 02:59:23 -- setup/common.sh@19 -- # local var val 00:04:21.364 02:59:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.364 02:59:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.364 02:59:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.364 02:59:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.364 02:59:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.364 02:59:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43016780 kB' 'MemAvailable: 46775624 kB' 'Buffers: 2708 kB' 'Cached: 12948416 kB' 'SwapCached: 0 kB' 'Active: 9638492 kB' 'Inactive: 3757844 kB' 'Active(anon): 9243660 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448532 kB' 'Mapped: 165692 kB' 'Shmem: 8798448 kB' 'KReclaimable: 199496 kB' 'Slab: 699692 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500196 kB' 'KernelStack: 12832 kB' 'PageTables: 7764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10325956 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.364 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.364 02:59:23 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.625 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.625 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.625 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.625 02:59:23 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.625 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.625 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:21.626 02:59:23 -- setup/common.sh@33 -- # echo 0 00:04:21.626 02:59:23 -- setup/common.sh@33 -- # return 0 00:04:21.626 02:59:23 -- setup/hugepages.sh@100 -- # resv=0 00:04:21.626 02:59:23 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:21.626 nr_hugepages=1024 00:04:21.626 02:59:23 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:21.626 resv_hugepages=0 00:04:21.626 02:59:23 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:21.626 surplus_hugepages=0 00:04:21.626 02:59:23 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:21.626 anon_hugepages=0 00:04:21.626 02:59:23 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:21.626 02:59:23 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:21.626 02:59:23 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:21.626 02:59:23 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:21.626 02:59:23 -- setup/common.sh@18 -- # local node= 00:04:21.626 02:59:23 -- setup/common.sh@19 -- # local var val 00:04:21.626 02:59:23 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.626 02:59:23 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.626 02:59:23 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:21.626 02:59:23 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:21.626 02:59:23 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.626 02:59:23 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.626 02:59:23 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43017904 kB' 'MemAvailable: 46776748 kB' 'Buffers: 2708 kB' 'Cached: 12948428 kB' 'SwapCached: 0 kB' 'Active: 9638528 kB' 'Inactive: 3757844 kB' 'Active(anon): 9243696 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448528 kB' 'Mapped: 165692 kB' 'Shmem: 8798460 kB' 'KReclaimable: 199496 kB' 'Slab: 699684 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500188 kB' 'KernelStack: 12832 kB' 'PageTables: 7764 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10325972 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.626 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.626 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:23 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:23 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.627 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.627 02:59:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:21.628 02:59:24 -- setup/common.sh@33 -- # echo 1024 00:04:21.628 02:59:24 -- setup/common.sh@33 -- # return 0 00:04:21.628 02:59:24 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:21.628 02:59:24 -- setup/hugepages.sh@112 -- # get_nodes 00:04:21.628 02:59:24 -- setup/hugepages.sh@27 -- # local node 00:04:21.628 02:59:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.628 02:59:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:21.628 02:59:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:21.628 02:59:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:21.628 02:59:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:21.628 02:59:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:21.628 02:59:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:21.628 02:59:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:21.628 02:59:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:21.628 02:59:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.628 02:59:24 -- setup/common.sh@18 -- # local node=0 00:04:21.628 02:59:24 -- setup/common.sh@19 -- # local var val 00:04:21.628 02:59:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.628 02:59:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.628 02:59:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:21.628 02:59:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:21.628 02:59:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.628 02:59:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27705288 kB' 'MemUsed: 5120568 kB' 'SwapCached: 0 kB' 'Active: 2631908 kB' 'Inactive: 176704 kB' 'Active(anon): 2479040 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2464200 kB' 'Mapped: 74272 kB' 'AnonPages: 347604 kB' 'Shmem: 2134628 kB' 'KernelStack: 7592 kB' 'PageTables: 4544 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 107356 kB' 'Slab: 391132 kB' 'SReclaimable: 107356 kB' 'SUnreclaim: 283776 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.628 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.628 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@33 -- # echo 0 00:04:21.629 02:59:24 -- setup/common.sh@33 -- # return 0 00:04:21.629 02:59:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:21.629 02:59:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:21.629 02:59:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:21.629 02:59:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:21.629 02:59:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:21.629 02:59:24 -- setup/common.sh@18 -- # local node=1 00:04:21.629 02:59:24 -- setup/common.sh@19 -- # local var val 00:04:21.629 02:59:24 -- setup/common.sh@20 -- # local mem_f mem 00:04:21.629 02:59:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:21.629 02:59:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:21.629 02:59:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:21.629 02:59:24 -- setup/common.sh@28 -- # mapfile -t mem 00:04:21.629 02:59:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 15313248 kB' 'MemUsed: 12396544 kB' 'SwapCached: 0 kB' 'Active: 7006668 kB' 'Inactive: 3581140 kB' 'Active(anon): 6764704 kB' 'Inactive(anon): 0 kB' 'Active(file): 241964 kB' 'Inactive(file): 3581140 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10486964 kB' 'Mapped: 91420 kB' 'AnonPages: 100924 kB' 'Shmem: 6663860 kB' 'KernelStack: 5240 kB' 'PageTables: 3220 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 92140 kB' 'Slab: 308552 kB' 'SReclaimable: 92140 kB' 'SUnreclaim: 216412 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.629 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.629 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # continue 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # IFS=': ' 00:04:21.630 02:59:24 -- setup/common.sh@31 -- # read -r var val _ 00:04:21.630 02:59:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:21.630 02:59:24 -- setup/common.sh@33 -- # echo 0 00:04:21.630 02:59:24 -- setup/common.sh@33 -- # return 0 00:04:21.630 02:59:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:21.630 02:59:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:21.630 02:59:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:21.630 02:59:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:21.630 02:59:24 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:21.630 node0=512 expecting 512 00:04:21.630 02:59:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:21.630 02:59:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:21.630 02:59:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:21.630 02:59:24 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:21.630 node1=512 expecting 512 00:04:21.630 02:59:24 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:21.630 00:04:21.630 real 0m1.488s 00:04:21.630 user 0m0.654s 00:04:21.630 sys 0m0.789s 00:04:21.630 02:59:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:21.630 02:59:24 -- common/autotest_common.sh@10 -- # set +x 00:04:21.630 ************************************ 00:04:21.630 END TEST even_2G_alloc 00:04:21.630 ************************************ 00:04:21.630 02:59:24 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:21.630 02:59:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:21.630 02:59:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:21.630 02:59:24 -- common/autotest_common.sh@10 -- # set +x 00:04:21.630 ************************************ 00:04:21.630 START TEST odd_alloc 00:04:21.630 ************************************ 00:04:21.630 02:59:24 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:21.630 02:59:24 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:21.630 02:59:24 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:21.630 02:59:24 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:21.630 02:59:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:21.630 02:59:24 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:21.630 02:59:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:21.630 02:59:24 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:21.630 02:59:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:21.630 02:59:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:21.630 02:59:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:21.630 02:59:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:21.630 02:59:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:21.630 02:59:24 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:21.630 02:59:24 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:21.630 02:59:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:21.630 02:59:24 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:21.630 02:59:24 -- setup/hugepages.sh@83 -- # : 513 00:04:21.630 02:59:24 -- setup/hugepages.sh@84 -- # : 1 00:04:21.630 02:59:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:21.630 02:59:24 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:21.630 02:59:24 -- setup/hugepages.sh@83 -- # : 0 00:04:21.630 02:59:24 -- setup/hugepages.sh@84 -- # : 0 00:04:21.630 02:59:24 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:21.630 02:59:24 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:21.630 02:59:24 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:21.630 02:59:24 -- setup/hugepages.sh@160 -- # setup output 00:04:21.630 02:59:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:21.630 02:59:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:22.564 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:22.564 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:22.564 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:22.564 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:22.564 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:22.564 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:22.564 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:22.564 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:22.564 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:22.564 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:22.564 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:22.564 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:22.825 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:22.825 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:22.825 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:22.825 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:22.825 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:22.825 02:59:25 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:22.825 02:59:25 -- setup/hugepages.sh@89 -- # local node 00:04:22.825 02:59:25 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:22.825 02:59:25 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:22.825 02:59:25 -- setup/hugepages.sh@92 -- # local surp 00:04:22.825 02:59:25 -- setup/hugepages.sh@93 -- # local resv 00:04:22.825 02:59:25 -- setup/hugepages.sh@94 -- # local anon 00:04:22.825 02:59:25 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:22.825 02:59:25 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:22.825 02:59:25 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:22.825 02:59:25 -- setup/common.sh@18 -- # local node= 00:04:22.825 02:59:25 -- setup/common.sh@19 -- # local var val 00:04:22.825 02:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.825 02:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.825 02:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.825 02:59:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.825 02:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.825 02:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43025960 kB' 'MemAvailable: 46784804 kB' 'Buffers: 2708 kB' 'Cached: 12948484 kB' 'SwapCached: 0 kB' 'Active: 9637364 kB' 'Inactive: 3757844 kB' 'Active(anon): 9242532 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447284 kB' 'Mapped: 164672 kB' 'Shmem: 8798516 kB' 'KReclaimable: 199496 kB' 'Slab: 699652 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500156 kB' 'KernelStack: 12848 kB' 'PageTables: 7688 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10316620 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.825 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.825 02:59:25 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:22.826 02:59:25 -- setup/common.sh@33 -- # echo 0 00:04:22.826 02:59:25 -- setup/common.sh@33 -- # return 0 00:04:22.826 02:59:25 -- setup/hugepages.sh@97 -- # anon=0 00:04:22.826 02:59:25 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:22.826 02:59:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:22.826 02:59:25 -- setup/common.sh@18 -- # local node= 00:04:22.826 02:59:25 -- setup/common.sh@19 -- # local var val 00:04:22.826 02:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.826 02:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.826 02:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.826 02:59:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.826 02:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.826 02:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43026656 kB' 'MemAvailable: 46785500 kB' 'Buffers: 2708 kB' 'Cached: 12948492 kB' 'SwapCached: 0 kB' 'Active: 9637300 kB' 'Inactive: 3757844 kB' 'Active(anon): 9242468 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 447240 kB' 'Mapped: 164680 kB' 'Shmem: 8798524 kB' 'KReclaimable: 199496 kB' 'Slab: 699612 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500116 kB' 'KernelStack: 13072 kB' 'PageTables: 8108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10316632 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.826 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.826 02:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:22.827 02:59:25 -- setup/common.sh@33 -- # echo 0 00:04:22.827 02:59:25 -- setup/common.sh@33 -- # return 0 00:04:22.827 02:59:25 -- setup/hugepages.sh@99 -- # surp=0 00:04:22.827 02:59:25 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:22.827 02:59:25 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:22.827 02:59:25 -- setup/common.sh@18 -- # local node= 00:04:22.827 02:59:25 -- setup/common.sh@19 -- # local var val 00:04:22.827 02:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.827 02:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.827 02:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.827 02:59:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.827 02:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.827 02:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43026616 kB' 'MemAvailable: 46785460 kB' 'Buffers: 2708 kB' 'Cached: 12948504 kB' 'SwapCached: 0 kB' 'Active: 9638588 kB' 'Inactive: 3757844 kB' 'Active(anon): 9243756 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448464 kB' 'Mapped: 164628 kB' 'Shmem: 8798536 kB' 'KReclaimable: 199496 kB' 'Slab: 699616 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500120 kB' 'KernelStack: 13184 kB' 'PageTables: 9088 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10316648 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198536 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.827 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.827 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.828 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.828 02:59:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:22.829 02:59:25 -- setup/common.sh@33 -- # echo 0 00:04:22.829 02:59:25 -- setup/common.sh@33 -- # return 0 00:04:22.829 02:59:25 -- setup/hugepages.sh@100 -- # resv=0 00:04:22.829 02:59:25 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:22.829 nr_hugepages=1025 00:04:22.829 02:59:25 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:22.829 resv_hugepages=0 00:04:22.829 02:59:25 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:22.829 surplus_hugepages=0 00:04:22.829 02:59:25 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:22.829 anon_hugepages=0 00:04:22.829 02:59:25 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:22.829 02:59:25 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:22.829 02:59:25 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:22.829 02:59:25 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:22.829 02:59:25 -- setup/common.sh@18 -- # local node= 00:04:22.829 02:59:25 -- setup/common.sh@19 -- # local var val 00:04:22.829 02:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:22.829 02:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:22.829 02:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:22.829 02:59:25 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:22.829 02:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:22.829 02:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43034740 kB' 'MemAvailable: 46793584 kB' 'Buffers: 2708 kB' 'Cached: 12948520 kB' 'SwapCached: 0 kB' 'Active: 9638936 kB' 'Inactive: 3757844 kB' 'Active(anon): 9244104 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448828 kB' 'Mapped: 164628 kB' 'Shmem: 8798552 kB' 'KReclaimable: 199496 kB' 'Slab: 699608 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 500112 kB' 'KernelStack: 12976 kB' 'PageTables: 9336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606828 kB' 'Committed_AS: 10316664 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198584 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.829 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.829 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # continue 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:22.830 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:22.830 02:59:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.088 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.088 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:23.089 02:59:25 -- setup/common.sh@33 -- # echo 1025 00:04:23.089 02:59:25 -- setup/common.sh@33 -- # return 0 00:04:23.089 02:59:25 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:23.089 02:59:25 -- setup/hugepages.sh@112 -- # get_nodes 00:04:23.089 02:59:25 -- setup/hugepages.sh@27 -- # local node 00:04:23.089 02:59:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:23.089 02:59:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:23.089 02:59:25 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:23.089 02:59:25 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:23.089 02:59:25 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:23.089 02:59:25 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:23.089 02:59:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:23.089 02:59:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:23.089 02:59:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:23.089 02:59:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:23.089 02:59:25 -- setup/common.sh@18 -- # local node=0 00:04:23.089 02:59:25 -- setup/common.sh@19 -- # local var val 00:04:23.089 02:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:23.089 02:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:23.089 02:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:23.089 02:59:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:23.089 02:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:23.089 02:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27713588 kB' 'MemUsed: 5112268 kB' 'SwapCached: 0 kB' 'Active: 2631624 kB' 'Inactive: 176704 kB' 'Active(anon): 2478756 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2464204 kB' 'Mapped: 73284 kB' 'AnonPages: 347272 kB' 'Shmem: 2134632 kB' 'KernelStack: 7624 kB' 'PageTables: 5336 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 107356 kB' 'Slab: 391108 kB' 'SReclaimable: 107356 kB' 'SUnreclaim: 283752 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@33 -- # echo 0 00:04:23.089 02:59:25 -- setup/common.sh@33 -- # return 0 00:04:23.089 02:59:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:23.089 02:59:25 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:23.089 02:59:25 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:23.089 02:59:25 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:23.089 02:59:25 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:23.089 02:59:25 -- setup/common.sh@18 -- # local node=1 00:04:23.089 02:59:25 -- setup/common.sh@19 -- # local var val 00:04:23.089 02:59:25 -- setup/common.sh@20 -- # local mem_f mem 00:04:23.089 02:59:25 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:23.089 02:59:25 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:23.089 02:59:25 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:23.089 02:59:25 -- setup/common.sh@28 -- # mapfile -t mem 00:04:23.089 02:59:25 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 15320784 kB' 'MemUsed: 12389008 kB' 'SwapCached: 0 kB' 'Active: 7006928 kB' 'Inactive: 3581140 kB' 'Active(anon): 6764964 kB' 'Inactive(anon): 0 kB' 'Active(file): 241964 kB' 'Inactive(file): 3581140 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10487036 kB' 'Mapped: 91344 kB' 'AnonPages: 101136 kB' 'Shmem: 6663932 kB' 'KernelStack: 5208 kB' 'PageTables: 3152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 92140 kB' 'Slab: 308500 kB' 'SReclaimable: 92140 kB' 'SUnreclaim: 216360 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.089 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.089 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # continue 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # IFS=': ' 00:04:23.090 02:59:25 -- setup/common.sh@31 -- # read -r var val _ 00:04:23.090 02:59:25 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:23.090 02:59:25 -- setup/common.sh@33 -- # echo 0 00:04:23.090 02:59:25 -- setup/common.sh@33 -- # return 0 00:04:23.090 02:59:25 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:23.090 02:59:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:23.090 02:59:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:23.090 02:59:25 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:23.090 node0=512 expecting 513 00:04:23.090 02:59:25 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:23.090 02:59:25 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:23.090 02:59:25 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:23.090 02:59:25 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:23.090 node1=513 expecting 512 00:04:23.090 02:59:25 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:23.090 00:04:23.090 real 0m1.398s 00:04:23.090 user 0m0.545s 00:04:23.090 sys 0m0.812s 00:04:23.090 02:59:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:23.090 02:59:25 -- common/autotest_common.sh@10 -- # set +x 00:04:23.090 ************************************ 00:04:23.090 END TEST odd_alloc 00:04:23.090 ************************************ 00:04:23.090 02:59:25 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:23.090 02:59:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:23.090 02:59:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:23.090 02:59:25 -- common/autotest_common.sh@10 -- # set +x 00:04:23.090 ************************************ 00:04:23.090 START TEST custom_alloc 00:04:23.090 ************************************ 00:04:23.090 02:59:25 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:23.090 02:59:25 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:23.090 02:59:25 -- setup/hugepages.sh@169 -- # local node 00:04:23.090 02:59:25 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:23.090 02:59:25 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:23.090 02:59:25 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:23.090 02:59:25 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:23.090 02:59:25 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:23.090 02:59:25 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:23.090 02:59:25 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:23.090 02:59:25 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:23.090 02:59:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:23.090 02:59:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:23.090 02:59:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:23.090 02:59:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:23.090 02:59:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:23.090 02:59:25 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:23.090 02:59:25 -- setup/hugepages.sh@83 -- # : 256 00:04:23.090 02:59:25 -- setup/hugepages.sh@84 -- # : 1 00:04:23.090 02:59:25 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:23.090 02:59:25 -- setup/hugepages.sh@83 -- # : 0 00:04:23.090 02:59:25 -- setup/hugepages.sh@84 -- # : 0 00:04:23.090 02:59:25 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:23.090 02:59:25 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:23.090 02:59:25 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:23.090 02:59:25 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:23.090 02:59:25 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:23.090 02:59:25 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:23.090 02:59:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:23.090 02:59:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:23.090 02:59:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:23.090 02:59:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:23.090 02:59:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:23.090 02:59:25 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:23.090 02:59:25 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:23.090 02:59:25 -- setup/hugepages.sh@78 -- # return 0 00:04:23.090 02:59:25 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:23.090 02:59:25 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:23.090 02:59:25 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:23.090 02:59:25 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:23.090 02:59:25 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:23.090 02:59:25 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:23.090 02:59:25 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:23.090 02:59:25 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:23.090 02:59:25 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:23.090 02:59:25 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:23.090 02:59:25 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:23.090 02:59:25 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:23.090 02:59:25 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:23.090 02:59:25 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:23.090 02:59:25 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:23.090 02:59:25 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:23.090 02:59:25 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:23.090 02:59:25 -- setup/hugepages.sh@78 -- # return 0 00:04:23.090 02:59:25 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:23.090 02:59:25 -- setup/hugepages.sh@187 -- # setup output 00:04:23.090 02:59:25 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:23.090 02:59:25 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:24.467 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:24.467 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:24.467 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:24.467 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:24.467 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:24.467 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:24.467 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:24.467 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:24.467 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:24.467 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:24.467 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:24.467 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:24.467 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:24.467 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:24.467 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:24.467 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:24.467 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:24.467 02:59:26 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:24.467 02:59:26 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:24.467 02:59:26 -- setup/hugepages.sh@89 -- # local node 00:04:24.467 02:59:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:24.467 02:59:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:24.467 02:59:26 -- setup/hugepages.sh@92 -- # local surp 00:04:24.467 02:59:26 -- setup/hugepages.sh@93 -- # local resv 00:04:24.467 02:59:26 -- setup/hugepages.sh@94 -- # local anon 00:04:24.467 02:59:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:24.467 02:59:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:24.467 02:59:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:24.467 02:59:26 -- setup/common.sh@18 -- # local node= 00:04:24.467 02:59:26 -- setup/common.sh@19 -- # local var val 00:04:24.467 02:59:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.467 02:59:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.467 02:59:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.467 02:59:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.467 02:59:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.467 02:59:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41983400 kB' 'MemAvailable: 45742244 kB' 'Buffers: 2708 kB' 'Cached: 12948584 kB' 'SwapCached: 0 kB' 'Active: 9636832 kB' 'Inactive: 3757844 kB' 'Active(anon): 9242000 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446552 kB' 'Mapped: 164668 kB' 'Shmem: 8798616 kB' 'KReclaimable: 199496 kB' 'Slab: 699216 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499720 kB' 'KernelStack: 12736 kB' 'PageTables: 7340 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10312800 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.467 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.467 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:24.468 02:59:26 -- setup/common.sh@33 -- # echo 0 00:04:24.468 02:59:26 -- setup/common.sh@33 -- # return 0 00:04:24.468 02:59:26 -- setup/hugepages.sh@97 -- # anon=0 00:04:24.468 02:59:26 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:24.468 02:59:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:24.468 02:59:26 -- setup/common.sh@18 -- # local node= 00:04:24.468 02:59:26 -- setup/common.sh@19 -- # local var val 00:04:24.468 02:59:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.468 02:59:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.468 02:59:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.468 02:59:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.468 02:59:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.468 02:59:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.468 02:59:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41985144 kB' 'MemAvailable: 45743988 kB' 'Buffers: 2708 kB' 'Cached: 12948588 kB' 'SwapCached: 0 kB' 'Active: 9636916 kB' 'Inactive: 3757844 kB' 'Active(anon): 9242084 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446632 kB' 'Mapped: 164668 kB' 'Shmem: 8798620 kB' 'KReclaimable: 199496 kB' 'Slab: 699216 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499720 kB' 'KernelStack: 12704 kB' 'PageTables: 7252 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10312812 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.468 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.468 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.469 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.469 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.470 02:59:26 -- setup/common.sh@33 -- # echo 0 00:04:24.470 02:59:26 -- setup/common.sh@33 -- # return 0 00:04:24.470 02:59:26 -- setup/hugepages.sh@99 -- # surp=0 00:04:24.470 02:59:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:24.470 02:59:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:24.470 02:59:26 -- setup/common.sh@18 -- # local node= 00:04:24.470 02:59:26 -- setup/common.sh@19 -- # local var val 00:04:24.470 02:59:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.470 02:59:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.470 02:59:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.470 02:59:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.470 02:59:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.470 02:59:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41985708 kB' 'MemAvailable: 45744552 kB' 'Buffers: 2708 kB' 'Cached: 12948592 kB' 'SwapCached: 0 kB' 'Active: 9636672 kB' 'Inactive: 3757844 kB' 'Active(anon): 9241840 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446412 kB' 'Mapped: 164624 kB' 'Shmem: 8798624 kB' 'KReclaimable: 199496 kB' 'Slab: 699232 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499736 kB' 'KernelStack: 12784 kB' 'PageTables: 7440 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10312828 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.470 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.470 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.471 02:59:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:24.471 02:59:26 -- setup/common.sh@33 -- # echo 0 00:04:24.471 02:59:26 -- setup/common.sh@33 -- # return 0 00:04:24.471 02:59:26 -- setup/hugepages.sh@100 -- # resv=0 00:04:24.471 02:59:26 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:24.471 nr_hugepages=1536 00:04:24.471 02:59:26 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:24.471 resv_hugepages=0 00:04:24.471 02:59:26 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:24.471 surplus_hugepages=0 00:04:24.471 02:59:26 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:24.471 anon_hugepages=0 00:04:24.471 02:59:26 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:24.471 02:59:26 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:24.471 02:59:26 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:24.471 02:59:26 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:24.471 02:59:26 -- setup/common.sh@18 -- # local node= 00:04:24.471 02:59:26 -- setup/common.sh@19 -- # local var val 00:04:24.471 02:59:26 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.471 02:59:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.471 02:59:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:24.471 02:59:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:24.471 02:59:26 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.471 02:59:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.471 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 41985708 kB' 'MemAvailable: 45744552 kB' 'Buffers: 2708 kB' 'Cached: 12948612 kB' 'SwapCached: 0 kB' 'Active: 9636652 kB' 'Inactive: 3757844 kB' 'Active(anon): 9241820 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446428 kB' 'Mapped: 164624 kB' 'Shmem: 8798644 kB' 'KReclaimable: 199496 kB' 'Slab: 699232 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499736 kB' 'KernelStack: 12768 kB' 'PageTables: 7372 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083564 kB' 'Committed_AS: 10312844 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.472 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.472 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:26 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:26 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:24.473 02:59:27 -- setup/common.sh@33 -- # echo 1536 00:04:24.473 02:59:27 -- setup/common.sh@33 -- # return 0 00:04:24.473 02:59:27 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:24.473 02:59:27 -- setup/hugepages.sh@112 -- # get_nodes 00:04:24.473 02:59:27 -- setup/hugepages.sh@27 -- # local node 00:04:24.473 02:59:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:24.473 02:59:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:24.473 02:59:27 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:24.473 02:59:27 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:24.473 02:59:27 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:24.473 02:59:27 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:24.473 02:59:27 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:24.473 02:59:27 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:24.473 02:59:27 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:24.473 02:59:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:24.473 02:59:27 -- setup/common.sh@18 -- # local node=0 00:04:24.473 02:59:27 -- setup/common.sh@19 -- # local var val 00:04:24.473 02:59:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.473 02:59:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.473 02:59:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:24.473 02:59:27 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:24.473 02:59:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.473 02:59:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 27716416 kB' 'MemUsed: 5109440 kB' 'SwapCached: 0 kB' 'Active: 2630644 kB' 'Inactive: 176704 kB' 'Active(anon): 2477776 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2464264 kB' 'Mapped: 73280 kB' 'AnonPages: 346224 kB' 'Shmem: 2134692 kB' 'KernelStack: 7544 kB' 'PageTables: 4240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 107356 kB' 'Slab: 390948 kB' 'SReclaimable: 107356 kB' 'SUnreclaim: 283592 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.473 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.473 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@33 -- # echo 0 00:04:24.474 02:59:27 -- setup/common.sh@33 -- # return 0 00:04:24.474 02:59:27 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:24.474 02:59:27 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:24.474 02:59:27 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:24.474 02:59:27 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:24.474 02:59:27 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:24.474 02:59:27 -- setup/common.sh@18 -- # local node=1 00:04:24.474 02:59:27 -- setup/common.sh@19 -- # local var val 00:04:24.474 02:59:27 -- setup/common.sh@20 -- # local mem_f mem 00:04:24.474 02:59:27 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:24.474 02:59:27 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:24.474 02:59:27 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:24.474 02:59:27 -- setup/common.sh@28 -- # mapfile -t mem 00:04:24.474 02:59:27 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709792 kB' 'MemFree: 14267780 kB' 'MemUsed: 13442012 kB' 'SwapCached: 0 kB' 'Active: 7011412 kB' 'Inactive: 3581140 kB' 'Active(anon): 6769448 kB' 'Inactive(anon): 0 kB' 'Active(file): 241964 kB' 'Inactive(file): 3581140 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 10487080 kB' 'Mapped: 91780 kB' 'AnonPages: 105536 kB' 'Shmem: 6663976 kB' 'KernelStack: 5256 kB' 'PageTables: 3240 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 92140 kB' 'Slab: 308284 kB' 'SReclaimable: 92140 kB' 'SUnreclaim: 216144 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.474 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.474 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # continue 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # IFS=': ' 00:04:24.475 02:59:27 -- setup/common.sh@31 -- # read -r var val _ 00:04:24.475 02:59:27 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:24.475 02:59:27 -- setup/common.sh@33 -- # echo 0 00:04:24.475 02:59:27 -- setup/common.sh@33 -- # return 0 00:04:24.475 02:59:27 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:24.475 02:59:27 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:24.475 02:59:27 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:24.475 02:59:27 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:24.475 02:59:27 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:24.475 node0=512 expecting 512 00:04:24.475 02:59:27 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:24.475 02:59:27 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:24.475 02:59:27 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:24.475 02:59:27 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:24.475 node1=1024 expecting 1024 00:04:24.475 02:59:27 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:24.475 00:04:24.475 real 0m1.532s 00:04:24.475 user 0m0.654s 00:04:24.475 sys 0m0.815s 00:04:24.475 02:59:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:24.475 02:59:27 -- common/autotest_common.sh@10 -- # set +x 00:04:24.475 ************************************ 00:04:24.475 END TEST custom_alloc 00:04:24.475 ************************************ 00:04:24.475 02:59:27 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:24.475 02:59:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:24.475 02:59:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:24.475 02:59:27 -- common/autotest_common.sh@10 -- # set +x 00:04:24.475 ************************************ 00:04:24.475 START TEST no_shrink_alloc 00:04:24.475 ************************************ 00:04:24.475 02:59:27 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:24.476 02:59:27 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:24.476 02:59:27 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:24.476 02:59:27 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:24.476 02:59:27 -- setup/hugepages.sh@51 -- # shift 00:04:24.476 02:59:27 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:24.476 02:59:27 -- setup/hugepages.sh@52 -- # local node_ids 00:04:24.476 02:59:27 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:24.476 02:59:27 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:24.476 02:59:27 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:24.476 02:59:27 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:24.476 02:59:27 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:24.476 02:59:27 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:24.476 02:59:27 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:24.476 02:59:27 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:24.476 02:59:27 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:24.476 02:59:27 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:24.476 02:59:27 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:24.476 02:59:27 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:24.476 02:59:27 -- setup/hugepages.sh@73 -- # return 0 00:04:24.476 02:59:27 -- setup/hugepages.sh@198 -- # setup output 00:04:24.476 02:59:27 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:24.476 02:59:27 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:25.850 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:25.850 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:25.850 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:25.850 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:25.850 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:25.850 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:25.850 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:25.850 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:25.850 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:25.850 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:25.850 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:25.850 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:25.850 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:25.850 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:25.850 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:25.850 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:25.850 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:25.850 02:59:28 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:25.850 02:59:28 -- setup/hugepages.sh@89 -- # local node 00:04:25.850 02:59:28 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:25.850 02:59:28 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:25.850 02:59:28 -- setup/hugepages.sh@92 -- # local surp 00:04:25.850 02:59:28 -- setup/hugepages.sh@93 -- # local resv 00:04:25.850 02:59:28 -- setup/hugepages.sh@94 -- # local anon 00:04:25.850 02:59:28 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:25.850 02:59:28 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:25.850 02:59:28 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:25.850 02:59:28 -- setup/common.sh@18 -- # local node= 00:04:25.850 02:59:28 -- setup/common.sh@19 -- # local var val 00:04:25.850 02:59:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.850 02:59:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.850 02:59:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.850 02:59:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.850 02:59:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.850 02:59:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43032868 kB' 'MemAvailable: 46791712 kB' 'Buffers: 2708 kB' 'Cached: 12948676 kB' 'SwapCached: 0 kB' 'Active: 9636716 kB' 'Inactive: 3757844 kB' 'Active(anon): 9241884 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446340 kB' 'Mapped: 164652 kB' 'Shmem: 8798708 kB' 'KReclaimable: 199496 kB' 'Slab: 699192 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499696 kB' 'KernelStack: 12784 kB' 'PageTables: 7380 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10313152 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.850 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.850 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:25.851 02:59:28 -- setup/common.sh@33 -- # echo 0 00:04:25.851 02:59:28 -- setup/common.sh@33 -- # return 0 00:04:25.851 02:59:28 -- setup/hugepages.sh@97 -- # anon=0 00:04:25.851 02:59:28 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:25.851 02:59:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:25.851 02:59:28 -- setup/common.sh@18 -- # local node= 00:04:25.851 02:59:28 -- setup/common.sh@19 -- # local var val 00:04:25.851 02:59:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.851 02:59:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.851 02:59:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.851 02:59:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.851 02:59:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.851 02:59:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43037492 kB' 'MemAvailable: 46796336 kB' 'Buffers: 2708 kB' 'Cached: 12948680 kB' 'SwapCached: 0 kB' 'Active: 9637296 kB' 'Inactive: 3757844 kB' 'Active(anon): 9242464 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446968 kB' 'Mapped: 164728 kB' 'Shmem: 8798712 kB' 'KReclaimable: 199496 kB' 'Slab: 699256 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499760 kB' 'KernelStack: 12816 kB' 'PageTables: 7492 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10313160 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.851 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.851 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.852 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.852 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:25.853 02:59:28 -- setup/common.sh@33 -- # echo 0 00:04:25.853 02:59:28 -- setup/common.sh@33 -- # return 0 00:04:25.853 02:59:28 -- setup/hugepages.sh@99 -- # surp=0 00:04:25.853 02:59:28 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:25.853 02:59:28 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:25.853 02:59:28 -- setup/common.sh@18 -- # local node= 00:04:25.853 02:59:28 -- setup/common.sh@19 -- # local var val 00:04:25.853 02:59:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:25.853 02:59:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:25.853 02:59:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:25.853 02:59:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:25.853 02:59:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:25.853 02:59:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43037504 kB' 'MemAvailable: 46796348 kB' 'Buffers: 2708 kB' 'Cached: 12948692 kB' 'SwapCached: 0 kB' 'Active: 9636860 kB' 'Inactive: 3757844 kB' 'Active(anon): 9242028 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446512 kB' 'Mapped: 164644 kB' 'Shmem: 8798724 kB' 'KReclaimable: 199496 kB' 'Slab: 699168 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499672 kB' 'KernelStack: 12768 kB' 'PageTables: 7320 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10313176 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:25.853 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:25.853 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.113 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.113 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:26.114 02:59:28 -- setup/common.sh@33 -- # echo 0 00:04:26.114 02:59:28 -- setup/common.sh@33 -- # return 0 00:04:26.114 02:59:28 -- setup/hugepages.sh@100 -- # resv=0 00:04:26.114 02:59:28 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:26.114 nr_hugepages=1024 00:04:26.114 02:59:28 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:26.114 resv_hugepages=0 00:04:26.114 02:59:28 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:26.114 surplus_hugepages=0 00:04:26.114 02:59:28 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:26.114 anon_hugepages=0 00:04:26.114 02:59:28 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:26.114 02:59:28 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:26.114 02:59:28 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:26.114 02:59:28 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:26.114 02:59:28 -- setup/common.sh@18 -- # local node= 00:04:26.114 02:59:28 -- setup/common.sh@19 -- # local var val 00:04:26.114 02:59:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:26.114 02:59:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:26.114 02:59:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:26.114 02:59:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:26.114 02:59:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:26.114 02:59:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43038012 kB' 'MemAvailable: 46796856 kB' 'Buffers: 2708 kB' 'Cached: 12948708 kB' 'SwapCached: 0 kB' 'Active: 9636716 kB' 'Inactive: 3757844 kB' 'Active(anon): 9241884 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 446344 kB' 'Mapped: 164644 kB' 'Shmem: 8798740 kB' 'KReclaimable: 199496 kB' 'Slab: 699168 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499672 kB' 'KernelStack: 12784 kB' 'PageTables: 7368 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10313192 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.114 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.114 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.115 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.115 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:26.115 02:59:28 -- setup/common.sh@33 -- # echo 1024 00:04:26.115 02:59:28 -- setup/common.sh@33 -- # return 0 00:04:26.115 02:59:28 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:26.115 02:59:28 -- setup/hugepages.sh@112 -- # get_nodes 00:04:26.115 02:59:28 -- setup/hugepages.sh@27 -- # local node 00:04:26.115 02:59:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:26.116 02:59:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:26.116 02:59:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:26.116 02:59:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:26.116 02:59:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:26.116 02:59:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:26.116 02:59:28 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:26.116 02:59:28 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:26.116 02:59:28 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:26.116 02:59:28 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:26.116 02:59:28 -- setup/common.sh@18 -- # local node=0 00:04:26.116 02:59:28 -- setup/common.sh@19 -- # local var val 00:04:26.116 02:59:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:26.116 02:59:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:26.116 02:59:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:26.116 02:59:28 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:26.116 02:59:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:26.116 02:59:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26677812 kB' 'MemUsed: 6148044 kB' 'SwapCached: 0 kB' 'Active: 2630972 kB' 'Inactive: 176704 kB' 'Active(anon): 2478104 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2464348 kB' 'Mapped: 73300 kB' 'AnonPages: 346476 kB' 'Shmem: 2134776 kB' 'KernelStack: 7560 kB' 'PageTables: 4276 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 107356 kB' 'Slab: 390780 kB' 'SReclaimable: 107356 kB' 'SUnreclaim: 283424 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.116 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.116 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.117 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.117 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.117 02:59:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.117 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.117 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.117 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.117 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.117 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.117 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.117 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.117 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.117 02:59:28 -- setup/common.sh@32 -- # continue 00:04:26.117 02:59:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:26.117 02:59:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:26.117 02:59:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:26.117 02:59:28 -- setup/common.sh@33 -- # echo 0 00:04:26.117 02:59:28 -- setup/common.sh@33 -- # return 0 00:04:26.117 02:59:28 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:26.117 02:59:28 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:26.117 02:59:28 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:26.117 02:59:28 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:26.117 02:59:28 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:26.117 node0=1024 expecting 1024 00:04:26.117 02:59:28 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:26.117 02:59:28 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:26.117 02:59:28 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:26.117 02:59:28 -- setup/hugepages.sh@202 -- # setup output 00:04:26.117 02:59:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:26.117 02:59:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:27.496 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:27.496 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:27.496 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:27.496 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:27.496 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:27.496 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:27.496 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:27.496 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:27.496 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:27.496 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:27.496 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:27.496 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:27.496 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:27.496 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:27.496 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:27.496 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:27.496 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:27.496 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:27.496 02:59:29 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:27.496 02:59:29 -- setup/hugepages.sh@89 -- # local node 00:04:27.496 02:59:29 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:27.496 02:59:29 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:27.496 02:59:29 -- setup/hugepages.sh@92 -- # local surp 00:04:27.496 02:59:29 -- setup/hugepages.sh@93 -- # local resv 00:04:27.496 02:59:29 -- setup/hugepages.sh@94 -- # local anon 00:04:27.496 02:59:29 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:27.496 02:59:29 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:27.496 02:59:29 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:27.496 02:59:29 -- setup/common.sh@18 -- # local node= 00:04:27.496 02:59:29 -- setup/common.sh@19 -- # local var val 00:04:27.496 02:59:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.496 02:59:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.496 02:59:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.496 02:59:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.496 02:59:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.496 02:59:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43015936 kB' 'MemAvailable: 46774780 kB' 'Buffers: 2708 kB' 'Cached: 12948756 kB' 'SwapCached: 0 kB' 'Active: 9639176 kB' 'Inactive: 3757844 kB' 'Active(anon): 9244344 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 448820 kB' 'Mapped: 164700 kB' 'Shmem: 8798788 kB' 'KReclaimable: 199496 kB' 'Slab: 699164 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499668 kB' 'KernelStack: 13120 kB' 'PageTables: 8264 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10317168 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198616 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.496 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.496 02:59:29 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:27.497 02:59:29 -- setup/common.sh@33 -- # echo 0 00:04:27.497 02:59:29 -- setup/common.sh@33 -- # return 0 00:04:27.497 02:59:29 -- setup/hugepages.sh@97 -- # anon=0 00:04:27.497 02:59:29 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:27.497 02:59:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:27.497 02:59:29 -- setup/common.sh@18 -- # local node= 00:04:27.497 02:59:29 -- setup/common.sh@19 -- # local var val 00:04:27.497 02:59:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.497 02:59:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.497 02:59:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.497 02:59:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.497 02:59:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.497 02:59:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43015996 kB' 'MemAvailable: 46774840 kB' 'Buffers: 2708 kB' 'Cached: 12948760 kB' 'SwapCached: 0 kB' 'Active: 9640916 kB' 'Inactive: 3757844 kB' 'Active(anon): 9246084 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 450160 kB' 'Mapped: 164716 kB' 'Shmem: 8798792 kB' 'KReclaimable: 199496 kB' 'Slab: 699204 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499708 kB' 'KernelStack: 13088 kB' 'PageTables: 9480 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10315792 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198808 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.497 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.497 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.498 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.498 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.499 02:59:29 -- setup/common.sh@33 -- # echo 0 00:04:27.499 02:59:29 -- setup/common.sh@33 -- # return 0 00:04:27.499 02:59:29 -- setup/hugepages.sh@99 -- # surp=0 00:04:27.499 02:59:29 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:27.499 02:59:29 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:27.499 02:59:29 -- setup/common.sh@18 -- # local node= 00:04:27.499 02:59:29 -- setup/common.sh@19 -- # local var val 00:04:27.499 02:59:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.499 02:59:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.499 02:59:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.499 02:59:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.499 02:59:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.499 02:59:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43015092 kB' 'MemAvailable: 46773936 kB' 'Buffers: 2708 kB' 'Cached: 12948764 kB' 'SwapCached: 0 kB' 'Active: 9641656 kB' 'Inactive: 3757844 kB' 'Active(anon): 9246824 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 451400 kB' 'Mapped: 164700 kB' 'Shmem: 8798796 kB' 'KReclaimable: 199496 kB' 'Slab: 699204 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499708 kB' 'KernelStack: 13136 kB' 'PageTables: 10476 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10317564 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198728 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.499 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.499 02:59:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:27.500 02:59:29 -- setup/common.sh@33 -- # echo 0 00:04:27.500 02:59:29 -- setup/common.sh@33 -- # return 0 00:04:27.500 02:59:29 -- setup/hugepages.sh@100 -- # resv=0 00:04:27.500 02:59:29 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:27.500 nr_hugepages=1024 00:04:27.500 02:59:29 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:27.500 resv_hugepages=0 00:04:27.500 02:59:29 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:27.500 surplus_hugepages=0 00:04:27.500 02:59:29 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:27.500 anon_hugepages=0 00:04:27.500 02:59:29 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:27.500 02:59:29 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:27.500 02:59:29 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:27.500 02:59:29 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:27.500 02:59:29 -- setup/common.sh@18 -- # local node= 00:04:27.500 02:59:29 -- setup/common.sh@19 -- # local var val 00:04:27.500 02:59:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.500 02:59:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.500 02:59:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:27.500 02:59:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:27.500 02:59:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.500 02:59:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535648 kB' 'MemFree: 43010480 kB' 'MemAvailable: 46769324 kB' 'Buffers: 2708 kB' 'Cached: 12948792 kB' 'SwapCached: 0 kB' 'Active: 9639696 kB' 'Inactive: 3757844 kB' 'Active(anon): 9244864 kB' 'Inactive(anon): 0 kB' 'Active(file): 394832 kB' 'Inactive(file): 3757844 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 449368 kB' 'Mapped: 164752 kB' 'Shmem: 8798824 kB' 'KReclaimable: 199496 kB' 'Slab: 699292 kB' 'SReclaimable: 199496 kB' 'SUnreclaim: 499796 kB' 'KernelStack: 13520 kB' 'PageTables: 8744 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607852 kB' 'Committed_AS: 10317580 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198744 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1767004 kB' 'DirectMap2M: 13881344 kB' 'DirectMap1G: 54525952 kB' 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.500 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.500 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.501 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.501 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:27.502 02:59:29 -- setup/common.sh@33 -- # echo 1024 00:04:27.502 02:59:29 -- setup/common.sh@33 -- # return 0 00:04:27.502 02:59:29 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:27.502 02:59:29 -- setup/hugepages.sh@112 -- # get_nodes 00:04:27.502 02:59:29 -- setup/hugepages.sh@27 -- # local node 00:04:27.502 02:59:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:27.502 02:59:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:27.502 02:59:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:27.502 02:59:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:27.502 02:59:29 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:27.502 02:59:29 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:27.502 02:59:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:27.502 02:59:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:27.502 02:59:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:27.502 02:59:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:27.502 02:59:29 -- setup/common.sh@18 -- # local node=0 00:04:27.502 02:59:29 -- setup/common.sh@19 -- # local var val 00:04:27.502 02:59:29 -- setup/common.sh@20 -- # local mem_f mem 00:04:27.502 02:59:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:27.502 02:59:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:27.502 02:59:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:27.502 02:59:29 -- setup/common.sh@28 -- # mapfile -t mem 00:04:27.502 02:59:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 26669292 kB' 'MemUsed: 6156564 kB' 'SwapCached: 0 kB' 'Active: 2631196 kB' 'Inactive: 176704 kB' 'Active(anon): 2478328 kB' 'Inactive(anon): 0 kB' 'Active(file): 152868 kB' 'Inactive(file): 176704 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 2464412 kB' 'Mapped: 73304 kB' 'AnonPages: 346712 kB' 'Shmem: 2134840 kB' 'KernelStack: 7528 kB' 'PageTables: 4140 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 107356 kB' 'Slab: 390876 kB' 'SReclaimable: 107356 kB' 'SUnreclaim: 283520 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.502 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.502 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:29 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:29 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:29 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # continue 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # IFS=': ' 00:04:27.503 02:59:30 -- setup/common.sh@31 -- # read -r var val _ 00:04:27.503 02:59:30 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:27.503 02:59:30 -- setup/common.sh@33 -- # echo 0 00:04:27.503 02:59:30 -- setup/common.sh@33 -- # return 0 00:04:27.503 02:59:30 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:27.503 02:59:30 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:27.503 02:59:30 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:27.503 02:59:30 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:27.503 02:59:30 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:27.503 node0=1024 expecting 1024 00:04:27.503 02:59:30 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:27.503 00:04:27.503 real 0m2.935s 00:04:27.503 user 0m1.133s 00:04:27.503 sys 0m1.726s 00:04:27.503 02:59:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:27.503 02:59:30 -- common/autotest_common.sh@10 -- # set +x 00:04:27.503 ************************************ 00:04:27.503 END TEST no_shrink_alloc 00:04:27.503 ************************************ 00:04:27.503 02:59:30 -- setup/hugepages.sh@217 -- # clear_hp 00:04:27.503 02:59:30 -- setup/hugepages.sh@37 -- # local node hp 00:04:27.503 02:59:30 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:27.503 02:59:30 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:27.503 02:59:30 -- setup/hugepages.sh@41 -- # echo 0 00:04:27.503 02:59:30 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:27.503 02:59:30 -- setup/hugepages.sh@41 -- # echo 0 00:04:27.503 02:59:30 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:27.503 02:59:30 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:27.503 02:59:30 -- setup/hugepages.sh@41 -- # echo 0 00:04:27.503 02:59:30 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:27.503 02:59:30 -- setup/hugepages.sh@41 -- # echo 0 00:04:27.503 02:59:30 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:27.503 02:59:30 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:27.503 00:04:27.503 real 0m11.692s 00:04:27.503 user 0m4.402s 00:04:27.503 sys 0m6.178s 00:04:27.503 02:59:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:27.503 02:59:30 -- common/autotest_common.sh@10 -- # set +x 00:04:27.503 ************************************ 00:04:27.503 END TEST hugepages 00:04:27.503 ************************************ 00:04:27.503 02:59:30 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:27.503 02:59:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.503 02:59:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.503 02:59:30 -- common/autotest_common.sh@10 -- # set +x 00:04:27.503 ************************************ 00:04:27.503 START TEST driver 00:04:27.503 ************************************ 00:04:27.503 02:59:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:27.762 * Looking for test storage... 00:04:27.762 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:27.762 02:59:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:27.762 02:59:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:27.762 02:59:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:27.762 02:59:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:27.762 02:59:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:27.762 02:59:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:27.762 02:59:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:27.762 02:59:30 -- scripts/common.sh@335 -- # IFS=.-: 00:04:27.762 02:59:30 -- scripts/common.sh@335 -- # read -ra ver1 00:04:27.762 02:59:30 -- scripts/common.sh@336 -- # IFS=.-: 00:04:27.762 02:59:30 -- scripts/common.sh@336 -- # read -ra ver2 00:04:27.762 02:59:30 -- scripts/common.sh@337 -- # local 'op=<' 00:04:27.762 02:59:30 -- scripts/common.sh@339 -- # ver1_l=2 00:04:27.762 02:59:30 -- scripts/common.sh@340 -- # ver2_l=1 00:04:27.762 02:59:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:27.762 02:59:30 -- scripts/common.sh@343 -- # case "$op" in 00:04:27.762 02:59:30 -- scripts/common.sh@344 -- # : 1 00:04:27.762 02:59:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:27.762 02:59:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:27.762 02:59:30 -- scripts/common.sh@364 -- # decimal 1 00:04:27.762 02:59:30 -- scripts/common.sh@352 -- # local d=1 00:04:27.762 02:59:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:27.762 02:59:30 -- scripts/common.sh@354 -- # echo 1 00:04:27.762 02:59:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:27.762 02:59:30 -- scripts/common.sh@365 -- # decimal 2 00:04:27.762 02:59:30 -- scripts/common.sh@352 -- # local d=2 00:04:27.762 02:59:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:27.762 02:59:30 -- scripts/common.sh@354 -- # echo 2 00:04:27.762 02:59:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:27.762 02:59:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:27.762 02:59:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:27.762 02:59:30 -- scripts/common.sh@367 -- # return 0 00:04:27.762 02:59:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:27.762 02:59:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:27.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.762 --rc genhtml_branch_coverage=1 00:04:27.762 --rc genhtml_function_coverage=1 00:04:27.762 --rc genhtml_legend=1 00:04:27.762 --rc geninfo_all_blocks=1 00:04:27.762 --rc geninfo_unexecuted_blocks=1 00:04:27.762 00:04:27.762 ' 00:04:27.762 02:59:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:27.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.762 --rc genhtml_branch_coverage=1 00:04:27.762 --rc genhtml_function_coverage=1 00:04:27.762 --rc genhtml_legend=1 00:04:27.762 --rc geninfo_all_blocks=1 00:04:27.762 --rc geninfo_unexecuted_blocks=1 00:04:27.762 00:04:27.762 ' 00:04:27.762 02:59:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:27.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.762 --rc genhtml_branch_coverage=1 00:04:27.762 --rc genhtml_function_coverage=1 00:04:27.762 --rc genhtml_legend=1 00:04:27.762 --rc geninfo_all_blocks=1 00:04:27.762 --rc geninfo_unexecuted_blocks=1 00:04:27.762 00:04:27.762 ' 00:04:27.762 02:59:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:27.762 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.762 --rc genhtml_branch_coverage=1 00:04:27.762 --rc genhtml_function_coverage=1 00:04:27.762 --rc genhtml_legend=1 00:04:27.762 --rc geninfo_all_blocks=1 00:04:27.762 --rc geninfo_unexecuted_blocks=1 00:04:27.762 00:04:27.762 ' 00:04:27.762 02:59:30 -- setup/driver.sh@68 -- # setup reset 00:04:27.762 02:59:30 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:27.762 02:59:30 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:30.322 02:59:32 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:30.322 02:59:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.322 02:59:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.322 02:59:32 -- common/autotest_common.sh@10 -- # set +x 00:04:30.322 ************************************ 00:04:30.322 START TEST guess_driver 00:04:30.322 ************************************ 00:04:30.322 02:59:32 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:30.322 02:59:32 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:30.322 02:59:32 -- setup/driver.sh@47 -- # local fail=0 00:04:30.322 02:59:32 -- setup/driver.sh@49 -- # pick_driver 00:04:30.322 02:59:32 -- setup/driver.sh@36 -- # vfio 00:04:30.322 02:59:32 -- setup/driver.sh@21 -- # local iommu_grups 00:04:30.322 02:59:32 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:30.322 02:59:32 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:30.322 02:59:32 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:30.322 02:59:32 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:30.322 02:59:32 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:30.322 02:59:32 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:30.322 02:59:32 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:30.322 02:59:32 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:30.322 02:59:32 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:30.322 02:59:32 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:30.322 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:30.322 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:30.322 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:30.322 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:30.323 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:30.323 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:30.323 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:30.323 02:59:32 -- setup/driver.sh@30 -- # return 0 00:04:30.323 02:59:32 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:30.323 02:59:32 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:30.323 02:59:32 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:30.323 02:59:32 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:30.323 Looking for driver=vfio-pci 00:04:30.323 02:59:32 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:30.323 02:59:32 -- setup/driver.sh@45 -- # setup output config 00:04:30.323 02:59:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:30.323 02:59:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:33 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:33 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:33 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:31.700 02:59:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:31.700 02:59:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:31.700 02:59:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:32.637 02:59:34 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:32.637 02:59:34 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:32.637 02:59:34 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:32.637 02:59:35 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:32.637 02:59:35 -- setup/driver.sh@65 -- # setup reset 00:04:32.637 02:59:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:32.637 02:59:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:35.171 00:04:35.171 real 0m4.841s 00:04:35.171 user 0m1.121s 00:04:35.171 sys 0m1.894s 00:04:35.171 02:59:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.171 02:59:37 -- common/autotest_common.sh@10 -- # set +x 00:04:35.171 ************************************ 00:04:35.171 END TEST guess_driver 00:04:35.171 ************************************ 00:04:35.171 00:04:35.171 real 0m7.515s 00:04:35.171 user 0m1.793s 00:04:35.171 sys 0m2.992s 00:04:35.171 02:59:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:35.171 02:59:37 -- common/autotest_common.sh@10 -- # set +x 00:04:35.171 ************************************ 00:04:35.171 END TEST driver 00:04:35.171 ************************************ 00:04:35.171 02:59:37 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:35.171 02:59:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:35.171 02:59:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:35.171 02:59:37 -- common/autotest_common.sh@10 -- # set +x 00:04:35.171 ************************************ 00:04:35.171 START TEST devices 00:04:35.171 ************************************ 00:04:35.171 02:59:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:35.171 * Looking for test storage... 00:04:35.171 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:35.171 02:59:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:35.171 02:59:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:35.171 02:59:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:35.171 02:59:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:35.171 02:59:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:35.171 02:59:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:35.171 02:59:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:35.171 02:59:37 -- scripts/common.sh@335 -- # IFS=.-: 00:04:35.171 02:59:37 -- scripts/common.sh@335 -- # read -ra ver1 00:04:35.171 02:59:37 -- scripts/common.sh@336 -- # IFS=.-: 00:04:35.171 02:59:37 -- scripts/common.sh@336 -- # read -ra ver2 00:04:35.171 02:59:37 -- scripts/common.sh@337 -- # local 'op=<' 00:04:35.171 02:59:37 -- scripts/common.sh@339 -- # ver1_l=2 00:04:35.171 02:59:37 -- scripts/common.sh@340 -- # ver2_l=1 00:04:35.171 02:59:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:35.171 02:59:37 -- scripts/common.sh@343 -- # case "$op" in 00:04:35.171 02:59:37 -- scripts/common.sh@344 -- # : 1 00:04:35.171 02:59:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:35.171 02:59:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:35.171 02:59:37 -- scripts/common.sh@364 -- # decimal 1 00:04:35.171 02:59:37 -- scripts/common.sh@352 -- # local d=1 00:04:35.171 02:59:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:35.171 02:59:37 -- scripts/common.sh@354 -- # echo 1 00:04:35.171 02:59:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:35.171 02:59:37 -- scripts/common.sh@365 -- # decimal 2 00:04:35.171 02:59:37 -- scripts/common.sh@352 -- # local d=2 00:04:35.171 02:59:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:35.171 02:59:37 -- scripts/common.sh@354 -- # echo 2 00:04:35.171 02:59:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:35.171 02:59:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:35.171 02:59:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:35.171 02:59:37 -- scripts/common.sh@367 -- # return 0 00:04:35.171 02:59:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:35.171 02:59:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:35.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.171 --rc genhtml_branch_coverage=1 00:04:35.171 --rc genhtml_function_coverage=1 00:04:35.171 --rc genhtml_legend=1 00:04:35.171 --rc geninfo_all_blocks=1 00:04:35.171 --rc geninfo_unexecuted_blocks=1 00:04:35.171 00:04:35.171 ' 00:04:35.171 02:59:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:35.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.171 --rc genhtml_branch_coverage=1 00:04:35.171 --rc genhtml_function_coverage=1 00:04:35.171 --rc genhtml_legend=1 00:04:35.171 --rc geninfo_all_blocks=1 00:04:35.171 --rc geninfo_unexecuted_blocks=1 00:04:35.171 00:04:35.171 ' 00:04:35.171 02:59:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:35.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.171 --rc genhtml_branch_coverage=1 00:04:35.171 --rc genhtml_function_coverage=1 00:04:35.171 --rc genhtml_legend=1 00:04:35.171 --rc geninfo_all_blocks=1 00:04:35.171 --rc geninfo_unexecuted_blocks=1 00:04:35.171 00:04:35.171 ' 00:04:35.171 02:59:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:35.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:35.171 --rc genhtml_branch_coverage=1 00:04:35.171 --rc genhtml_function_coverage=1 00:04:35.171 --rc genhtml_legend=1 00:04:35.172 --rc geninfo_all_blocks=1 00:04:35.172 --rc geninfo_unexecuted_blocks=1 00:04:35.172 00:04:35.172 ' 00:04:35.172 02:59:37 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:35.172 02:59:37 -- setup/devices.sh@192 -- # setup reset 00:04:35.172 02:59:37 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:35.172 02:59:37 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:37.077 02:59:39 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:37.077 02:59:39 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:37.077 02:59:39 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:37.077 02:59:39 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:37.077 02:59:39 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:37.077 02:59:39 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:37.077 02:59:39 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:37.077 02:59:39 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:37.077 02:59:39 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:37.077 02:59:39 -- setup/devices.sh@196 -- # blocks=() 00:04:37.077 02:59:39 -- setup/devices.sh@196 -- # declare -a blocks 00:04:37.077 02:59:39 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:37.077 02:59:39 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:37.077 02:59:39 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:37.077 02:59:39 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:37.077 02:59:39 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:37.077 02:59:39 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:37.077 02:59:39 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:37.077 02:59:39 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:37.077 02:59:39 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:37.077 02:59:39 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:37.077 02:59:39 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:37.077 No valid GPT data, bailing 00:04:37.077 02:59:39 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:37.077 02:59:39 -- scripts/common.sh@393 -- # pt= 00:04:37.077 02:59:39 -- scripts/common.sh@394 -- # return 1 00:04:37.077 02:59:39 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:37.077 02:59:39 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:37.077 02:59:39 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:37.077 02:59:39 -- setup/common.sh@80 -- # echo 1000204886016 00:04:37.077 02:59:39 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:37.077 02:59:39 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:37.077 02:59:39 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:37.077 02:59:39 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:37.077 02:59:39 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:37.077 02:59:39 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:37.077 02:59:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.077 02:59:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.077 02:59:39 -- common/autotest_common.sh@10 -- # set +x 00:04:37.077 ************************************ 00:04:37.077 START TEST nvme_mount 00:04:37.077 ************************************ 00:04:37.077 02:59:39 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:37.077 02:59:39 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:37.077 02:59:39 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:37.077 02:59:39 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:37.077 02:59:39 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:37.077 02:59:39 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:37.077 02:59:39 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:37.077 02:59:39 -- setup/common.sh@40 -- # local part_no=1 00:04:37.077 02:59:39 -- setup/common.sh@41 -- # local size=1073741824 00:04:37.077 02:59:39 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:37.077 02:59:39 -- setup/common.sh@44 -- # parts=() 00:04:37.077 02:59:39 -- setup/common.sh@44 -- # local parts 00:04:37.077 02:59:39 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:37.077 02:59:39 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:37.077 02:59:39 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:37.077 02:59:39 -- setup/common.sh@46 -- # (( part++ )) 00:04:37.077 02:59:39 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:37.077 02:59:39 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:37.077 02:59:39 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:37.077 02:59:39 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:38.014 Creating new GPT entries in memory. 00:04:38.014 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:38.014 other utilities. 00:04:38.014 02:59:40 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:38.014 02:59:40 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:38.014 02:59:40 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:38.014 02:59:40 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:38.014 02:59:40 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:38.951 Creating new GPT entries in memory. 00:04:38.951 The operation has completed successfully. 00:04:38.951 02:59:41 -- setup/common.sh@57 -- # (( part++ )) 00:04:38.951 02:59:41 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:38.951 02:59:41 -- setup/common.sh@62 -- # wait 2318871 00:04:38.951 02:59:41 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.951 02:59:41 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:04:38.951 02:59:41 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.951 02:59:41 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:04:38.951 02:59:41 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:04:38.951 02:59:41 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.951 02:59:41 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:38.951 02:59:41 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:38.951 02:59:41 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:04:38.951 02:59:41 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:38.951 02:59:41 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:38.951 02:59:41 -- setup/devices.sh@53 -- # local found=0 00:04:38.951 02:59:41 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:38.951 02:59:41 -- setup/devices.sh@56 -- # : 00:04:38.951 02:59:41 -- setup/devices.sh@59 -- # local pci status 00:04:38.951 02:59:41 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:38.951 02:59:41 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:38.951 02:59:41 -- setup/devices.sh@47 -- # setup output config 00:04:38.951 02:59:41 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:38.951 02:59:41 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:04:39.886 02:59:42 -- setup/devices.sh@63 -- # found=1 00:04:39.886 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.886 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.886 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.886 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.886 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.886 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.886 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.886 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:39.886 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:39.886 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.145 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.145 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.145 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.145 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.145 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.145 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.145 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.145 02:59:42 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.145 02:59:42 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:40.145 02:59:42 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:40.145 02:59:42 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.145 02:59:42 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:40.145 02:59:42 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:40.145 02:59:42 -- setup/devices.sh@110 -- # cleanup_nvme 00:04:40.145 02:59:42 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.145 02:59:42 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.145 02:59:42 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:40.145 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:40.145 02:59:42 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:40.145 02:59:42 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:40.401 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:40.401 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:40.401 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:40.401 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:40.401 02:59:43 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:04:40.401 02:59:43 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:04:40.401 02:59:43 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.401 02:59:43 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:04:40.401 02:59:43 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:04:40.659 02:59:43 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.659 02:59:43 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:40.659 02:59:43 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:40.659 02:59:43 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:04:40.659 02:59:43 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:40.659 02:59:43 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:40.659 02:59:43 -- setup/devices.sh@53 -- # local found=0 00:04:40.659 02:59:43 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:40.659 02:59:43 -- setup/devices.sh@56 -- # : 00:04:40.659 02:59:43 -- setup/devices.sh@59 -- # local pci status 00:04:40.659 02:59:43 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:40.659 02:59:43 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:40.659 02:59:43 -- setup/devices.sh@47 -- # setup output config 00:04:40.660 02:59:43 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:40.660 02:59:43 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:41.592 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.592 02:59:44 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:04:41.592 02:59:44 -- setup/devices.sh@63 -- # found=1 00:04:41.592 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.593 02:59:44 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:41.593 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.851 02:59:44 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:41.851 02:59:44 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:04:41.851 02:59:44 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:41.851 02:59:44 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:04:41.851 02:59:44 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:41.851 02:59:44 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:41.851 02:59:44 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:04:41.851 02:59:44 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:41.851 02:59:44 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:04:41.851 02:59:44 -- setup/devices.sh@50 -- # local mount_point= 00:04:41.851 02:59:44 -- setup/devices.sh@51 -- # local test_file= 00:04:41.851 02:59:44 -- setup/devices.sh@53 -- # local found=0 00:04:41.851 02:59:44 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:41.851 02:59:44 -- setup/devices.sh@59 -- # local pci status 00:04:41.851 02:59:44 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:41.851 02:59:44 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:41.851 02:59:44 -- setup/devices.sh@47 -- # setup output config 00:04:41.851 02:59:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:41.851 02:59:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:04:43.226 02:59:45 -- setup/devices.sh@63 -- # found=1 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:43.226 02:59:45 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:43.226 02:59:45 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:43.226 02:59:45 -- setup/devices.sh@68 -- # return 0 00:04:43.226 02:59:45 -- setup/devices.sh@128 -- # cleanup_nvme 00:04:43.226 02:59:45 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:43.226 02:59:45 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:43.226 02:59:45 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:43.226 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:43.226 00:04:43.226 real 0m6.497s 00:04:43.226 user 0m1.520s 00:04:43.226 sys 0m2.571s 00:04:43.226 02:59:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.226 02:59:45 -- common/autotest_common.sh@10 -- # set +x 00:04:43.226 ************************************ 00:04:43.226 END TEST nvme_mount 00:04:43.226 ************************************ 00:04:43.226 02:59:45 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:04:43.226 02:59:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.226 02:59:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.226 02:59:45 -- common/autotest_common.sh@10 -- # set +x 00:04:43.226 ************************************ 00:04:43.226 START TEST dm_mount 00:04:43.226 ************************************ 00:04:43.226 02:59:45 -- common/autotest_common.sh@1114 -- # dm_mount 00:04:43.226 02:59:45 -- setup/devices.sh@144 -- # pv=nvme0n1 00:04:43.226 02:59:45 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:04:43.226 02:59:45 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:04:43.226 02:59:45 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:04:43.226 02:59:45 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:43.226 02:59:45 -- setup/common.sh@40 -- # local part_no=2 00:04:43.226 02:59:45 -- setup/common.sh@41 -- # local size=1073741824 00:04:43.226 02:59:45 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:43.226 02:59:45 -- setup/common.sh@44 -- # parts=() 00:04:43.226 02:59:45 -- setup/common.sh@44 -- # local parts 00:04:43.226 02:59:45 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:43.226 02:59:45 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:43.226 02:59:45 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:43.226 02:59:45 -- setup/common.sh@46 -- # (( part++ )) 00:04:43.226 02:59:45 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:43.226 02:59:45 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:43.226 02:59:45 -- setup/common.sh@46 -- # (( part++ )) 00:04:43.226 02:59:45 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:43.226 02:59:45 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:43.226 02:59:45 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:43.226 02:59:45 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:04:44.600 Creating new GPT entries in memory. 00:04:44.600 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:44.600 other utilities. 00:04:44.600 02:59:46 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:44.600 02:59:46 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:44.600 02:59:46 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:44.600 02:59:46 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:44.600 02:59:46 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:04:45.536 Creating new GPT entries in memory. 00:04:45.536 The operation has completed successfully. 00:04:45.536 02:59:47 -- setup/common.sh@57 -- # (( part++ )) 00:04:45.536 02:59:47 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:45.536 02:59:47 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:45.536 02:59:47 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:45.536 02:59:47 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:04:46.470 The operation has completed successfully. 00:04:46.471 02:59:48 -- setup/common.sh@57 -- # (( part++ )) 00:04:46.471 02:59:48 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:46.471 02:59:48 -- setup/common.sh@62 -- # wait 2321337 00:04:46.471 02:59:48 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:04:46.471 02:59:48 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:46.471 02:59:48 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:46.471 02:59:48 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:04:46.471 02:59:48 -- setup/devices.sh@160 -- # for t in {1..5} 00:04:46.471 02:59:48 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:46.471 02:59:48 -- setup/devices.sh@161 -- # break 00:04:46.471 02:59:48 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:46.471 02:59:48 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:04:46.471 02:59:48 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:04:46.471 02:59:48 -- setup/devices.sh@166 -- # dm=dm-0 00:04:46.471 02:59:48 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:04:46.471 02:59:48 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:04:46.471 02:59:48 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:46.471 02:59:48 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:04:46.471 02:59:48 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:46.471 02:59:48 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:04:46.471 02:59:48 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:04:46.471 02:59:48 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:46.471 02:59:49 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:46.471 02:59:49 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:46.471 02:59:49 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:04:46.471 02:59:49 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:46.471 02:59:49 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:46.471 02:59:49 -- setup/devices.sh@53 -- # local found=0 00:04:46.471 02:59:49 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:46.471 02:59:49 -- setup/devices.sh@56 -- # : 00:04:46.471 02:59:49 -- setup/devices.sh@59 -- # local pci status 00:04:46.471 02:59:49 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:46.471 02:59:49 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:46.471 02:59:49 -- setup/devices.sh@47 -- # setup output config 00:04:46.471 02:59:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:46.471 02:59:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:47.851 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:04:47.852 02:59:50 -- setup/devices.sh@63 -- # found=1 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:47.852 02:59:50 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:04:47.852 02:59:50 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:47.852 02:59:50 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:04:47.852 02:59:50 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:04:47.852 02:59:50 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:47.852 02:59:50 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:04:47.852 02:59:50 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:04:47.852 02:59:50 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:04:47.852 02:59:50 -- setup/devices.sh@50 -- # local mount_point= 00:04:47.852 02:59:50 -- setup/devices.sh@51 -- # local test_file= 00:04:47.852 02:59:50 -- setup/devices.sh@53 -- # local found=0 00:04:47.852 02:59:50 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:04:47.852 02:59:50 -- setup/devices.sh@59 -- # local pci status 00:04:47.852 02:59:50 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:47.852 02:59:50 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:04:47.852 02:59:50 -- setup/devices.sh@47 -- # setup output config 00:04:47.852 02:59:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:47.852 02:59:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:04:48.809 02:59:51 -- setup/devices.sh@63 -- # found=1 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:48.809 02:59:51 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:04:48.809 02:59:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:49.067 02:59:51 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:49.067 02:59:51 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:49.067 02:59:51 -- setup/devices.sh@68 -- # return 0 00:04:49.067 02:59:51 -- setup/devices.sh@187 -- # cleanup_dm 00:04:49.067 02:59:51 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:49.067 02:59:51 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:49.067 02:59:51 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:49.067 02:59:51 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:49.067 02:59:51 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:49.067 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:49.067 02:59:51 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:49.067 02:59:51 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:49.067 00:04:49.067 real 0m5.802s 00:04:49.067 user 0m1.015s 00:04:49.067 sys 0m1.642s 00:04:49.067 02:59:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.067 02:59:51 -- common/autotest_common.sh@10 -- # set +x 00:04:49.067 ************************************ 00:04:49.067 END TEST dm_mount 00:04:49.067 ************************************ 00:04:49.067 02:59:51 -- setup/devices.sh@1 -- # cleanup 00:04:49.067 02:59:51 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:49.067 02:59:51 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:49.067 02:59:51 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:49.067 02:59:51 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:49.067 02:59:51 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:49.067 02:59:51 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:49.325 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:49.325 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:49.325 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:49.325 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:49.325 02:59:51 -- setup/devices.sh@12 -- # cleanup_dm 00:04:49.325 02:59:51 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:49.325 02:59:51 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:49.325 02:59:51 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:49.325 02:59:51 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:49.325 02:59:51 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:49.325 02:59:51 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:49.325 00:04:49.325 real 0m14.300s 00:04:49.325 user 0m3.205s 00:04:49.325 sys 0m5.322s 00:04:49.325 02:59:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.325 02:59:51 -- common/autotest_common.sh@10 -- # set +x 00:04:49.325 ************************************ 00:04:49.325 END TEST devices 00:04:49.325 ************************************ 00:04:49.325 00:04:49.325 real 0m44.559s 00:04:49.325 user 0m12.894s 00:04:49.325 sys 0m20.177s 00:04:49.325 02:59:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.325 02:59:51 -- common/autotest_common.sh@10 -- # set +x 00:04:49.325 ************************************ 00:04:49.325 END TEST setup.sh 00:04:49.325 ************************************ 00:04:49.583 02:59:51 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:50.517 Hugepages 00:04:50.517 node hugesize free / total 00:04:50.517 node0 1048576kB 0 / 0 00:04:50.517 node0 2048kB 2048 / 2048 00:04:50.517 node1 1048576kB 0 / 0 00:04:50.517 node1 2048kB 0 / 0 00:04:50.517 00:04:50.517 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:50.517 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:04:50.517 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:04:50.517 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:04:50.517 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:04:50.517 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:04:50.517 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:04:50.517 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:04:50.517 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:04:50.517 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:04:50.517 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:04:50.517 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:04:50.517 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:04:50.517 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:04:50.517 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:04:50.517 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:04:50.517 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:04:50.517 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:04:50.517 02:59:53 -- spdk/autotest.sh@128 -- # uname -s 00:04:50.517 02:59:53 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:04:50.517 02:59:53 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:04:50.517 02:59:53 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:51.890 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:51.890 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:51.890 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:51.890 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:51.890 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:51.890 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:51.890 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:51.890 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:51.890 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:51.890 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:51.890 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:51.890 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:51.890 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:51.890 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:51.890 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:51.890 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:52.826 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:52.826 02:59:55 -- common/autotest_common.sh@1527 -- # sleep 1 00:04:54.203 02:59:56 -- common/autotest_common.sh@1528 -- # bdfs=() 00:04:54.203 02:59:56 -- common/autotest_common.sh@1528 -- # local bdfs 00:04:54.203 02:59:56 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:04:54.203 02:59:56 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:04:54.203 02:59:56 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:54.203 02:59:56 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:54.203 02:59:56 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:54.203 02:59:56 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:54.203 02:59:56 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:54.203 02:59:56 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:54.203 02:59:56 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:54.203 02:59:56 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:55.139 Waiting for block devices as requested 00:04:55.139 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:04:55.397 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:55.397 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:55.397 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:55.397 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:55.655 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:55.656 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:55.656 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:55.656 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:55.914 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:55.914 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:55.914 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:55.914 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:56.172 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:56.172 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:56.172 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:56.172 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:56.431 02:59:58 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:56.431 02:59:58 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:56.431 02:59:58 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:56.431 02:59:58 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:04:56.431 02:59:58 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:56.431 02:59:58 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:56.431 02:59:58 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:56.431 02:59:58 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:56.431 02:59:58 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:56.431 02:59:58 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:56.431 02:59:58 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:56.431 02:59:58 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:56.431 02:59:58 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:56.431 02:59:58 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:56.431 02:59:58 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:56.431 02:59:58 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:56.431 02:59:58 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:56.431 02:59:58 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:56.431 02:59:58 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:56.431 02:59:58 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:56.431 02:59:58 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:56.431 02:59:58 -- common/autotest_common.sh@1552 -- # continue 00:04:56.431 02:59:58 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:56.431 02:59:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:56.431 02:59:58 -- common/autotest_common.sh@10 -- # set +x 00:04:56.431 02:59:58 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:56.431 02:59:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:56.431 02:59:58 -- common/autotest_common.sh@10 -- # set +x 00:04:56.431 02:59:58 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:57.811 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:57.811 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:57.811 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:57.811 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:57.811 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:57.811 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:57.811 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:57.811 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:57.811 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:57.811 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:57.811 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:57.811 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:57.811 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:57.811 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:57.811 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:57.811 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:58.747 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:58.747 03:00:01 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:58.747 03:00:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:58.747 03:00:01 -- common/autotest_common.sh@10 -- # set +x 00:04:58.747 03:00:01 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:58.748 03:00:01 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:58.748 03:00:01 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:58.748 03:00:01 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:58.748 03:00:01 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:58.748 03:00:01 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:58.748 03:00:01 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:58.748 03:00:01 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:58.748 03:00:01 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:58.748 03:00:01 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:58.748 03:00:01 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:59.006 03:00:01 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:59.006 03:00:01 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:59.006 03:00:01 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:59.006 03:00:01 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:59.006 03:00:01 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:59.006 03:00:01 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:59.006 03:00:01 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:59.006 03:00:01 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:59.006 03:00:01 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:59.006 03:00:01 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=2326721 00:04:59.006 03:00:01 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:59.006 03:00:01 -- common/autotest_common.sh@1593 -- # waitforlisten 2326721 00:04:59.006 03:00:01 -- common/autotest_common.sh@829 -- # '[' -z 2326721 ']' 00:04:59.006 03:00:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:59.006 03:00:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:59.006 03:00:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:59.006 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:59.006 03:00:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:59.006 03:00:01 -- common/autotest_common.sh@10 -- # set +x 00:04:59.006 [2024-11-27 03:00:01.447682] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:59.006 [2024-11-27 03:00:01.447784] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2326721 ] 00:04:59.006 EAL: No free 2048 kB hugepages reported on node 1 00:04:59.006 [2024-11-27 03:00:01.507852] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:59.006 [2024-11-27 03:00:01.595072] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:59.006 [2024-11-27 03:00:01.595250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:59.972 03:00:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:59.972 03:00:02 -- common/autotest_common.sh@862 -- # return 0 00:04:59.972 03:00:02 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:59.972 03:00:02 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:59.972 03:00:02 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:03.259 nvme0n1 00:05:03.259 03:00:05 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:03.259 [2024-11-27 03:00:05.748195] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:03.259 [2024-11-27 03:00:05.748238] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:03.259 request: 00:05:03.259 { 00:05:03.259 "nvme_ctrlr_name": "nvme0", 00:05:03.259 "password": "test", 00:05:03.259 "method": "bdev_nvme_opal_revert", 00:05:03.259 "req_id": 1 00:05:03.259 } 00:05:03.259 Got JSON-RPC error response 00:05:03.259 response: 00:05:03.259 { 00:05:03.259 "code": -32603, 00:05:03.259 "message": "Internal error" 00:05:03.259 } 00:05:03.259 03:00:05 -- common/autotest_common.sh@1599 -- # true 00:05:03.259 03:00:05 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:03.259 03:00:05 -- common/autotest_common.sh@1603 -- # killprocess 2326721 00:05:03.259 03:00:05 -- common/autotest_common.sh@936 -- # '[' -z 2326721 ']' 00:05:03.259 03:00:05 -- common/autotest_common.sh@940 -- # kill -0 2326721 00:05:03.259 03:00:05 -- common/autotest_common.sh@941 -- # uname 00:05:03.259 03:00:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:03.259 03:00:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2326721 00:05:03.259 03:00:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:03.259 03:00:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:03.259 03:00:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2326721' 00:05:03.259 killing process with pid 2326721 00:05:03.259 03:00:05 -- common/autotest_common.sh@955 -- # kill 2326721 00:05:03.259 03:00:05 -- common/autotest_common.sh@960 -- # wait 2326721 00:05:05.160 03:00:07 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:05.160 03:00:07 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:05.160 03:00:07 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:05.160 03:00:07 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:05.160 03:00:07 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:05.160 03:00:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:05.160 03:00:07 -- common/autotest_common.sh@10 -- # set +x 00:05:05.160 03:00:07 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:05.160 03:00:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.160 03:00:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.160 03:00:07 -- common/autotest_common.sh@10 -- # set +x 00:05:05.160 ************************************ 00:05:05.160 START TEST env 00:05:05.160 ************************************ 00:05:05.160 03:00:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:05.160 * Looking for test storage... 00:05:05.160 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:05.160 03:00:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:05.160 03:00:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:05.160 03:00:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:05.160 03:00:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:05.160 03:00:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:05.160 03:00:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:05.160 03:00:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:05.160 03:00:07 -- scripts/common.sh@335 -- # IFS=.-: 00:05:05.160 03:00:07 -- scripts/common.sh@335 -- # read -ra ver1 00:05:05.160 03:00:07 -- scripts/common.sh@336 -- # IFS=.-: 00:05:05.160 03:00:07 -- scripts/common.sh@336 -- # read -ra ver2 00:05:05.160 03:00:07 -- scripts/common.sh@337 -- # local 'op=<' 00:05:05.160 03:00:07 -- scripts/common.sh@339 -- # ver1_l=2 00:05:05.160 03:00:07 -- scripts/common.sh@340 -- # ver2_l=1 00:05:05.160 03:00:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:05.160 03:00:07 -- scripts/common.sh@343 -- # case "$op" in 00:05:05.160 03:00:07 -- scripts/common.sh@344 -- # : 1 00:05:05.160 03:00:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:05.160 03:00:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:05.160 03:00:07 -- scripts/common.sh@364 -- # decimal 1 00:05:05.160 03:00:07 -- scripts/common.sh@352 -- # local d=1 00:05:05.160 03:00:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:05.160 03:00:07 -- scripts/common.sh@354 -- # echo 1 00:05:05.160 03:00:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:05.160 03:00:07 -- scripts/common.sh@365 -- # decimal 2 00:05:05.160 03:00:07 -- scripts/common.sh@352 -- # local d=2 00:05:05.160 03:00:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:05.160 03:00:07 -- scripts/common.sh@354 -- # echo 2 00:05:05.160 03:00:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:05.160 03:00:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:05.160 03:00:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:05.160 03:00:07 -- scripts/common.sh@367 -- # return 0 00:05:05.160 03:00:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:05.160 03:00:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:05.160 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:05.160 --rc genhtml_branch_coverage=1 00:05:05.160 --rc genhtml_function_coverage=1 00:05:05.160 --rc genhtml_legend=1 00:05:05.160 --rc geninfo_all_blocks=1 00:05:05.160 --rc geninfo_unexecuted_blocks=1 00:05:05.160 00:05:05.160 ' 00:05:05.160 03:00:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:05.160 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:05.160 --rc genhtml_branch_coverage=1 00:05:05.160 --rc genhtml_function_coverage=1 00:05:05.160 --rc genhtml_legend=1 00:05:05.160 --rc geninfo_all_blocks=1 00:05:05.160 --rc geninfo_unexecuted_blocks=1 00:05:05.160 00:05:05.160 ' 00:05:05.160 03:00:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:05.160 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:05.160 --rc genhtml_branch_coverage=1 00:05:05.160 --rc genhtml_function_coverage=1 00:05:05.160 --rc genhtml_legend=1 00:05:05.160 --rc geninfo_all_blocks=1 00:05:05.160 --rc geninfo_unexecuted_blocks=1 00:05:05.160 00:05:05.160 ' 00:05:05.160 03:00:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:05.160 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:05.160 --rc genhtml_branch_coverage=1 00:05:05.160 --rc genhtml_function_coverage=1 00:05:05.160 --rc genhtml_legend=1 00:05:05.160 --rc geninfo_all_blocks=1 00:05:05.160 --rc geninfo_unexecuted_blocks=1 00:05:05.160 00:05:05.160 ' 00:05:05.160 03:00:07 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:05.160 03:00:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.160 03:00:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.160 03:00:07 -- common/autotest_common.sh@10 -- # set +x 00:05:05.160 ************************************ 00:05:05.160 START TEST env_memory 00:05:05.160 ************************************ 00:05:05.160 03:00:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:05.160 00:05:05.160 00:05:05.160 CUnit - A unit testing framework for C - Version 2.1-3 00:05:05.161 http://cunit.sourceforge.net/ 00:05:05.161 00:05:05.161 00:05:05.161 Suite: memory 00:05:05.161 Test: alloc and free memory map ...[2024-11-27 03:00:07.762871] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:05.161 passed 00:05:05.420 Test: mem map translation ...[2024-11-27 03:00:07.785054] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:05.420 [2024-11-27 03:00:07.785079] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:05.420 [2024-11-27 03:00:07.785130] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:05.420 [2024-11-27 03:00:07.785142] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:05.420 passed 00:05:05.420 Test: mem map registration ...[2024-11-27 03:00:07.830294] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:05.420 [2024-11-27 03:00:07.830316] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:05.420 passed 00:05:05.420 Test: mem map adjacent registrations ...passed 00:05:05.420 00:05:05.420 Run Summary: Type Total Ran Passed Failed Inactive 00:05:05.420 suites 1 1 n/a 0 0 00:05:05.420 tests 4 4 4 0 0 00:05:05.420 asserts 152 152 152 0 n/a 00:05:05.420 00:05:05.420 Elapsed time = 0.151 seconds 00:05:05.420 00:05:05.420 real 0m0.158s 00:05:05.420 user 0m0.152s 00:05:05.420 sys 0m0.006s 00:05:05.420 03:00:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.420 03:00:07 -- common/autotest_common.sh@10 -- # set +x 00:05:05.420 ************************************ 00:05:05.420 END TEST env_memory 00:05:05.420 ************************************ 00:05:05.420 03:00:07 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:05.420 03:00:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.420 03:00:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.420 03:00:07 -- common/autotest_common.sh@10 -- # set +x 00:05:05.420 ************************************ 00:05:05.420 START TEST env_vtophys 00:05:05.420 ************************************ 00:05:05.420 03:00:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:05.420 EAL: lib.eal log level changed from notice to debug 00:05:05.420 EAL: Detected lcore 0 as core 0 on socket 0 00:05:05.420 EAL: Detected lcore 1 as core 1 on socket 0 00:05:05.420 EAL: Detected lcore 2 as core 2 on socket 0 00:05:05.420 EAL: Detected lcore 3 as core 3 on socket 0 00:05:05.420 EAL: Detected lcore 4 as core 4 on socket 0 00:05:05.420 EAL: Detected lcore 5 as core 5 on socket 0 00:05:05.420 EAL: Detected lcore 6 as core 8 on socket 0 00:05:05.420 EAL: Detected lcore 7 as core 9 on socket 0 00:05:05.420 EAL: Detected lcore 8 as core 10 on socket 0 00:05:05.420 EAL: Detected lcore 9 as core 11 on socket 0 00:05:05.420 EAL: Detected lcore 10 as core 12 on socket 0 00:05:05.420 EAL: Detected lcore 11 as core 13 on socket 0 00:05:05.420 EAL: Detected lcore 12 as core 0 on socket 1 00:05:05.420 EAL: Detected lcore 13 as core 1 on socket 1 00:05:05.420 EAL: Detected lcore 14 as core 2 on socket 1 00:05:05.420 EAL: Detected lcore 15 as core 3 on socket 1 00:05:05.420 EAL: Detected lcore 16 as core 4 on socket 1 00:05:05.420 EAL: Detected lcore 17 as core 5 on socket 1 00:05:05.420 EAL: Detected lcore 18 as core 8 on socket 1 00:05:05.420 EAL: Detected lcore 19 as core 9 on socket 1 00:05:05.420 EAL: Detected lcore 20 as core 10 on socket 1 00:05:05.420 EAL: Detected lcore 21 as core 11 on socket 1 00:05:05.420 EAL: Detected lcore 22 as core 12 on socket 1 00:05:05.420 EAL: Detected lcore 23 as core 13 on socket 1 00:05:05.420 EAL: Detected lcore 24 as core 0 on socket 0 00:05:05.420 EAL: Detected lcore 25 as core 1 on socket 0 00:05:05.420 EAL: Detected lcore 26 as core 2 on socket 0 00:05:05.420 EAL: Detected lcore 27 as core 3 on socket 0 00:05:05.420 EAL: Detected lcore 28 as core 4 on socket 0 00:05:05.420 EAL: Detected lcore 29 as core 5 on socket 0 00:05:05.420 EAL: Detected lcore 30 as core 8 on socket 0 00:05:05.420 EAL: Detected lcore 31 as core 9 on socket 0 00:05:05.420 EAL: Detected lcore 32 as core 10 on socket 0 00:05:05.420 EAL: Detected lcore 33 as core 11 on socket 0 00:05:05.420 EAL: Detected lcore 34 as core 12 on socket 0 00:05:05.420 EAL: Detected lcore 35 as core 13 on socket 0 00:05:05.420 EAL: Detected lcore 36 as core 0 on socket 1 00:05:05.420 EAL: Detected lcore 37 as core 1 on socket 1 00:05:05.420 EAL: Detected lcore 38 as core 2 on socket 1 00:05:05.420 EAL: Detected lcore 39 as core 3 on socket 1 00:05:05.420 EAL: Detected lcore 40 as core 4 on socket 1 00:05:05.420 EAL: Detected lcore 41 as core 5 on socket 1 00:05:05.420 EAL: Detected lcore 42 as core 8 on socket 1 00:05:05.420 EAL: Detected lcore 43 as core 9 on socket 1 00:05:05.420 EAL: Detected lcore 44 as core 10 on socket 1 00:05:05.420 EAL: Detected lcore 45 as core 11 on socket 1 00:05:05.420 EAL: Detected lcore 46 as core 12 on socket 1 00:05:05.420 EAL: Detected lcore 47 as core 13 on socket 1 00:05:05.420 EAL: Maximum logical cores by configuration: 128 00:05:05.420 EAL: Detected CPU lcores: 48 00:05:05.420 EAL: Detected NUMA nodes: 2 00:05:05.420 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:05.420 EAL: Detected shared linkage of DPDK 00:05:05.420 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24.0 00:05:05.420 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24.0 00:05:05.420 EAL: Registered [vdev] bus. 00:05:05.420 EAL: bus.vdev log level changed from disabled to notice 00:05:05.420 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24.0 00:05:05.420 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24.0 00:05:05.420 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:05.420 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:05.420 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:05:05.420 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:05:05.420 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:05:05.420 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:05:05.420 EAL: No shared files mode enabled, IPC will be disabled 00:05:05.420 EAL: No shared files mode enabled, IPC is disabled 00:05:05.420 EAL: Bus pci wants IOVA as 'DC' 00:05:05.421 EAL: Bus vdev wants IOVA as 'DC' 00:05:05.421 EAL: Buses did not request a specific IOVA mode. 00:05:05.421 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:05.421 EAL: Selected IOVA mode 'VA' 00:05:05.421 EAL: No free 2048 kB hugepages reported on node 1 00:05:05.421 EAL: Probing VFIO support... 00:05:05.421 EAL: IOMMU type 1 (Type 1) is supported 00:05:05.421 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:05.421 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:05.421 EAL: VFIO support initialized 00:05:05.421 EAL: Ask a virtual area of 0x2e000 bytes 00:05:05.421 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:05.421 EAL: Setting up physically contiguous memory... 00:05:05.421 EAL: Setting maximum number of open files to 524288 00:05:05.421 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:05.421 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:05.421 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:05.421 EAL: Ask a virtual area of 0x61000 bytes 00:05:05.421 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:05.421 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:05.421 EAL: Ask a virtual area of 0x400000000 bytes 00:05:05.421 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:05.421 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:05.421 EAL: Ask a virtual area of 0x61000 bytes 00:05:05.421 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:05.421 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:05.421 EAL: Ask a virtual area of 0x400000000 bytes 00:05:05.421 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:05.421 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:05.421 EAL: Ask a virtual area of 0x61000 bytes 00:05:05.421 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:05.421 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:05.421 EAL: Ask a virtual area of 0x400000000 bytes 00:05:05.421 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:05.421 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:05.421 EAL: Ask a virtual area of 0x61000 bytes 00:05:05.421 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:05.421 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:05.421 EAL: Ask a virtual area of 0x400000000 bytes 00:05:05.421 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:05.421 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:05.421 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:05.421 EAL: Ask a virtual area of 0x61000 bytes 00:05:05.421 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:05.421 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:05.421 EAL: Ask a virtual area of 0x400000000 bytes 00:05:05.421 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:05.421 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:05.421 EAL: Ask a virtual area of 0x61000 bytes 00:05:05.421 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:05.421 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:05.421 EAL: Ask a virtual area of 0x400000000 bytes 00:05:05.421 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:05.421 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:05.421 EAL: Ask a virtual area of 0x61000 bytes 00:05:05.421 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:05.421 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:05.421 EAL: Ask a virtual area of 0x400000000 bytes 00:05:05.421 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:05.421 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:05.421 EAL: Ask a virtual area of 0x61000 bytes 00:05:05.421 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:05.421 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:05.421 EAL: Ask a virtual area of 0x400000000 bytes 00:05:05.421 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:05.421 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:05.421 EAL: Hugepages will be freed exactly as allocated. 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: TSC frequency is ~2700000 KHz 00:05:05.421 EAL: Main lcore 0 is ready (tid=7f7c4c383a00;cpuset=[0]) 00:05:05.421 EAL: Trying to obtain current memory policy. 00:05:05.421 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.421 EAL: Restoring previous memory policy: 0 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was expanded by 2MB 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:05.421 EAL: Mem event callback 'spdk:(nil)' registered 00:05:05.421 00:05:05.421 00:05:05.421 CUnit - A unit testing framework for C - Version 2.1-3 00:05:05.421 http://cunit.sourceforge.net/ 00:05:05.421 00:05:05.421 00:05:05.421 Suite: components_suite 00:05:05.421 Test: vtophys_malloc_test ...passed 00:05:05.421 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:05.421 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.421 EAL: Restoring previous memory policy: 4 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was expanded by 4MB 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was shrunk by 4MB 00:05:05.421 EAL: Trying to obtain current memory policy. 00:05:05.421 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.421 EAL: Restoring previous memory policy: 4 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was expanded by 6MB 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was shrunk by 6MB 00:05:05.421 EAL: Trying to obtain current memory policy. 00:05:05.421 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.421 EAL: Restoring previous memory policy: 4 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was expanded by 10MB 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was shrunk by 10MB 00:05:05.421 EAL: Trying to obtain current memory policy. 00:05:05.421 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.421 EAL: Restoring previous memory policy: 4 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was expanded by 18MB 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was shrunk by 18MB 00:05:05.421 EAL: Trying to obtain current memory policy. 00:05:05.421 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.421 EAL: Restoring previous memory policy: 4 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was expanded by 34MB 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was shrunk by 34MB 00:05:05.421 EAL: Trying to obtain current memory policy. 00:05:05.421 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.421 EAL: Restoring previous memory policy: 4 00:05:05.421 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.421 EAL: request: mp_malloc_sync 00:05:05.421 EAL: No shared files mode enabled, IPC is disabled 00:05:05.421 EAL: Heap on socket 0 was expanded by 66MB 00:05:05.679 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.679 EAL: request: mp_malloc_sync 00:05:05.679 EAL: No shared files mode enabled, IPC is disabled 00:05:05.679 EAL: Heap on socket 0 was shrunk by 66MB 00:05:05.679 EAL: Trying to obtain current memory policy. 00:05:05.679 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.679 EAL: Restoring previous memory policy: 4 00:05:05.679 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.679 EAL: request: mp_malloc_sync 00:05:05.679 EAL: No shared files mode enabled, IPC is disabled 00:05:05.679 EAL: Heap on socket 0 was expanded by 130MB 00:05:05.679 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.679 EAL: request: mp_malloc_sync 00:05:05.679 EAL: No shared files mode enabled, IPC is disabled 00:05:05.679 EAL: Heap on socket 0 was shrunk by 130MB 00:05:05.679 EAL: Trying to obtain current memory policy. 00:05:05.679 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.679 EAL: Restoring previous memory policy: 4 00:05:05.679 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.679 EAL: request: mp_malloc_sync 00:05:05.679 EAL: No shared files mode enabled, IPC is disabled 00:05:05.679 EAL: Heap on socket 0 was expanded by 258MB 00:05:05.679 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.937 EAL: request: mp_malloc_sync 00:05:05.937 EAL: No shared files mode enabled, IPC is disabled 00:05:05.937 EAL: Heap on socket 0 was shrunk by 258MB 00:05:05.937 EAL: Trying to obtain current memory policy. 00:05:05.937 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:05.937 EAL: Restoring previous memory policy: 4 00:05:05.937 EAL: Calling mem event callback 'spdk:(nil)' 00:05:05.937 EAL: request: mp_malloc_sync 00:05:05.937 EAL: No shared files mode enabled, IPC is disabled 00:05:05.937 EAL: Heap on socket 0 was expanded by 514MB 00:05:06.196 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.196 EAL: request: mp_malloc_sync 00:05:06.196 EAL: No shared files mode enabled, IPC is disabled 00:05:06.196 EAL: Heap on socket 0 was shrunk by 514MB 00:05:06.196 EAL: Trying to obtain current memory policy. 00:05:06.196 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:06.454 EAL: Restoring previous memory policy: 4 00:05:06.454 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.454 EAL: request: mp_malloc_sync 00:05:06.454 EAL: No shared files mode enabled, IPC is disabled 00:05:06.454 EAL: Heap on socket 0 was expanded by 1026MB 00:05:06.712 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.971 EAL: request: mp_malloc_sync 00:05:06.971 EAL: No shared files mode enabled, IPC is disabled 00:05:06.971 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:06.971 passed 00:05:06.971 00:05:06.971 Run Summary: Type Total Ran Passed Failed Inactive 00:05:06.971 suites 1 1 n/a 0 0 00:05:06.971 tests 2 2 2 0 0 00:05:06.971 asserts 497 497 497 0 n/a 00:05:06.971 00:05:06.971 Elapsed time = 1.319 seconds 00:05:06.971 EAL: Calling mem event callback 'spdk:(nil)' 00:05:06.971 EAL: request: mp_malloc_sync 00:05:06.971 EAL: No shared files mode enabled, IPC is disabled 00:05:06.971 EAL: Heap on socket 0 was shrunk by 2MB 00:05:06.971 EAL: No shared files mode enabled, IPC is disabled 00:05:06.972 EAL: No shared files mode enabled, IPC is disabled 00:05:06.972 EAL: No shared files mode enabled, IPC is disabled 00:05:06.972 00:05:06.972 real 0m1.467s 00:05:06.972 user 0m0.804s 00:05:06.972 sys 0m0.601s 00:05:06.972 03:00:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:06.972 03:00:09 -- common/autotest_common.sh@10 -- # set +x 00:05:06.972 ************************************ 00:05:06.972 END TEST env_vtophys 00:05:06.972 ************************************ 00:05:06.972 03:00:09 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:06.972 03:00:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:06.972 03:00:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.972 03:00:09 -- common/autotest_common.sh@10 -- # set +x 00:05:06.972 ************************************ 00:05:06.972 START TEST env_pci 00:05:06.972 ************************************ 00:05:06.972 03:00:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:06.972 00:05:06.972 00:05:06.972 CUnit - A unit testing framework for C - Version 2.1-3 00:05:06.972 http://cunit.sourceforge.net/ 00:05:06.972 00:05:06.972 00:05:06.972 Suite: pci 00:05:06.972 Test: pci_hook ...[2024-11-27 03:00:09.420986] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2328300 has claimed it 00:05:06.972 EAL: Cannot find device (10000:00:01.0) 00:05:06.972 EAL: Failed to attach device on primary process 00:05:06.972 passed 00:05:06.972 00:05:06.972 Run Summary: Type Total Ran Passed Failed Inactive 00:05:06.972 suites 1 1 n/a 0 0 00:05:06.972 tests 1 1 1 0 0 00:05:06.972 asserts 25 25 25 0 n/a 00:05:06.972 00:05:06.972 Elapsed time = 0.020 seconds 00:05:06.972 00:05:06.972 real 0m0.033s 00:05:06.972 user 0m0.010s 00:05:06.972 sys 0m0.023s 00:05:06.972 03:00:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:06.972 03:00:09 -- common/autotest_common.sh@10 -- # set +x 00:05:06.972 ************************************ 00:05:06.972 END TEST env_pci 00:05:06.972 ************************************ 00:05:06.972 03:00:09 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:06.972 03:00:09 -- env/env.sh@15 -- # uname 00:05:06.972 03:00:09 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:06.972 03:00:09 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:06.972 03:00:09 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:06.972 03:00:09 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:06.972 03:00:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:06.972 03:00:09 -- common/autotest_common.sh@10 -- # set +x 00:05:06.972 ************************************ 00:05:06.972 START TEST env_dpdk_post_init 00:05:06.972 ************************************ 00:05:06.972 03:00:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:06.972 EAL: Detected CPU lcores: 48 00:05:06.972 EAL: Detected NUMA nodes: 2 00:05:06.972 EAL: Detected shared linkage of DPDK 00:05:06.972 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:06.972 EAL: Selected IOVA mode 'VA' 00:05:06.972 EAL: No free 2048 kB hugepages reported on node 1 00:05:06.972 EAL: VFIO support initialized 00:05:06.972 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:06.972 EAL: Using IOMMU type 1 (Type 1) 00:05:06.972 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:07.231 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:08.168 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:11.450 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:11.450 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:11.450 Starting DPDK initialization... 00:05:11.450 Starting SPDK post initialization... 00:05:11.450 SPDK NVMe probe 00:05:11.450 Attaching to 0000:88:00.0 00:05:11.450 Attached to 0000:88:00.0 00:05:11.450 Cleaning up... 00:05:11.450 00:05:11.450 real 0m4.396s 00:05:11.450 user 0m3.245s 00:05:11.450 sys 0m0.212s 00:05:11.450 03:00:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.450 03:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:11.450 ************************************ 00:05:11.450 END TEST env_dpdk_post_init 00:05:11.450 ************************************ 00:05:11.450 03:00:13 -- env/env.sh@26 -- # uname 00:05:11.450 03:00:13 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:11.450 03:00:13 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:11.450 03:00:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.450 03:00:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.450 03:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:11.450 ************************************ 00:05:11.450 START TEST env_mem_callbacks 00:05:11.450 ************************************ 00:05:11.450 03:00:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:11.450 EAL: Detected CPU lcores: 48 00:05:11.450 EAL: Detected NUMA nodes: 2 00:05:11.450 EAL: Detected shared linkage of DPDK 00:05:11.450 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:11.450 EAL: Selected IOVA mode 'VA' 00:05:11.450 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.450 EAL: VFIO support initialized 00:05:11.450 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:11.450 00:05:11.450 00:05:11.450 CUnit - A unit testing framework for C - Version 2.1-3 00:05:11.450 http://cunit.sourceforge.net/ 00:05:11.450 00:05:11.450 00:05:11.450 Suite: memory 00:05:11.450 Test: test ... 00:05:11.450 register 0x200000200000 2097152 00:05:11.450 malloc 3145728 00:05:11.450 register 0x200000400000 4194304 00:05:11.450 buf 0x200000500000 len 3145728 PASSED 00:05:11.450 malloc 64 00:05:11.450 buf 0x2000004fff40 len 64 PASSED 00:05:11.450 malloc 4194304 00:05:11.450 register 0x200000800000 6291456 00:05:11.450 buf 0x200000a00000 len 4194304 PASSED 00:05:11.450 free 0x200000500000 3145728 00:05:11.450 free 0x2000004fff40 64 00:05:11.450 unregister 0x200000400000 4194304 PASSED 00:05:11.450 free 0x200000a00000 4194304 00:05:11.450 unregister 0x200000800000 6291456 PASSED 00:05:11.450 malloc 8388608 00:05:11.450 register 0x200000400000 10485760 00:05:11.450 buf 0x200000600000 len 8388608 PASSED 00:05:11.450 free 0x200000600000 8388608 00:05:11.450 unregister 0x200000400000 10485760 PASSED 00:05:11.450 passed 00:05:11.450 00:05:11.450 Run Summary: Type Total Ran Passed Failed Inactive 00:05:11.450 suites 1 1 n/a 0 0 00:05:11.450 tests 1 1 1 0 0 00:05:11.450 asserts 15 15 15 0 n/a 00:05:11.450 00:05:11.450 Elapsed time = 0.005 seconds 00:05:11.450 00:05:11.450 real 0m0.051s 00:05:11.450 user 0m0.011s 00:05:11.450 sys 0m0.040s 00:05:11.450 03:00:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.450 03:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:11.450 ************************************ 00:05:11.450 END TEST env_mem_callbacks 00:05:11.450 ************************************ 00:05:11.450 00:05:11.450 real 0m6.387s 00:05:11.450 user 0m4.362s 00:05:11.450 sys 0m1.055s 00:05:11.450 03:00:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.450 03:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:11.450 ************************************ 00:05:11.450 END TEST env 00:05:11.450 ************************************ 00:05:11.450 03:00:13 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:11.450 03:00:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:11.450 03:00:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:11.450 03:00:13 -- common/autotest_common.sh@10 -- # set +x 00:05:11.450 ************************************ 00:05:11.450 START TEST rpc 00:05:11.450 ************************************ 00:05:11.450 03:00:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:11.450 * Looking for test storage... 00:05:11.450 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:11.450 03:00:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:11.450 03:00:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:11.450 03:00:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:11.709 03:00:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:11.709 03:00:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:11.709 03:00:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:11.709 03:00:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:11.709 03:00:14 -- scripts/common.sh@335 -- # IFS=.-: 00:05:11.709 03:00:14 -- scripts/common.sh@335 -- # read -ra ver1 00:05:11.709 03:00:14 -- scripts/common.sh@336 -- # IFS=.-: 00:05:11.709 03:00:14 -- scripts/common.sh@336 -- # read -ra ver2 00:05:11.709 03:00:14 -- scripts/common.sh@337 -- # local 'op=<' 00:05:11.709 03:00:14 -- scripts/common.sh@339 -- # ver1_l=2 00:05:11.709 03:00:14 -- scripts/common.sh@340 -- # ver2_l=1 00:05:11.709 03:00:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:11.709 03:00:14 -- scripts/common.sh@343 -- # case "$op" in 00:05:11.709 03:00:14 -- scripts/common.sh@344 -- # : 1 00:05:11.709 03:00:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:11.709 03:00:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:11.709 03:00:14 -- scripts/common.sh@364 -- # decimal 1 00:05:11.709 03:00:14 -- scripts/common.sh@352 -- # local d=1 00:05:11.709 03:00:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:11.709 03:00:14 -- scripts/common.sh@354 -- # echo 1 00:05:11.709 03:00:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:11.709 03:00:14 -- scripts/common.sh@365 -- # decimal 2 00:05:11.709 03:00:14 -- scripts/common.sh@352 -- # local d=2 00:05:11.709 03:00:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:11.709 03:00:14 -- scripts/common.sh@354 -- # echo 2 00:05:11.709 03:00:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:11.709 03:00:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:11.709 03:00:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:11.709 03:00:14 -- scripts/common.sh@367 -- # return 0 00:05:11.709 03:00:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:11.709 03:00:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:11.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:11.709 --rc genhtml_branch_coverage=1 00:05:11.709 --rc genhtml_function_coverage=1 00:05:11.709 --rc genhtml_legend=1 00:05:11.709 --rc geninfo_all_blocks=1 00:05:11.709 --rc geninfo_unexecuted_blocks=1 00:05:11.709 00:05:11.709 ' 00:05:11.709 03:00:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:11.709 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:11.709 --rc genhtml_branch_coverage=1 00:05:11.709 --rc genhtml_function_coverage=1 00:05:11.709 --rc genhtml_legend=1 00:05:11.709 --rc geninfo_all_blocks=1 00:05:11.709 --rc geninfo_unexecuted_blocks=1 00:05:11.709 00:05:11.709 ' 00:05:11.709 03:00:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:11.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:11.710 --rc genhtml_branch_coverage=1 00:05:11.710 --rc genhtml_function_coverage=1 00:05:11.710 --rc genhtml_legend=1 00:05:11.710 --rc geninfo_all_blocks=1 00:05:11.710 --rc geninfo_unexecuted_blocks=1 00:05:11.710 00:05:11.710 ' 00:05:11.710 03:00:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:11.710 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:11.710 --rc genhtml_branch_coverage=1 00:05:11.710 --rc genhtml_function_coverage=1 00:05:11.710 --rc genhtml_legend=1 00:05:11.710 --rc geninfo_all_blocks=1 00:05:11.710 --rc geninfo_unexecuted_blocks=1 00:05:11.710 00:05:11.710 ' 00:05:11.710 03:00:14 -- rpc/rpc.sh@65 -- # spdk_pid=2328976 00:05:11.710 03:00:14 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:11.710 03:00:14 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:11.710 03:00:14 -- rpc/rpc.sh@67 -- # waitforlisten 2328976 00:05:11.710 03:00:14 -- common/autotest_common.sh@829 -- # '[' -z 2328976 ']' 00:05:11.710 03:00:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:11.710 03:00:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:11.710 03:00:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:11.710 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:11.710 03:00:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:11.710 03:00:14 -- common/autotest_common.sh@10 -- # set +x 00:05:11.710 [2024-11-27 03:00:14.182729] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:11.710 [2024-11-27 03:00:14.182810] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2328976 ] 00:05:11.710 EAL: No free 2048 kB hugepages reported on node 1 00:05:11.710 [2024-11-27 03:00:14.241290] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:11.968 [2024-11-27 03:00:14.327643] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:11.969 [2024-11-27 03:00:14.327794] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:11.969 [2024-11-27 03:00:14.327822] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2328976' to capture a snapshot of events at runtime. 00:05:11.969 [2024-11-27 03:00:14.327835] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2328976 for offline analysis/debug. 00:05:11.969 [2024-11-27 03:00:14.327870] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:12.535 03:00:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.535 03:00:15 -- common/autotest_common.sh@862 -- # return 0 00:05:12.535 03:00:15 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:12.535 03:00:15 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:12.535 03:00:15 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:12.535 03:00:15 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:12.535 03:00:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.535 03:00:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.535 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.535 ************************************ 00:05:12.535 START TEST rpc_integrity 00:05:12.535 ************************************ 00:05:12.535 03:00:15 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:12.535 03:00:15 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:12.535 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.535 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.794 03:00:15 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:12.794 03:00:15 -- rpc/rpc.sh@13 -- # jq length 00:05:12.794 03:00:15 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:12.794 03:00:15 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:12.794 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.794 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.794 03:00:15 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:12.794 03:00:15 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:12.794 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.794 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.794 03:00:15 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:12.794 { 00:05:12.794 "name": "Malloc0", 00:05:12.794 "aliases": [ 00:05:12.794 "917bb88b-96ac-4dfc-920a-8207e65ccb0d" 00:05:12.794 ], 00:05:12.794 "product_name": "Malloc disk", 00:05:12.794 "block_size": 512, 00:05:12.794 "num_blocks": 16384, 00:05:12.794 "uuid": "917bb88b-96ac-4dfc-920a-8207e65ccb0d", 00:05:12.794 "assigned_rate_limits": { 00:05:12.794 "rw_ios_per_sec": 0, 00:05:12.794 "rw_mbytes_per_sec": 0, 00:05:12.794 "r_mbytes_per_sec": 0, 00:05:12.794 "w_mbytes_per_sec": 0 00:05:12.794 }, 00:05:12.794 "claimed": false, 00:05:12.794 "zoned": false, 00:05:12.794 "supported_io_types": { 00:05:12.794 "read": true, 00:05:12.794 "write": true, 00:05:12.794 "unmap": true, 00:05:12.794 "write_zeroes": true, 00:05:12.794 "flush": true, 00:05:12.794 "reset": true, 00:05:12.794 "compare": false, 00:05:12.794 "compare_and_write": false, 00:05:12.794 "abort": true, 00:05:12.794 "nvme_admin": false, 00:05:12.794 "nvme_io": false 00:05:12.794 }, 00:05:12.794 "memory_domains": [ 00:05:12.794 { 00:05:12.794 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:12.794 "dma_device_type": 2 00:05:12.794 } 00:05:12.794 ], 00:05:12.794 "driver_specific": {} 00:05:12.794 } 00:05:12.794 ]' 00:05:12.794 03:00:15 -- rpc/rpc.sh@17 -- # jq length 00:05:12.794 03:00:15 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:12.794 03:00:15 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:12.794 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.794 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 [2024-11-27 03:00:15.255560] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:12.794 [2024-11-27 03:00:15.255619] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:12.794 [2024-11-27 03:00:15.255642] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1de4bf0 00:05:12.794 [2024-11-27 03:00:15.255657] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:12.794 [2024-11-27 03:00:15.257061] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:12.794 [2024-11-27 03:00:15.257088] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:12.794 Passthru0 00:05:12.794 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.794 03:00:15 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:12.794 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.794 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.794 03:00:15 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:12.794 { 00:05:12.794 "name": "Malloc0", 00:05:12.794 "aliases": [ 00:05:12.794 "917bb88b-96ac-4dfc-920a-8207e65ccb0d" 00:05:12.794 ], 00:05:12.794 "product_name": "Malloc disk", 00:05:12.794 "block_size": 512, 00:05:12.794 "num_blocks": 16384, 00:05:12.794 "uuid": "917bb88b-96ac-4dfc-920a-8207e65ccb0d", 00:05:12.794 "assigned_rate_limits": { 00:05:12.794 "rw_ios_per_sec": 0, 00:05:12.794 "rw_mbytes_per_sec": 0, 00:05:12.794 "r_mbytes_per_sec": 0, 00:05:12.794 "w_mbytes_per_sec": 0 00:05:12.794 }, 00:05:12.794 "claimed": true, 00:05:12.794 "claim_type": "exclusive_write", 00:05:12.794 "zoned": false, 00:05:12.794 "supported_io_types": { 00:05:12.794 "read": true, 00:05:12.794 "write": true, 00:05:12.794 "unmap": true, 00:05:12.794 "write_zeroes": true, 00:05:12.794 "flush": true, 00:05:12.794 "reset": true, 00:05:12.794 "compare": false, 00:05:12.794 "compare_and_write": false, 00:05:12.794 "abort": true, 00:05:12.794 "nvme_admin": false, 00:05:12.794 "nvme_io": false 00:05:12.794 }, 00:05:12.794 "memory_domains": [ 00:05:12.794 { 00:05:12.794 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:12.794 "dma_device_type": 2 00:05:12.794 } 00:05:12.794 ], 00:05:12.794 "driver_specific": {} 00:05:12.794 }, 00:05:12.794 { 00:05:12.794 "name": "Passthru0", 00:05:12.794 "aliases": [ 00:05:12.794 "1f582334-390f-5bbc-beb3-e96521d91678" 00:05:12.794 ], 00:05:12.794 "product_name": "passthru", 00:05:12.794 "block_size": 512, 00:05:12.794 "num_blocks": 16384, 00:05:12.794 "uuid": "1f582334-390f-5bbc-beb3-e96521d91678", 00:05:12.794 "assigned_rate_limits": { 00:05:12.794 "rw_ios_per_sec": 0, 00:05:12.794 "rw_mbytes_per_sec": 0, 00:05:12.794 "r_mbytes_per_sec": 0, 00:05:12.794 "w_mbytes_per_sec": 0 00:05:12.794 }, 00:05:12.794 "claimed": false, 00:05:12.794 "zoned": false, 00:05:12.794 "supported_io_types": { 00:05:12.794 "read": true, 00:05:12.794 "write": true, 00:05:12.794 "unmap": true, 00:05:12.794 "write_zeroes": true, 00:05:12.794 "flush": true, 00:05:12.794 "reset": true, 00:05:12.794 "compare": false, 00:05:12.794 "compare_and_write": false, 00:05:12.794 "abort": true, 00:05:12.794 "nvme_admin": false, 00:05:12.794 "nvme_io": false 00:05:12.794 }, 00:05:12.794 "memory_domains": [ 00:05:12.794 { 00:05:12.794 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:12.794 "dma_device_type": 2 00:05:12.794 } 00:05:12.794 ], 00:05:12.794 "driver_specific": { 00:05:12.794 "passthru": { 00:05:12.794 "name": "Passthru0", 00:05:12.794 "base_bdev_name": "Malloc0" 00:05:12.794 } 00:05:12.794 } 00:05:12.794 } 00:05:12.794 ]' 00:05:12.794 03:00:15 -- rpc/rpc.sh@21 -- # jq length 00:05:12.794 03:00:15 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:12.794 03:00:15 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:12.794 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.794 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.794 03:00:15 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:12.794 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.794 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.794 03:00:15 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:12.794 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.794 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.794 03:00:15 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:12.794 03:00:15 -- rpc/rpc.sh@26 -- # jq length 00:05:12.794 03:00:15 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:12.794 00:05:12.794 real 0m0.225s 00:05:12.794 user 0m0.145s 00:05:12.794 sys 0m0.021s 00:05:12.794 03:00:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.794 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 ************************************ 00:05:12.794 END TEST rpc_integrity 00:05:12.794 ************************************ 00:05:12.794 03:00:15 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:12.794 03:00:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.794 03:00:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.794 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.794 ************************************ 00:05:12.794 START TEST rpc_plugins 00:05:12.794 ************************************ 00:05:12.794 03:00:15 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:12.794 03:00:15 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:12.794 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.795 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:12.795 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:12.795 03:00:15 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:12.795 03:00:15 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:12.795 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:12.795 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.054 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.054 03:00:15 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:13.054 { 00:05:13.054 "name": "Malloc1", 00:05:13.054 "aliases": [ 00:05:13.054 "bf68f265-685b-4b2d-a8c2-b24e66740443" 00:05:13.054 ], 00:05:13.054 "product_name": "Malloc disk", 00:05:13.054 "block_size": 4096, 00:05:13.054 "num_blocks": 256, 00:05:13.054 "uuid": "bf68f265-685b-4b2d-a8c2-b24e66740443", 00:05:13.054 "assigned_rate_limits": { 00:05:13.054 "rw_ios_per_sec": 0, 00:05:13.054 "rw_mbytes_per_sec": 0, 00:05:13.054 "r_mbytes_per_sec": 0, 00:05:13.054 "w_mbytes_per_sec": 0 00:05:13.054 }, 00:05:13.054 "claimed": false, 00:05:13.054 "zoned": false, 00:05:13.054 "supported_io_types": { 00:05:13.054 "read": true, 00:05:13.054 "write": true, 00:05:13.054 "unmap": true, 00:05:13.054 "write_zeroes": true, 00:05:13.054 "flush": true, 00:05:13.054 "reset": true, 00:05:13.054 "compare": false, 00:05:13.054 "compare_and_write": false, 00:05:13.054 "abort": true, 00:05:13.054 "nvme_admin": false, 00:05:13.054 "nvme_io": false 00:05:13.054 }, 00:05:13.054 "memory_domains": [ 00:05:13.054 { 00:05:13.054 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:13.054 "dma_device_type": 2 00:05:13.054 } 00:05:13.054 ], 00:05:13.054 "driver_specific": {} 00:05:13.054 } 00:05:13.054 ]' 00:05:13.054 03:00:15 -- rpc/rpc.sh@32 -- # jq length 00:05:13.054 03:00:15 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:13.054 03:00:15 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:13.054 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.054 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.054 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.054 03:00:15 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:13.054 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.054 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.054 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.054 03:00:15 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:13.054 03:00:15 -- rpc/rpc.sh@36 -- # jq length 00:05:13.054 03:00:15 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:13.054 00:05:13.054 real 0m0.113s 00:05:13.054 user 0m0.069s 00:05:13.054 sys 0m0.009s 00:05:13.054 03:00:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.054 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.054 ************************************ 00:05:13.054 END TEST rpc_plugins 00:05:13.054 ************************************ 00:05:13.054 03:00:15 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:13.054 03:00:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.054 03:00:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.054 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.054 ************************************ 00:05:13.054 START TEST rpc_trace_cmd_test 00:05:13.054 ************************************ 00:05:13.054 03:00:15 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:13.054 03:00:15 -- rpc/rpc.sh@40 -- # local info 00:05:13.054 03:00:15 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:13.054 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.054 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.054 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.054 03:00:15 -- rpc/rpc.sh@42 -- # info='{ 00:05:13.054 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2328976", 00:05:13.054 "tpoint_group_mask": "0x8", 00:05:13.054 "iscsi_conn": { 00:05:13.054 "mask": "0x2", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "scsi": { 00:05:13.054 "mask": "0x4", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "bdev": { 00:05:13.054 "mask": "0x8", 00:05:13.054 "tpoint_mask": "0xffffffffffffffff" 00:05:13.054 }, 00:05:13.054 "nvmf_rdma": { 00:05:13.054 "mask": "0x10", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "nvmf_tcp": { 00:05:13.054 "mask": "0x20", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "ftl": { 00:05:13.054 "mask": "0x40", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "blobfs": { 00:05:13.054 "mask": "0x80", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "dsa": { 00:05:13.054 "mask": "0x200", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "thread": { 00:05:13.054 "mask": "0x400", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "nvme_pcie": { 00:05:13.054 "mask": "0x800", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "iaa": { 00:05:13.054 "mask": "0x1000", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "nvme_tcp": { 00:05:13.054 "mask": "0x2000", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 }, 00:05:13.054 "bdev_nvme": { 00:05:13.054 "mask": "0x4000", 00:05:13.054 "tpoint_mask": "0x0" 00:05:13.054 } 00:05:13.054 }' 00:05:13.054 03:00:15 -- rpc/rpc.sh@43 -- # jq length 00:05:13.054 03:00:15 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:13.054 03:00:15 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:13.054 03:00:15 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:13.054 03:00:15 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:13.054 03:00:15 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:13.054 03:00:15 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:13.313 03:00:15 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:13.313 03:00:15 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:13.313 03:00:15 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:13.313 00:05:13.313 real 0m0.198s 00:05:13.313 user 0m0.175s 00:05:13.313 sys 0m0.014s 00:05:13.313 03:00:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.313 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.313 ************************************ 00:05:13.313 END TEST rpc_trace_cmd_test 00:05:13.313 ************************************ 00:05:13.313 03:00:15 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:13.313 03:00:15 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:13.313 03:00:15 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:13.313 03:00:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:13.313 03:00:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:13.313 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.313 ************************************ 00:05:13.313 START TEST rpc_daemon_integrity 00:05:13.313 ************************************ 00:05:13.313 03:00:15 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:13.313 03:00:15 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:13.313 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.313 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.313 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.313 03:00:15 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:13.313 03:00:15 -- rpc/rpc.sh@13 -- # jq length 00:05:13.313 03:00:15 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:13.313 03:00:15 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:13.313 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.313 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.313 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.313 03:00:15 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:13.313 03:00:15 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:13.313 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.313 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.313 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.313 03:00:15 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:13.313 { 00:05:13.313 "name": "Malloc2", 00:05:13.313 "aliases": [ 00:05:13.313 "63efe759-154e-49ff-9038-76eae7e42ce3" 00:05:13.313 ], 00:05:13.313 "product_name": "Malloc disk", 00:05:13.313 "block_size": 512, 00:05:13.313 "num_blocks": 16384, 00:05:13.313 "uuid": "63efe759-154e-49ff-9038-76eae7e42ce3", 00:05:13.313 "assigned_rate_limits": { 00:05:13.313 "rw_ios_per_sec": 0, 00:05:13.313 "rw_mbytes_per_sec": 0, 00:05:13.313 "r_mbytes_per_sec": 0, 00:05:13.313 "w_mbytes_per_sec": 0 00:05:13.313 }, 00:05:13.313 "claimed": false, 00:05:13.313 "zoned": false, 00:05:13.313 "supported_io_types": { 00:05:13.313 "read": true, 00:05:13.313 "write": true, 00:05:13.313 "unmap": true, 00:05:13.313 "write_zeroes": true, 00:05:13.313 "flush": true, 00:05:13.313 "reset": true, 00:05:13.313 "compare": false, 00:05:13.313 "compare_and_write": false, 00:05:13.313 "abort": true, 00:05:13.313 "nvme_admin": false, 00:05:13.313 "nvme_io": false 00:05:13.313 }, 00:05:13.313 "memory_domains": [ 00:05:13.313 { 00:05:13.313 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:13.313 "dma_device_type": 2 00:05:13.313 } 00:05:13.313 ], 00:05:13.313 "driver_specific": {} 00:05:13.313 } 00:05:13.313 ]' 00:05:13.313 03:00:15 -- rpc/rpc.sh@17 -- # jq length 00:05:13.313 03:00:15 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:13.313 03:00:15 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:13.313 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.313 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.313 [2024-11-27 03:00:15.873361] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:13.313 [2024-11-27 03:00:15.873407] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:13.313 [2024-11-27 03:00:15.873431] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1f84940 00:05:13.313 [2024-11-27 03:00:15.873446] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:13.313 [2024-11-27 03:00:15.874816] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:13.313 [2024-11-27 03:00:15.874850] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:13.313 Passthru0 00:05:13.313 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.313 03:00:15 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:13.313 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.313 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.313 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.313 03:00:15 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:13.313 { 00:05:13.313 "name": "Malloc2", 00:05:13.313 "aliases": [ 00:05:13.313 "63efe759-154e-49ff-9038-76eae7e42ce3" 00:05:13.313 ], 00:05:13.313 "product_name": "Malloc disk", 00:05:13.313 "block_size": 512, 00:05:13.313 "num_blocks": 16384, 00:05:13.313 "uuid": "63efe759-154e-49ff-9038-76eae7e42ce3", 00:05:13.313 "assigned_rate_limits": { 00:05:13.314 "rw_ios_per_sec": 0, 00:05:13.314 "rw_mbytes_per_sec": 0, 00:05:13.314 "r_mbytes_per_sec": 0, 00:05:13.314 "w_mbytes_per_sec": 0 00:05:13.314 }, 00:05:13.314 "claimed": true, 00:05:13.314 "claim_type": "exclusive_write", 00:05:13.314 "zoned": false, 00:05:13.314 "supported_io_types": { 00:05:13.314 "read": true, 00:05:13.314 "write": true, 00:05:13.314 "unmap": true, 00:05:13.314 "write_zeroes": true, 00:05:13.314 "flush": true, 00:05:13.314 "reset": true, 00:05:13.314 "compare": false, 00:05:13.314 "compare_and_write": false, 00:05:13.314 "abort": true, 00:05:13.314 "nvme_admin": false, 00:05:13.314 "nvme_io": false 00:05:13.314 }, 00:05:13.314 "memory_domains": [ 00:05:13.314 { 00:05:13.314 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:13.314 "dma_device_type": 2 00:05:13.314 } 00:05:13.314 ], 00:05:13.314 "driver_specific": {} 00:05:13.314 }, 00:05:13.314 { 00:05:13.314 "name": "Passthru0", 00:05:13.314 "aliases": [ 00:05:13.314 "500f1969-73cf-5d20-8b2b-c51580b1f16d" 00:05:13.314 ], 00:05:13.314 "product_name": "passthru", 00:05:13.314 "block_size": 512, 00:05:13.314 "num_blocks": 16384, 00:05:13.314 "uuid": "500f1969-73cf-5d20-8b2b-c51580b1f16d", 00:05:13.314 "assigned_rate_limits": { 00:05:13.314 "rw_ios_per_sec": 0, 00:05:13.314 "rw_mbytes_per_sec": 0, 00:05:13.314 "r_mbytes_per_sec": 0, 00:05:13.314 "w_mbytes_per_sec": 0 00:05:13.314 }, 00:05:13.314 "claimed": false, 00:05:13.314 "zoned": false, 00:05:13.314 "supported_io_types": { 00:05:13.314 "read": true, 00:05:13.314 "write": true, 00:05:13.314 "unmap": true, 00:05:13.314 "write_zeroes": true, 00:05:13.314 "flush": true, 00:05:13.314 "reset": true, 00:05:13.314 "compare": false, 00:05:13.314 "compare_and_write": false, 00:05:13.314 "abort": true, 00:05:13.314 "nvme_admin": false, 00:05:13.314 "nvme_io": false 00:05:13.314 }, 00:05:13.314 "memory_domains": [ 00:05:13.314 { 00:05:13.314 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:13.314 "dma_device_type": 2 00:05:13.314 } 00:05:13.314 ], 00:05:13.314 "driver_specific": { 00:05:13.314 "passthru": { 00:05:13.314 "name": "Passthru0", 00:05:13.314 "base_bdev_name": "Malloc2" 00:05:13.314 } 00:05:13.314 } 00:05:13.314 } 00:05:13.314 ]' 00:05:13.314 03:00:15 -- rpc/rpc.sh@21 -- # jq length 00:05:13.314 03:00:15 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:13.314 03:00:15 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:13.314 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.314 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.572 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.572 03:00:15 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:13.572 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.572 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.572 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.572 03:00:15 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:13.572 03:00:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.572 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.572 03:00:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.572 03:00:15 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:13.572 03:00:15 -- rpc/rpc.sh@26 -- # jq length 00:05:13.572 03:00:15 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:13.572 00:05:13.572 real 0m0.226s 00:05:13.572 user 0m0.149s 00:05:13.572 sys 0m0.019s 00:05:13.572 03:00:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:13.572 03:00:15 -- common/autotest_common.sh@10 -- # set +x 00:05:13.572 ************************************ 00:05:13.572 END TEST rpc_daemon_integrity 00:05:13.572 ************************************ 00:05:13.572 03:00:16 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:13.572 03:00:16 -- rpc/rpc.sh@84 -- # killprocess 2328976 00:05:13.572 03:00:16 -- common/autotest_common.sh@936 -- # '[' -z 2328976 ']' 00:05:13.572 03:00:16 -- common/autotest_common.sh@940 -- # kill -0 2328976 00:05:13.572 03:00:16 -- common/autotest_common.sh@941 -- # uname 00:05:13.572 03:00:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:13.572 03:00:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2328976 00:05:13.572 03:00:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:13.572 03:00:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:13.572 03:00:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2328976' 00:05:13.572 killing process with pid 2328976 00:05:13.572 03:00:16 -- common/autotest_common.sh@955 -- # kill 2328976 00:05:13.572 03:00:16 -- common/autotest_common.sh@960 -- # wait 2328976 00:05:14.138 00:05:14.138 real 0m2.464s 00:05:14.138 user 0m3.104s 00:05:14.138 sys 0m0.603s 00:05:14.138 03:00:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.138 03:00:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.138 ************************************ 00:05:14.138 END TEST rpc 00:05:14.138 ************************************ 00:05:14.138 03:00:16 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:14.138 03:00:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.138 03:00:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.138 03:00:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.138 ************************************ 00:05:14.138 START TEST rpc_client 00:05:14.138 ************************************ 00:05:14.138 03:00:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:14.138 * Looking for test storage... 00:05:14.138 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:14.138 03:00:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:14.138 03:00:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:14.138 03:00:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:14.138 03:00:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:14.138 03:00:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:14.138 03:00:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:14.138 03:00:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:14.138 03:00:16 -- scripts/common.sh@335 -- # IFS=.-: 00:05:14.138 03:00:16 -- scripts/common.sh@335 -- # read -ra ver1 00:05:14.138 03:00:16 -- scripts/common.sh@336 -- # IFS=.-: 00:05:14.138 03:00:16 -- scripts/common.sh@336 -- # read -ra ver2 00:05:14.138 03:00:16 -- scripts/common.sh@337 -- # local 'op=<' 00:05:14.138 03:00:16 -- scripts/common.sh@339 -- # ver1_l=2 00:05:14.138 03:00:16 -- scripts/common.sh@340 -- # ver2_l=1 00:05:14.138 03:00:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:14.138 03:00:16 -- scripts/common.sh@343 -- # case "$op" in 00:05:14.138 03:00:16 -- scripts/common.sh@344 -- # : 1 00:05:14.138 03:00:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:14.138 03:00:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:14.138 03:00:16 -- scripts/common.sh@364 -- # decimal 1 00:05:14.138 03:00:16 -- scripts/common.sh@352 -- # local d=1 00:05:14.138 03:00:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:14.138 03:00:16 -- scripts/common.sh@354 -- # echo 1 00:05:14.138 03:00:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:14.138 03:00:16 -- scripts/common.sh@365 -- # decimal 2 00:05:14.138 03:00:16 -- scripts/common.sh@352 -- # local d=2 00:05:14.138 03:00:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:14.138 03:00:16 -- scripts/common.sh@354 -- # echo 2 00:05:14.138 03:00:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:14.138 03:00:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:14.139 03:00:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:14.139 03:00:16 -- scripts/common.sh@367 -- # return 0 00:05:14.139 03:00:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:14.139 03:00:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:14.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.139 --rc genhtml_branch_coverage=1 00:05:14.139 --rc genhtml_function_coverage=1 00:05:14.139 --rc genhtml_legend=1 00:05:14.139 --rc geninfo_all_blocks=1 00:05:14.139 --rc geninfo_unexecuted_blocks=1 00:05:14.139 00:05:14.139 ' 00:05:14.139 03:00:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:14.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.139 --rc genhtml_branch_coverage=1 00:05:14.139 --rc genhtml_function_coverage=1 00:05:14.139 --rc genhtml_legend=1 00:05:14.139 --rc geninfo_all_blocks=1 00:05:14.139 --rc geninfo_unexecuted_blocks=1 00:05:14.139 00:05:14.139 ' 00:05:14.139 03:00:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:14.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.139 --rc genhtml_branch_coverage=1 00:05:14.139 --rc genhtml_function_coverage=1 00:05:14.139 --rc genhtml_legend=1 00:05:14.139 --rc geninfo_all_blocks=1 00:05:14.139 --rc geninfo_unexecuted_blocks=1 00:05:14.139 00:05:14.139 ' 00:05:14.139 03:00:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:14.139 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.139 --rc genhtml_branch_coverage=1 00:05:14.139 --rc genhtml_function_coverage=1 00:05:14.139 --rc genhtml_legend=1 00:05:14.139 --rc geninfo_all_blocks=1 00:05:14.139 --rc geninfo_unexecuted_blocks=1 00:05:14.139 00:05:14.139 ' 00:05:14.139 03:00:16 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:14.139 OK 00:05:14.139 03:00:16 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:14.139 00:05:14.139 real 0m0.149s 00:05:14.139 user 0m0.104s 00:05:14.139 sys 0m0.053s 00:05:14.139 03:00:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.139 03:00:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.139 ************************************ 00:05:14.139 END TEST rpc_client 00:05:14.139 ************************************ 00:05:14.139 03:00:16 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:14.139 03:00:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.139 03:00:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.139 03:00:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.139 ************************************ 00:05:14.139 START TEST json_config 00:05:14.139 ************************************ 00:05:14.139 03:00:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:14.139 03:00:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:14.139 03:00:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:14.139 03:00:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:14.398 03:00:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:14.398 03:00:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:14.398 03:00:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:14.398 03:00:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:14.398 03:00:16 -- scripts/common.sh@335 -- # IFS=.-: 00:05:14.398 03:00:16 -- scripts/common.sh@335 -- # read -ra ver1 00:05:14.398 03:00:16 -- scripts/common.sh@336 -- # IFS=.-: 00:05:14.398 03:00:16 -- scripts/common.sh@336 -- # read -ra ver2 00:05:14.398 03:00:16 -- scripts/common.sh@337 -- # local 'op=<' 00:05:14.398 03:00:16 -- scripts/common.sh@339 -- # ver1_l=2 00:05:14.398 03:00:16 -- scripts/common.sh@340 -- # ver2_l=1 00:05:14.398 03:00:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:14.398 03:00:16 -- scripts/common.sh@343 -- # case "$op" in 00:05:14.398 03:00:16 -- scripts/common.sh@344 -- # : 1 00:05:14.398 03:00:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:14.398 03:00:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:14.398 03:00:16 -- scripts/common.sh@364 -- # decimal 1 00:05:14.398 03:00:16 -- scripts/common.sh@352 -- # local d=1 00:05:14.398 03:00:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:14.398 03:00:16 -- scripts/common.sh@354 -- # echo 1 00:05:14.398 03:00:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:14.398 03:00:16 -- scripts/common.sh@365 -- # decimal 2 00:05:14.398 03:00:16 -- scripts/common.sh@352 -- # local d=2 00:05:14.398 03:00:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:14.398 03:00:16 -- scripts/common.sh@354 -- # echo 2 00:05:14.398 03:00:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:14.398 03:00:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:14.398 03:00:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:14.398 03:00:16 -- scripts/common.sh@367 -- # return 0 00:05:14.398 03:00:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:14.398 03:00:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:14.398 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.398 --rc genhtml_branch_coverage=1 00:05:14.398 --rc genhtml_function_coverage=1 00:05:14.398 --rc genhtml_legend=1 00:05:14.398 --rc geninfo_all_blocks=1 00:05:14.398 --rc geninfo_unexecuted_blocks=1 00:05:14.398 00:05:14.398 ' 00:05:14.398 03:00:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:14.398 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.398 --rc genhtml_branch_coverage=1 00:05:14.398 --rc genhtml_function_coverage=1 00:05:14.398 --rc genhtml_legend=1 00:05:14.398 --rc geninfo_all_blocks=1 00:05:14.398 --rc geninfo_unexecuted_blocks=1 00:05:14.398 00:05:14.398 ' 00:05:14.398 03:00:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:14.398 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.398 --rc genhtml_branch_coverage=1 00:05:14.398 --rc genhtml_function_coverage=1 00:05:14.398 --rc genhtml_legend=1 00:05:14.398 --rc geninfo_all_blocks=1 00:05:14.399 --rc geninfo_unexecuted_blocks=1 00:05:14.399 00:05:14.399 ' 00:05:14.399 03:00:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:14.399 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:14.399 --rc genhtml_branch_coverage=1 00:05:14.399 --rc genhtml_function_coverage=1 00:05:14.399 --rc genhtml_legend=1 00:05:14.399 --rc geninfo_all_blocks=1 00:05:14.399 --rc geninfo_unexecuted_blocks=1 00:05:14.399 00:05:14.399 ' 00:05:14.399 03:00:16 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:14.399 03:00:16 -- nvmf/common.sh@7 -- # uname -s 00:05:14.399 03:00:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:14.399 03:00:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:14.399 03:00:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:14.399 03:00:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:14.399 03:00:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:14.399 03:00:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:14.399 03:00:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:14.399 03:00:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:14.399 03:00:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:14.399 03:00:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:14.399 03:00:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:14.399 03:00:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:14.399 03:00:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:14.399 03:00:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:14.399 03:00:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:14.399 03:00:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:14.399 03:00:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:14.399 03:00:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:14.399 03:00:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:14.399 03:00:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:14.399 03:00:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:14.399 03:00:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:14.399 03:00:16 -- paths/export.sh@5 -- # export PATH 00:05:14.399 03:00:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:14.399 03:00:16 -- nvmf/common.sh@46 -- # : 0 00:05:14.399 03:00:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:14.399 03:00:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:14.399 03:00:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:14.399 03:00:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:14.399 03:00:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:14.399 03:00:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:14.399 03:00:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:14.399 03:00:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:14.399 03:00:16 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:14.399 03:00:16 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:14.399 03:00:16 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:14.399 03:00:16 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:14.399 03:00:16 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:14.399 03:00:16 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:14.399 03:00:16 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:14.399 03:00:16 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:14.399 03:00:16 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:14.399 03:00:16 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:14.399 03:00:16 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:14.399 03:00:16 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:14.399 03:00:16 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:14.399 03:00:16 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:14.399 03:00:16 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:14.399 INFO: JSON configuration test init 00:05:14.399 03:00:16 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:14.399 03:00:16 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:14.399 03:00:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:14.399 03:00:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.399 03:00:16 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:14.399 03:00:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:14.399 03:00:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.399 03:00:16 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:14.399 03:00:16 -- json_config/json_config.sh@98 -- # local app=target 00:05:14.399 03:00:16 -- json_config/json_config.sh@99 -- # shift 00:05:14.399 03:00:16 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:14.399 03:00:16 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:14.399 03:00:16 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:14.399 03:00:16 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:14.399 03:00:16 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:14.399 03:00:16 -- json_config/json_config.sh@111 -- # app_pid[$app]=2329473 00:05:14.399 03:00:16 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:14.399 03:00:16 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:14.399 Waiting for target to run... 00:05:14.399 03:00:16 -- json_config/json_config.sh@114 -- # waitforlisten 2329473 /var/tmp/spdk_tgt.sock 00:05:14.399 03:00:16 -- common/autotest_common.sh@829 -- # '[' -z 2329473 ']' 00:05:14.399 03:00:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:14.399 03:00:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.399 03:00:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:14.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:14.399 03:00:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.399 03:00:16 -- common/autotest_common.sh@10 -- # set +x 00:05:14.399 [2024-11-27 03:00:16.852267] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.399 [2024-11-27 03:00:16.852352] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2329473 ] 00:05:14.399 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.966 [2024-11-27 03:00:17.358791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.966 [2024-11-27 03:00:17.438420] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.966 [2024-11-27 03:00:17.438626] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.531 03:00:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.531 03:00:17 -- common/autotest_common.sh@862 -- # return 0 00:05:15.531 03:00:17 -- json_config/json_config.sh@115 -- # echo '' 00:05:15.531 00:05:15.531 03:00:17 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:15.531 03:00:17 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:15.531 03:00:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:15.531 03:00:17 -- common/autotest_common.sh@10 -- # set +x 00:05:15.531 03:00:17 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:15.531 03:00:17 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:15.531 03:00:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:15.531 03:00:17 -- common/autotest_common.sh@10 -- # set +x 00:05:15.531 03:00:17 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:15.531 03:00:17 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:15.531 03:00:17 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:18.815 03:00:21 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:18.815 03:00:21 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:18.815 03:00:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:18.815 03:00:21 -- common/autotest_common.sh@10 -- # set +x 00:05:18.815 03:00:21 -- json_config/json_config.sh@48 -- # local ret=0 00:05:18.815 03:00:21 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:18.815 03:00:21 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:18.815 03:00:21 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:18.815 03:00:21 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:18.815 03:00:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:18.815 03:00:21 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:18.815 03:00:21 -- json_config/json_config.sh@51 -- # local get_types 00:05:18.815 03:00:21 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:18.815 03:00:21 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:18.815 03:00:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:18.815 03:00:21 -- common/autotest_common.sh@10 -- # set +x 00:05:18.815 03:00:21 -- json_config/json_config.sh@58 -- # return 0 00:05:18.815 03:00:21 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:18.816 03:00:21 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:18.816 03:00:21 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:18.816 03:00:21 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:18.816 03:00:21 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:18.816 03:00:21 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:18.816 03:00:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:18.816 03:00:21 -- common/autotest_common.sh@10 -- # set +x 00:05:18.816 03:00:21 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:18.816 03:00:21 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:18.816 03:00:21 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:18.816 03:00:21 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:18.816 03:00:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:19.073 MallocForNvmf0 00:05:19.073 03:00:21 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:19.073 03:00:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:19.332 MallocForNvmf1 00:05:19.332 03:00:21 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:19.332 03:00:21 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:19.590 [2024-11-27 03:00:22.057356] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:19.590 03:00:22 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:19.590 03:00:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:19.848 03:00:22 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:19.848 03:00:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:20.107 03:00:22 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:20.107 03:00:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:20.365 03:00:22 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:20.365 03:00:22 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:20.624 [2024-11-27 03:00:23.068707] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:20.624 03:00:23 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:20.624 03:00:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:20.624 03:00:23 -- common/autotest_common.sh@10 -- # set +x 00:05:20.624 03:00:23 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:20.624 03:00:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:20.624 03:00:23 -- common/autotest_common.sh@10 -- # set +x 00:05:20.624 03:00:23 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:20.624 03:00:23 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:20.624 03:00:23 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:20.882 MallocBdevForConfigChangeCheck 00:05:20.882 03:00:23 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:20.882 03:00:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:20.882 03:00:23 -- common/autotest_common.sh@10 -- # set +x 00:05:20.882 03:00:23 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:20.882 03:00:23 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:21.448 03:00:23 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:21.448 INFO: shutting down applications... 00:05:21.448 03:00:23 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:21.449 03:00:23 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:21.449 03:00:23 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:21.449 03:00:23 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:23.348 Calling clear_iscsi_subsystem 00:05:23.348 Calling clear_nvmf_subsystem 00:05:23.348 Calling clear_nbd_subsystem 00:05:23.348 Calling clear_ublk_subsystem 00:05:23.348 Calling clear_vhost_blk_subsystem 00:05:23.348 Calling clear_vhost_scsi_subsystem 00:05:23.348 Calling clear_scheduler_subsystem 00:05:23.348 Calling clear_bdev_subsystem 00:05:23.348 Calling clear_accel_subsystem 00:05:23.348 Calling clear_vmd_subsystem 00:05:23.348 Calling clear_sock_subsystem 00:05:23.348 Calling clear_iobuf_subsystem 00:05:23.349 03:00:25 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:23.349 03:00:25 -- json_config/json_config.sh@396 -- # count=100 00:05:23.349 03:00:25 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:23.349 03:00:25 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:23.349 03:00:25 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:23.349 03:00:25 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:23.349 03:00:25 -- json_config/json_config.sh@398 -- # break 00:05:23.349 03:00:25 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:23.349 03:00:25 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:23.349 03:00:25 -- json_config/json_config.sh@120 -- # local app=target 00:05:23.349 03:00:25 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:23.349 03:00:25 -- json_config/json_config.sh@124 -- # [[ -n 2329473 ]] 00:05:23.349 03:00:25 -- json_config/json_config.sh@127 -- # kill -SIGINT 2329473 00:05:23.349 03:00:25 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:23.349 03:00:25 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:23.349 03:00:25 -- json_config/json_config.sh@130 -- # kill -0 2329473 00:05:23.349 03:00:25 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:23.917 03:00:26 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:23.917 03:00:26 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:23.917 03:00:26 -- json_config/json_config.sh@130 -- # kill -0 2329473 00:05:23.917 03:00:26 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:23.917 03:00:26 -- json_config/json_config.sh@132 -- # break 00:05:23.917 03:00:26 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:23.917 03:00:26 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:23.917 SPDK target shutdown done 00:05:23.917 03:00:26 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:23.918 INFO: relaunching applications... 00:05:23.918 03:00:26 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:23.918 03:00:26 -- json_config/json_config.sh@98 -- # local app=target 00:05:23.918 03:00:26 -- json_config/json_config.sh@99 -- # shift 00:05:23.918 03:00:26 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:23.918 03:00:26 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:23.918 03:00:26 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:23.918 03:00:26 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:23.918 03:00:26 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:23.918 03:00:26 -- json_config/json_config.sh@111 -- # app_pid[$app]=2330823 00:05:23.918 03:00:26 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:23.918 03:00:26 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:23.918 Waiting for target to run... 00:05:23.918 03:00:26 -- json_config/json_config.sh@114 -- # waitforlisten 2330823 /var/tmp/spdk_tgt.sock 00:05:23.918 03:00:26 -- common/autotest_common.sh@829 -- # '[' -z 2330823 ']' 00:05:23.918 03:00:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:23.918 03:00:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:23.918 03:00:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:23.918 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:23.918 03:00:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:23.918 03:00:26 -- common/autotest_common.sh@10 -- # set +x 00:05:23.918 [2024-11-27 03:00:26.400802] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:23.918 [2024-11-27 03:00:26.400904] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2330823 ] 00:05:23.918 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.487 [2024-11-27 03:00:26.936998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:24.487 [2024-11-27 03:00:27.012708] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:24.487 [2024-11-27 03:00:27.012873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.774 [2024-11-27 03:00:30.041502] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:27.774 [2024-11-27 03:00:30.073990] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:27.774 03:00:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:27.774 03:00:30 -- common/autotest_common.sh@862 -- # return 0 00:05:27.774 03:00:30 -- json_config/json_config.sh@115 -- # echo '' 00:05:27.774 00:05:27.774 03:00:30 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:27.774 03:00:30 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:27.774 INFO: Checking if target configuration is the same... 00:05:27.774 03:00:30 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:27.774 03:00:30 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:27.774 03:00:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:27.774 + '[' 2 -ne 2 ']' 00:05:27.774 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:27.774 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:27.774 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:27.774 +++ basename /dev/fd/62 00:05:27.774 ++ mktemp /tmp/62.XXX 00:05:27.774 + tmp_file_1=/tmp/62.4nQ 00:05:27.774 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:27.774 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:27.774 + tmp_file_2=/tmp/spdk_tgt_config.json.6La 00:05:27.774 + ret=0 00:05:27.774 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:28.339 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:28.339 + diff -u /tmp/62.4nQ /tmp/spdk_tgt_config.json.6La 00:05:28.340 + echo 'INFO: JSON config files are the same' 00:05:28.340 INFO: JSON config files are the same 00:05:28.340 + rm /tmp/62.4nQ /tmp/spdk_tgt_config.json.6La 00:05:28.340 + exit 0 00:05:28.340 03:00:30 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:28.340 03:00:30 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:28.340 INFO: changing configuration and checking if this can be detected... 00:05:28.340 03:00:30 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:28.340 03:00:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:28.598 03:00:31 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:28.598 03:00:31 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:28.598 03:00:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:28.598 + '[' 2 -ne 2 ']' 00:05:28.598 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:28.598 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:28.598 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:28.598 +++ basename /dev/fd/62 00:05:28.598 ++ mktemp /tmp/62.XXX 00:05:28.598 + tmp_file_1=/tmp/62.8m0 00:05:28.598 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:28.598 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:28.598 + tmp_file_2=/tmp/spdk_tgt_config.json.kAJ 00:05:28.598 + ret=0 00:05:28.598 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:28.856 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:28.856 + diff -u /tmp/62.8m0 /tmp/spdk_tgt_config.json.kAJ 00:05:28.856 + ret=1 00:05:28.856 + echo '=== Start of file: /tmp/62.8m0 ===' 00:05:28.856 + cat /tmp/62.8m0 00:05:28.856 + echo '=== End of file: /tmp/62.8m0 ===' 00:05:28.856 + echo '' 00:05:28.856 + echo '=== Start of file: /tmp/spdk_tgt_config.json.kAJ ===' 00:05:28.856 + cat /tmp/spdk_tgt_config.json.kAJ 00:05:28.856 + echo '=== End of file: /tmp/spdk_tgt_config.json.kAJ ===' 00:05:28.856 + echo '' 00:05:28.856 + rm /tmp/62.8m0 /tmp/spdk_tgt_config.json.kAJ 00:05:28.856 + exit 1 00:05:28.856 03:00:31 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:28.856 INFO: configuration change detected. 00:05:28.856 03:00:31 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:28.856 03:00:31 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:28.856 03:00:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:28.856 03:00:31 -- common/autotest_common.sh@10 -- # set +x 00:05:28.856 03:00:31 -- json_config/json_config.sh@360 -- # local ret=0 00:05:28.856 03:00:31 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:28.856 03:00:31 -- json_config/json_config.sh@370 -- # [[ -n 2330823 ]] 00:05:28.856 03:00:31 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:28.856 03:00:31 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:28.856 03:00:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:28.856 03:00:31 -- common/autotest_common.sh@10 -- # set +x 00:05:28.856 03:00:31 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:28.856 03:00:31 -- json_config/json_config.sh@246 -- # uname -s 00:05:29.114 03:00:31 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:29.114 03:00:31 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:29.114 03:00:31 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:29.114 03:00:31 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:29.114 03:00:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:29.114 03:00:31 -- common/autotest_common.sh@10 -- # set +x 00:05:29.114 03:00:31 -- json_config/json_config.sh@376 -- # killprocess 2330823 00:05:29.114 03:00:31 -- common/autotest_common.sh@936 -- # '[' -z 2330823 ']' 00:05:29.114 03:00:31 -- common/autotest_common.sh@940 -- # kill -0 2330823 00:05:29.114 03:00:31 -- common/autotest_common.sh@941 -- # uname 00:05:29.114 03:00:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:29.114 03:00:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2330823 00:05:29.114 03:00:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:29.114 03:00:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:29.114 03:00:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2330823' 00:05:29.114 killing process with pid 2330823 00:05:29.114 03:00:31 -- common/autotest_common.sh@955 -- # kill 2330823 00:05:29.114 03:00:31 -- common/autotest_common.sh@960 -- # wait 2330823 00:05:31.042 03:00:33 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:31.042 03:00:33 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:31.042 03:00:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:31.042 03:00:33 -- common/autotest_common.sh@10 -- # set +x 00:05:31.042 03:00:33 -- json_config/json_config.sh@381 -- # return 0 00:05:31.042 03:00:33 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:31.042 INFO: Success 00:05:31.042 00:05:31.042 real 0m16.557s 00:05:31.042 user 0m18.908s 00:05:31.042 sys 0m2.325s 00:05:31.042 03:00:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.042 03:00:33 -- common/autotest_common.sh@10 -- # set +x 00:05:31.042 ************************************ 00:05:31.042 END TEST json_config 00:05:31.042 ************************************ 00:05:31.042 03:00:33 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:31.042 03:00:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:31.042 03:00:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.042 03:00:33 -- common/autotest_common.sh@10 -- # set +x 00:05:31.042 ************************************ 00:05:31.042 START TEST json_config_extra_key 00:05:31.042 ************************************ 00:05:31.042 03:00:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:31.042 03:00:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:31.042 03:00:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:31.042 03:00:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:31.042 03:00:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:31.042 03:00:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:31.042 03:00:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:31.042 03:00:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:31.042 03:00:33 -- scripts/common.sh@335 -- # IFS=.-: 00:05:31.042 03:00:33 -- scripts/common.sh@335 -- # read -ra ver1 00:05:31.042 03:00:33 -- scripts/common.sh@336 -- # IFS=.-: 00:05:31.042 03:00:33 -- scripts/common.sh@336 -- # read -ra ver2 00:05:31.042 03:00:33 -- scripts/common.sh@337 -- # local 'op=<' 00:05:31.042 03:00:33 -- scripts/common.sh@339 -- # ver1_l=2 00:05:31.042 03:00:33 -- scripts/common.sh@340 -- # ver2_l=1 00:05:31.042 03:00:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:31.042 03:00:33 -- scripts/common.sh@343 -- # case "$op" in 00:05:31.042 03:00:33 -- scripts/common.sh@344 -- # : 1 00:05:31.042 03:00:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:31.042 03:00:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:31.042 03:00:33 -- scripts/common.sh@364 -- # decimal 1 00:05:31.042 03:00:33 -- scripts/common.sh@352 -- # local d=1 00:05:31.042 03:00:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:31.042 03:00:33 -- scripts/common.sh@354 -- # echo 1 00:05:31.042 03:00:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:31.042 03:00:33 -- scripts/common.sh@365 -- # decimal 2 00:05:31.042 03:00:33 -- scripts/common.sh@352 -- # local d=2 00:05:31.042 03:00:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:31.042 03:00:33 -- scripts/common.sh@354 -- # echo 2 00:05:31.042 03:00:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:31.042 03:00:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:31.042 03:00:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:31.042 03:00:33 -- scripts/common.sh@367 -- # return 0 00:05:31.042 03:00:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:31.042 03:00:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:31.042 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.042 --rc genhtml_branch_coverage=1 00:05:31.042 --rc genhtml_function_coverage=1 00:05:31.042 --rc genhtml_legend=1 00:05:31.042 --rc geninfo_all_blocks=1 00:05:31.042 --rc geninfo_unexecuted_blocks=1 00:05:31.042 00:05:31.042 ' 00:05:31.042 03:00:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:31.042 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.042 --rc genhtml_branch_coverage=1 00:05:31.042 --rc genhtml_function_coverage=1 00:05:31.042 --rc genhtml_legend=1 00:05:31.042 --rc geninfo_all_blocks=1 00:05:31.042 --rc geninfo_unexecuted_blocks=1 00:05:31.042 00:05:31.042 ' 00:05:31.042 03:00:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:31.042 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.042 --rc genhtml_branch_coverage=1 00:05:31.042 --rc genhtml_function_coverage=1 00:05:31.042 --rc genhtml_legend=1 00:05:31.042 --rc geninfo_all_blocks=1 00:05:31.042 --rc geninfo_unexecuted_blocks=1 00:05:31.042 00:05:31.042 ' 00:05:31.042 03:00:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:31.042 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:31.042 --rc genhtml_branch_coverage=1 00:05:31.042 --rc genhtml_function_coverage=1 00:05:31.042 --rc genhtml_legend=1 00:05:31.042 --rc geninfo_all_blocks=1 00:05:31.042 --rc geninfo_unexecuted_blocks=1 00:05:31.042 00:05:31.042 ' 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:31.042 03:00:33 -- nvmf/common.sh@7 -- # uname -s 00:05:31.042 03:00:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:31.042 03:00:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:31.042 03:00:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:31.042 03:00:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:31.042 03:00:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:31.042 03:00:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:31.042 03:00:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:31.042 03:00:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:31.042 03:00:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:31.042 03:00:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:31.042 03:00:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:31.042 03:00:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:31.042 03:00:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:31.042 03:00:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:31.042 03:00:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:31.042 03:00:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:31.042 03:00:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:31.042 03:00:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:31.042 03:00:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:31.042 03:00:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.042 03:00:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.042 03:00:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.042 03:00:33 -- paths/export.sh@5 -- # export PATH 00:05:31.042 03:00:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:31.042 03:00:33 -- nvmf/common.sh@46 -- # : 0 00:05:31.042 03:00:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:31.042 03:00:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:31.042 03:00:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:31.042 03:00:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:31.042 03:00:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:31.042 03:00:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:31.042 03:00:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:31.042 03:00:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:31.042 INFO: launching applications... 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2331775 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:31.042 Waiting for target to run... 00:05:31.042 03:00:33 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2331775 /var/tmp/spdk_tgt.sock 00:05:31.042 03:00:33 -- common/autotest_common.sh@829 -- # '[' -z 2331775 ']' 00:05:31.042 03:00:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:31.042 03:00:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:31.042 03:00:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:31.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:31.043 03:00:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:31.043 03:00:33 -- common/autotest_common.sh@10 -- # set +x 00:05:31.043 [2024-11-27 03:00:33.438603] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.043 [2024-11-27 03:00:33.438691] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2331775 ] 00:05:31.043 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.608 [2024-11-27 03:00:33.935693] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.608 [2024-11-27 03:00:34.015356] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:31.608 [2024-11-27 03:00:34.015573] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.866 03:00:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:31.866 03:00:34 -- common/autotest_common.sh@862 -- # return 0 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:31.866 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:31.866 INFO: shutting down applications... 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2331775 ]] 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2331775 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2331775 00:05:31.866 03:00:34 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:32.432 03:00:34 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:32.432 03:00:34 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:32.432 03:00:34 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2331775 00:05:32.432 03:00:34 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:32.432 03:00:34 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:32.432 03:00:34 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:32.432 03:00:34 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:32.432 SPDK target shutdown done 00:05:32.432 03:00:34 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:32.432 Success 00:05:32.432 00:05:32.432 real 0m1.646s 00:05:32.432 user 0m1.445s 00:05:32.432 sys 0m0.612s 00:05:32.432 03:00:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.432 03:00:34 -- common/autotest_common.sh@10 -- # set +x 00:05:32.432 ************************************ 00:05:32.432 END TEST json_config_extra_key 00:05:32.432 ************************************ 00:05:32.432 03:00:34 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:32.432 03:00:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.432 03:00:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.432 03:00:34 -- common/autotest_common.sh@10 -- # set +x 00:05:32.432 ************************************ 00:05:32.432 START TEST alias_rpc 00:05:32.432 ************************************ 00:05:32.432 03:00:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:32.432 * Looking for test storage... 00:05:32.432 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:32.432 03:00:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:32.432 03:00:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:32.432 03:00:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:32.432 03:00:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:32.432 03:00:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:32.432 03:00:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:32.432 03:00:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:32.432 03:00:35 -- scripts/common.sh@335 -- # IFS=.-: 00:05:32.432 03:00:35 -- scripts/common.sh@335 -- # read -ra ver1 00:05:32.432 03:00:35 -- scripts/common.sh@336 -- # IFS=.-: 00:05:32.432 03:00:35 -- scripts/common.sh@336 -- # read -ra ver2 00:05:32.432 03:00:35 -- scripts/common.sh@337 -- # local 'op=<' 00:05:32.432 03:00:35 -- scripts/common.sh@339 -- # ver1_l=2 00:05:32.432 03:00:35 -- scripts/common.sh@340 -- # ver2_l=1 00:05:32.432 03:00:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:32.432 03:00:35 -- scripts/common.sh@343 -- # case "$op" in 00:05:32.432 03:00:35 -- scripts/common.sh@344 -- # : 1 00:05:32.432 03:00:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:32.432 03:00:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:32.432 03:00:35 -- scripts/common.sh@364 -- # decimal 1 00:05:32.432 03:00:35 -- scripts/common.sh@352 -- # local d=1 00:05:32.432 03:00:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:32.432 03:00:35 -- scripts/common.sh@354 -- # echo 1 00:05:32.432 03:00:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:32.432 03:00:35 -- scripts/common.sh@365 -- # decimal 2 00:05:32.690 03:00:35 -- scripts/common.sh@352 -- # local d=2 00:05:32.690 03:00:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:32.690 03:00:35 -- scripts/common.sh@354 -- # echo 2 00:05:32.690 03:00:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:32.690 03:00:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:32.690 03:00:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:32.690 03:00:35 -- scripts/common.sh@367 -- # return 0 00:05:32.690 03:00:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:32.690 03:00:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:32.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.690 --rc genhtml_branch_coverage=1 00:05:32.691 --rc genhtml_function_coverage=1 00:05:32.691 --rc genhtml_legend=1 00:05:32.691 --rc geninfo_all_blocks=1 00:05:32.691 --rc geninfo_unexecuted_blocks=1 00:05:32.691 00:05:32.691 ' 00:05:32.691 03:00:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:32.691 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.691 --rc genhtml_branch_coverage=1 00:05:32.691 --rc genhtml_function_coverage=1 00:05:32.691 --rc genhtml_legend=1 00:05:32.691 --rc geninfo_all_blocks=1 00:05:32.691 --rc geninfo_unexecuted_blocks=1 00:05:32.691 00:05:32.691 ' 00:05:32.691 03:00:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:32.691 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.691 --rc genhtml_branch_coverage=1 00:05:32.691 --rc genhtml_function_coverage=1 00:05:32.691 --rc genhtml_legend=1 00:05:32.691 --rc geninfo_all_blocks=1 00:05:32.691 --rc geninfo_unexecuted_blocks=1 00:05:32.691 00:05:32.691 ' 00:05:32.691 03:00:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:32.691 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:32.691 --rc genhtml_branch_coverage=1 00:05:32.691 --rc genhtml_function_coverage=1 00:05:32.691 --rc genhtml_legend=1 00:05:32.691 --rc geninfo_all_blocks=1 00:05:32.691 --rc geninfo_unexecuted_blocks=1 00:05:32.691 00:05:32.691 ' 00:05:32.691 03:00:35 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:32.691 03:00:35 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2332094 00:05:32.691 03:00:35 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:32.691 03:00:35 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2332094 00:05:32.691 03:00:35 -- common/autotest_common.sh@829 -- # '[' -z 2332094 ']' 00:05:32.691 03:00:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:32.691 03:00:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:32.691 03:00:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:32.691 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:32.691 03:00:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:32.691 03:00:35 -- common/autotest_common.sh@10 -- # set +x 00:05:32.691 [2024-11-27 03:00:35.102749] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.691 [2024-11-27 03:00:35.102844] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2332094 ] 00:05:32.691 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.691 [2024-11-27 03:00:35.161121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:32.691 [2024-11-27 03:00:35.247541] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:32.691 [2024-11-27 03:00:35.247716] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.624 03:00:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:33.624 03:00:36 -- common/autotest_common.sh@862 -- # return 0 00:05:33.624 03:00:36 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:33.881 03:00:36 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2332094 00:05:33.881 03:00:36 -- common/autotest_common.sh@936 -- # '[' -z 2332094 ']' 00:05:33.881 03:00:36 -- common/autotest_common.sh@940 -- # kill -0 2332094 00:05:33.881 03:00:36 -- common/autotest_common.sh@941 -- # uname 00:05:33.881 03:00:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:33.881 03:00:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332094 00:05:33.881 03:00:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:33.881 03:00:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:33.881 03:00:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332094' 00:05:33.881 killing process with pid 2332094 00:05:33.881 03:00:36 -- common/autotest_common.sh@955 -- # kill 2332094 00:05:33.881 03:00:36 -- common/autotest_common.sh@960 -- # wait 2332094 00:05:34.447 00:05:34.447 real 0m1.875s 00:05:34.447 user 0m2.163s 00:05:34.447 sys 0m0.488s 00:05:34.447 03:00:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.447 03:00:36 -- common/autotest_common.sh@10 -- # set +x 00:05:34.447 ************************************ 00:05:34.447 END TEST alias_rpc 00:05:34.447 ************************************ 00:05:34.447 03:00:36 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:34.447 03:00:36 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:34.447 03:00:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.447 03:00:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.447 03:00:36 -- common/autotest_common.sh@10 -- # set +x 00:05:34.447 ************************************ 00:05:34.447 START TEST spdkcli_tcp 00:05:34.447 ************************************ 00:05:34.447 03:00:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:34.447 * Looking for test storage... 00:05:34.447 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:34.447 03:00:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:34.447 03:00:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:34.447 03:00:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:34.447 03:00:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:34.447 03:00:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:34.447 03:00:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:34.447 03:00:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:34.447 03:00:36 -- scripts/common.sh@335 -- # IFS=.-: 00:05:34.447 03:00:36 -- scripts/common.sh@335 -- # read -ra ver1 00:05:34.447 03:00:36 -- scripts/common.sh@336 -- # IFS=.-: 00:05:34.447 03:00:36 -- scripts/common.sh@336 -- # read -ra ver2 00:05:34.447 03:00:36 -- scripts/common.sh@337 -- # local 'op=<' 00:05:34.447 03:00:36 -- scripts/common.sh@339 -- # ver1_l=2 00:05:34.447 03:00:36 -- scripts/common.sh@340 -- # ver2_l=1 00:05:34.447 03:00:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:34.447 03:00:36 -- scripts/common.sh@343 -- # case "$op" in 00:05:34.447 03:00:36 -- scripts/common.sh@344 -- # : 1 00:05:34.447 03:00:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:34.447 03:00:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:34.447 03:00:36 -- scripts/common.sh@364 -- # decimal 1 00:05:34.447 03:00:36 -- scripts/common.sh@352 -- # local d=1 00:05:34.447 03:00:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:34.447 03:00:36 -- scripts/common.sh@354 -- # echo 1 00:05:34.447 03:00:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:34.447 03:00:36 -- scripts/common.sh@365 -- # decimal 2 00:05:34.447 03:00:36 -- scripts/common.sh@352 -- # local d=2 00:05:34.447 03:00:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:34.447 03:00:36 -- scripts/common.sh@354 -- # echo 2 00:05:34.447 03:00:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:34.447 03:00:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:34.447 03:00:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:34.447 03:00:36 -- scripts/common.sh@367 -- # return 0 00:05:34.447 03:00:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:34.447 03:00:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:34.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.447 --rc genhtml_branch_coverage=1 00:05:34.447 --rc genhtml_function_coverage=1 00:05:34.447 --rc genhtml_legend=1 00:05:34.447 --rc geninfo_all_blocks=1 00:05:34.447 --rc geninfo_unexecuted_blocks=1 00:05:34.447 00:05:34.447 ' 00:05:34.447 03:00:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:34.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.447 --rc genhtml_branch_coverage=1 00:05:34.447 --rc genhtml_function_coverage=1 00:05:34.447 --rc genhtml_legend=1 00:05:34.447 --rc geninfo_all_blocks=1 00:05:34.447 --rc geninfo_unexecuted_blocks=1 00:05:34.447 00:05:34.447 ' 00:05:34.447 03:00:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:34.447 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.447 --rc genhtml_branch_coverage=1 00:05:34.447 --rc genhtml_function_coverage=1 00:05:34.447 --rc genhtml_legend=1 00:05:34.447 --rc geninfo_all_blocks=1 00:05:34.448 --rc geninfo_unexecuted_blocks=1 00:05:34.448 00:05:34.448 ' 00:05:34.448 03:00:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:34.448 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:34.448 --rc genhtml_branch_coverage=1 00:05:34.448 --rc genhtml_function_coverage=1 00:05:34.448 --rc genhtml_legend=1 00:05:34.448 --rc geninfo_all_blocks=1 00:05:34.448 --rc geninfo_unexecuted_blocks=1 00:05:34.448 00:05:34.448 ' 00:05:34.448 03:00:36 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:34.448 03:00:36 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:34.448 03:00:36 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:34.448 03:00:36 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:34.448 03:00:36 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:34.448 03:00:36 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:34.448 03:00:36 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:34.448 03:00:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:34.448 03:00:36 -- common/autotest_common.sh@10 -- # set +x 00:05:34.448 03:00:36 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2332299 00:05:34.448 03:00:36 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:34.448 03:00:36 -- spdkcli/tcp.sh@27 -- # waitforlisten 2332299 00:05:34.448 03:00:36 -- common/autotest_common.sh@829 -- # '[' -z 2332299 ']' 00:05:34.448 03:00:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.448 03:00:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:34.448 03:00:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.448 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.448 03:00:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:34.448 03:00:36 -- common/autotest_common.sh@10 -- # set +x 00:05:34.448 [2024-11-27 03:00:37.009086] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:34.448 [2024-11-27 03:00:37.009172] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2332299 ] 00:05:34.448 EAL: No free 2048 kB hugepages reported on node 1 00:05:34.706 [2024-11-27 03:00:37.070592] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:34.706 [2024-11-27 03:00:37.165983] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:34.706 [2024-11-27 03:00:37.166194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:34.706 [2024-11-27 03:00:37.166200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.640 03:00:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:35.640 03:00:37 -- common/autotest_common.sh@862 -- # return 0 00:05:35.640 03:00:37 -- spdkcli/tcp.sh@31 -- # socat_pid=2332440 00:05:35.640 03:00:37 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:35.640 03:00:37 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:35.640 [ 00:05:35.640 "bdev_malloc_delete", 00:05:35.640 "bdev_malloc_create", 00:05:35.640 "bdev_null_resize", 00:05:35.640 "bdev_null_delete", 00:05:35.640 "bdev_null_create", 00:05:35.640 "bdev_nvme_cuse_unregister", 00:05:35.640 "bdev_nvme_cuse_register", 00:05:35.640 "bdev_opal_new_user", 00:05:35.640 "bdev_opal_set_lock_state", 00:05:35.640 "bdev_opal_delete", 00:05:35.640 "bdev_opal_get_info", 00:05:35.640 "bdev_opal_create", 00:05:35.640 "bdev_nvme_opal_revert", 00:05:35.640 "bdev_nvme_opal_init", 00:05:35.640 "bdev_nvme_send_cmd", 00:05:35.640 "bdev_nvme_get_path_iostat", 00:05:35.640 "bdev_nvme_get_mdns_discovery_info", 00:05:35.640 "bdev_nvme_stop_mdns_discovery", 00:05:35.640 "bdev_nvme_start_mdns_discovery", 00:05:35.640 "bdev_nvme_set_multipath_policy", 00:05:35.640 "bdev_nvme_set_preferred_path", 00:05:35.640 "bdev_nvme_get_io_paths", 00:05:35.640 "bdev_nvme_remove_error_injection", 00:05:35.640 "bdev_nvme_add_error_injection", 00:05:35.640 "bdev_nvme_get_discovery_info", 00:05:35.640 "bdev_nvme_stop_discovery", 00:05:35.640 "bdev_nvme_start_discovery", 00:05:35.640 "bdev_nvme_get_controller_health_info", 00:05:35.640 "bdev_nvme_disable_controller", 00:05:35.640 "bdev_nvme_enable_controller", 00:05:35.640 "bdev_nvme_reset_controller", 00:05:35.640 "bdev_nvme_get_transport_statistics", 00:05:35.640 "bdev_nvme_apply_firmware", 00:05:35.640 "bdev_nvme_detach_controller", 00:05:35.640 "bdev_nvme_get_controllers", 00:05:35.640 "bdev_nvme_attach_controller", 00:05:35.640 "bdev_nvme_set_hotplug", 00:05:35.640 "bdev_nvme_set_options", 00:05:35.640 "bdev_passthru_delete", 00:05:35.640 "bdev_passthru_create", 00:05:35.640 "bdev_lvol_grow_lvstore", 00:05:35.640 "bdev_lvol_get_lvols", 00:05:35.640 "bdev_lvol_get_lvstores", 00:05:35.640 "bdev_lvol_delete", 00:05:35.640 "bdev_lvol_set_read_only", 00:05:35.640 "bdev_lvol_resize", 00:05:35.640 "bdev_lvol_decouple_parent", 00:05:35.640 "bdev_lvol_inflate", 00:05:35.640 "bdev_lvol_rename", 00:05:35.640 "bdev_lvol_clone_bdev", 00:05:35.640 "bdev_lvol_clone", 00:05:35.640 "bdev_lvol_snapshot", 00:05:35.640 "bdev_lvol_create", 00:05:35.640 "bdev_lvol_delete_lvstore", 00:05:35.640 "bdev_lvol_rename_lvstore", 00:05:35.640 "bdev_lvol_create_lvstore", 00:05:35.640 "bdev_raid_set_options", 00:05:35.640 "bdev_raid_remove_base_bdev", 00:05:35.640 "bdev_raid_add_base_bdev", 00:05:35.640 "bdev_raid_delete", 00:05:35.640 "bdev_raid_create", 00:05:35.640 "bdev_raid_get_bdevs", 00:05:35.640 "bdev_error_inject_error", 00:05:35.640 "bdev_error_delete", 00:05:35.640 "bdev_error_create", 00:05:35.640 "bdev_split_delete", 00:05:35.640 "bdev_split_create", 00:05:35.640 "bdev_delay_delete", 00:05:35.640 "bdev_delay_create", 00:05:35.640 "bdev_delay_update_latency", 00:05:35.640 "bdev_zone_block_delete", 00:05:35.640 "bdev_zone_block_create", 00:05:35.640 "blobfs_create", 00:05:35.640 "blobfs_detect", 00:05:35.640 "blobfs_set_cache_size", 00:05:35.640 "bdev_aio_delete", 00:05:35.640 "bdev_aio_rescan", 00:05:35.640 "bdev_aio_create", 00:05:35.640 "bdev_ftl_set_property", 00:05:35.640 "bdev_ftl_get_properties", 00:05:35.640 "bdev_ftl_get_stats", 00:05:35.640 "bdev_ftl_unmap", 00:05:35.640 "bdev_ftl_unload", 00:05:35.640 "bdev_ftl_delete", 00:05:35.640 "bdev_ftl_load", 00:05:35.640 "bdev_ftl_create", 00:05:35.640 "bdev_virtio_attach_controller", 00:05:35.640 "bdev_virtio_scsi_get_devices", 00:05:35.640 "bdev_virtio_detach_controller", 00:05:35.640 "bdev_virtio_blk_set_hotplug", 00:05:35.640 "bdev_iscsi_delete", 00:05:35.640 "bdev_iscsi_create", 00:05:35.640 "bdev_iscsi_set_options", 00:05:35.640 "accel_error_inject_error", 00:05:35.640 "ioat_scan_accel_module", 00:05:35.640 "dsa_scan_accel_module", 00:05:35.640 "iaa_scan_accel_module", 00:05:35.640 "vfu_virtio_create_scsi_endpoint", 00:05:35.640 "vfu_virtio_scsi_remove_target", 00:05:35.640 "vfu_virtio_scsi_add_target", 00:05:35.640 "vfu_virtio_create_blk_endpoint", 00:05:35.640 "vfu_virtio_delete_endpoint", 00:05:35.640 "iscsi_set_options", 00:05:35.640 "iscsi_get_auth_groups", 00:05:35.640 "iscsi_auth_group_remove_secret", 00:05:35.640 "iscsi_auth_group_add_secret", 00:05:35.640 "iscsi_delete_auth_group", 00:05:35.640 "iscsi_create_auth_group", 00:05:35.641 "iscsi_set_discovery_auth", 00:05:35.641 "iscsi_get_options", 00:05:35.641 "iscsi_target_node_request_logout", 00:05:35.641 "iscsi_target_node_set_redirect", 00:05:35.641 "iscsi_target_node_set_auth", 00:05:35.641 "iscsi_target_node_add_lun", 00:05:35.641 "iscsi_get_connections", 00:05:35.641 "iscsi_portal_group_set_auth", 00:05:35.641 "iscsi_start_portal_group", 00:05:35.641 "iscsi_delete_portal_group", 00:05:35.641 "iscsi_create_portal_group", 00:05:35.641 "iscsi_get_portal_groups", 00:05:35.641 "iscsi_delete_target_node", 00:05:35.641 "iscsi_target_node_remove_pg_ig_maps", 00:05:35.641 "iscsi_target_node_add_pg_ig_maps", 00:05:35.641 "iscsi_create_target_node", 00:05:35.641 "iscsi_get_target_nodes", 00:05:35.641 "iscsi_delete_initiator_group", 00:05:35.641 "iscsi_initiator_group_remove_initiators", 00:05:35.641 "iscsi_initiator_group_add_initiators", 00:05:35.641 "iscsi_create_initiator_group", 00:05:35.641 "iscsi_get_initiator_groups", 00:05:35.641 "nvmf_set_crdt", 00:05:35.641 "nvmf_set_config", 00:05:35.641 "nvmf_set_max_subsystems", 00:05:35.641 "nvmf_subsystem_get_listeners", 00:05:35.641 "nvmf_subsystem_get_qpairs", 00:05:35.641 "nvmf_subsystem_get_controllers", 00:05:35.641 "nvmf_get_stats", 00:05:35.641 "nvmf_get_transports", 00:05:35.641 "nvmf_create_transport", 00:05:35.641 "nvmf_get_targets", 00:05:35.641 "nvmf_delete_target", 00:05:35.641 "nvmf_create_target", 00:05:35.641 "nvmf_subsystem_allow_any_host", 00:05:35.641 "nvmf_subsystem_remove_host", 00:05:35.641 "nvmf_subsystem_add_host", 00:05:35.641 "nvmf_subsystem_remove_ns", 00:05:35.641 "nvmf_subsystem_add_ns", 00:05:35.641 "nvmf_subsystem_listener_set_ana_state", 00:05:35.641 "nvmf_discovery_get_referrals", 00:05:35.641 "nvmf_discovery_remove_referral", 00:05:35.641 "nvmf_discovery_add_referral", 00:05:35.641 "nvmf_subsystem_remove_listener", 00:05:35.641 "nvmf_subsystem_add_listener", 00:05:35.641 "nvmf_delete_subsystem", 00:05:35.641 "nvmf_create_subsystem", 00:05:35.641 "nvmf_get_subsystems", 00:05:35.641 "env_dpdk_get_mem_stats", 00:05:35.641 "nbd_get_disks", 00:05:35.641 "nbd_stop_disk", 00:05:35.641 "nbd_start_disk", 00:05:35.641 "ublk_recover_disk", 00:05:35.641 "ublk_get_disks", 00:05:35.641 "ublk_stop_disk", 00:05:35.641 "ublk_start_disk", 00:05:35.641 "ublk_destroy_target", 00:05:35.641 "ublk_create_target", 00:05:35.641 "virtio_blk_create_transport", 00:05:35.641 "virtio_blk_get_transports", 00:05:35.641 "vhost_controller_set_coalescing", 00:05:35.641 "vhost_get_controllers", 00:05:35.641 "vhost_delete_controller", 00:05:35.641 "vhost_create_blk_controller", 00:05:35.641 "vhost_scsi_controller_remove_target", 00:05:35.641 "vhost_scsi_controller_add_target", 00:05:35.641 "vhost_start_scsi_controller", 00:05:35.641 "vhost_create_scsi_controller", 00:05:35.641 "thread_set_cpumask", 00:05:35.641 "framework_get_scheduler", 00:05:35.641 "framework_set_scheduler", 00:05:35.641 "framework_get_reactors", 00:05:35.641 "thread_get_io_channels", 00:05:35.641 "thread_get_pollers", 00:05:35.641 "thread_get_stats", 00:05:35.641 "framework_monitor_context_switch", 00:05:35.641 "spdk_kill_instance", 00:05:35.641 "log_enable_timestamps", 00:05:35.641 "log_get_flags", 00:05:35.641 "log_clear_flag", 00:05:35.641 "log_set_flag", 00:05:35.641 "log_get_level", 00:05:35.641 "log_set_level", 00:05:35.641 "log_get_print_level", 00:05:35.641 "log_set_print_level", 00:05:35.641 "framework_enable_cpumask_locks", 00:05:35.641 "framework_disable_cpumask_locks", 00:05:35.641 "framework_wait_init", 00:05:35.641 "framework_start_init", 00:05:35.641 "scsi_get_devices", 00:05:35.641 "bdev_get_histogram", 00:05:35.641 "bdev_enable_histogram", 00:05:35.641 "bdev_set_qos_limit", 00:05:35.641 "bdev_set_qd_sampling_period", 00:05:35.641 "bdev_get_bdevs", 00:05:35.641 "bdev_reset_iostat", 00:05:35.641 "bdev_get_iostat", 00:05:35.641 "bdev_examine", 00:05:35.641 "bdev_wait_for_examine", 00:05:35.641 "bdev_set_options", 00:05:35.641 "notify_get_notifications", 00:05:35.641 "notify_get_types", 00:05:35.641 "accel_get_stats", 00:05:35.641 "accel_set_options", 00:05:35.641 "accel_set_driver", 00:05:35.641 "accel_crypto_key_destroy", 00:05:35.641 "accel_crypto_keys_get", 00:05:35.641 "accel_crypto_key_create", 00:05:35.641 "accel_assign_opc", 00:05:35.641 "accel_get_module_info", 00:05:35.641 "accel_get_opc_assignments", 00:05:35.641 "vmd_rescan", 00:05:35.641 "vmd_remove_device", 00:05:35.641 "vmd_enable", 00:05:35.641 "sock_set_default_impl", 00:05:35.641 "sock_impl_set_options", 00:05:35.641 "sock_impl_get_options", 00:05:35.641 "iobuf_get_stats", 00:05:35.641 "iobuf_set_options", 00:05:35.641 "framework_get_pci_devices", 00:05:35.641 "framework_get_config", 00:05:35.641 "framework_get_subsystems", 00:05:35.641 "vfu_tgt_set_base_path", 00:05:35.641 "trace_get_info", 00:05:35.641 "trace_get_tpoint_group_mask", 00:05:35.641 "trace_disable_tpoint_group", 00:05:35.641 "trace_enable_tpoint_group", 00:05:35.641 "trace_clear_tpoint_mask", 00:05:35.641 "trace_set_tpoint_mask", 00:05:35.641 "spdk_get_version", 00:05:35.641 "rpc_get_methods" 00:05:35.641 ] 00:05:35.641 03:00:38 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:35.641 03:00:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:35.641 03:00:38 -- common/autotest_common.sh@10 -- # set +x 00:05:35.641 03:00:38 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:35.641 03:00:38 -- spdkcli/tcp.sh@38 -- # killprocess 2332299 00:05:35.641 03:00:38 -- common/autotest_common.sh@936 -- # '[' -z 2332299 ']' 00:05:35.641 03:00:38 -- common/autotest_common.sh@940 -- # kill -0 2332299 00:05:35.641 03:00:38 -- common/autotest_common.sh@941 -- # uname 00:05:35.641 03:00:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.641 03:00:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332299 00:05:35.899 03:00:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.899 03:00:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.899 03:00:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332299' 00:05:35.899 killing process with pid 2332299 00:05:35.899 03:00:38 -- common/autotest_common.sh@955 -- # kill 2332299 00:05:35.899 03:00:38 -- common/autotest_common.sh@960 -- # wait 2332299 00:05:36.157 00:05:36.157 real 0m1.860s 00:05:36.157 user 0m3.554s 00:05:36.157 sys 0m0.516s 00:05:36.157 03:00:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.157 03:00:38 -- common/autotest_common.sh@10 -- # set +x 00:05:36.157 ************************************ 00:05:36.157 END TEST spdkcli_tcp 00:05:36.157 ************************************ 00:05:36.157 03:00:38 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:36.157 03:00:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.157 03:00:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.157 03:00:38 -- common/autotest_common.sh@10 -- # set +x 00:05:36.157 ************************************ 00:05:36.157 START TEST dpdk_mem_utility 00:05:36.157 ************************************ 00:05:36.157 03:00:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:36.157 * Looking for test storage... 00:05:36.157 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:36.157 03:00:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:36.157 03:00:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:36.157 03:00:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:36.415 03:00:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:36.415 03:00:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:36.415 03:00:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:36.415 03:00:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:36.415 03:00:38 -- scripts/common.sh@335 -- # IFS=.-: 00:05:36.415 03:00:38 -- scripts/common.sh@335 -- # read -ra ver1 00:05:36.415 03:00:38 -- scripts/common.sh@336 -- # IFS=.-: 00:05:36.415 03:00:38 -- scripts/common.sh@336 -- # read -ra ver2 00:05:36.415 03:00:38 -- scripts/common.sh@337 -- # local 'op=<' 00:05:36.415 03:00:38 -- scripts/common.sh@339 -- # ver1_l=2 00:05:36.415 03:00:38 -- scripts/common.sh@340 -- # ver2_l=1 00:05:36.415 03:00:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:36.415 03:00:38 -- scripts/common.sh@343 -- # case "$op" in 00:05:36.415 03:00:38 -- scripts/common.sh@344 -- # : 1 00:05:36.415 03:00:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:36.415 03:00:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:36.415 03:00:38 -- scripts/common.sh@364 -- # decimal 1 00:05:36.415 03:00:38 -- scripts/common.sh@352 -- # local d=1 00:05:36.415 03:00:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:36.415 03:00:38 -- scripts/common.sh@354 -- # echo 1 00:05:36.415 03:00:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:36.415 03:00:38 -- scripts/common.sh@365 -- # decimal 2 00:05:36.415 03:00:38 -- scripts/common.sh@352 -- # local d=2 00:05:36.415 03:00:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:36.415 03:00:38 -- scripts/common.sh@354 -- # echo 2 00:05:36.415 03:00:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:36.415 03:00:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:36.415 03:00:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:36.415 03:00:38 -- scripts/common.sh@367 -- # return 0 00:05:36.415 03:00:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:36.415 03:00:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:36.415 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.415 --rc genhtml_branch_coverage=1 00:05:36.415 --rc genhtml_function_coverage=1 00:05:36.415 --rc genhtml_legend=1 00:05:36.415 --rc geninfo_all_blocks=1 00:05:36.415 --rc geninfo_unexecuted_blocks=1 00:05:36.415 00:05:36.416 ' 00:05:36.416 03:00:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:36.416 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.416 --rc genhtml_branch_coverage=1 00:05:36.416 --rc genhtml_function_coverage=1 00:05:36.416 --rc genhtml_legend=1 00:05:36.416 --rc geninfo_all_blocks=1 00:05:36.416 --rc geninfo_unexecuted_blocks=1 00:05:36.416 00:05:36.416 ' 00:05:36.416 03:00:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:36.416 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.416 --rc genhtml_branch_coverage=1 00:05:36.416 --rc genhtml_function_coverage=1 00:05:36.416 --rc genhtml_legend=1 00:05:36.416 --rc geninfo_all_blocks=1 00:05:36.416 --rc geninfo_unexecuted_blocks=1 00:05:36.416 00:05:36.416 ' 00:05:36.416 03:00:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:36.416 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.416 --rc genhtml_branch_coverage=1 00:05:36.416 --rc genhtml_function_coverage=1 00:05:36.416 --rc genhtml_legend=1 00:05:36.416 --rc geninfo_all_blocks=1 00:05:36.416 --rc geninfo_unexecuted_blocks=1 00:05:36.416 00:05:36.416 ' 00:05:36.416 03:00:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:36.416 03:00:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2332647 00:05:36.416 03:00:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:36.416 03:00:38 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2332647 00:05:36.416 03:00:38 -- common/autotest_common.sh@829 -- # '[' -z 2332647 ']' 00:05:36.416 03:00:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:36.416 03:00:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:36.416 03:00:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:36.416 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:36.416 03:00:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:36.416 03:00:38 -- common/autotest_common.sh@10 -- # set +x 00:05:36.416 [2024-11-27 03:00:38.893178] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.416 [2024-11-27 03:00:38.893257] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2332647 ] 00:05:36.416 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.416 [2024-11-27 03:00:38.951573] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.674 [2024-11-27 03:00:39.039794] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:36.674 [2024-11-27 03:00:39.039952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.239 03:00:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:37.239 03:00:39 -- common/autotest_common.sh@862 -- # return 0 00:05:37.239 03:00:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:37.239 03:00:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:37.239 03:00:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:37.239 03:00:39 -- common/autotest_common.sh@10 -- # set +x 00:05:37.498 { 00:05:37.498 "filename": "/tmp/spdk_mem_dump.txt" 00:05:37.498 } 00:05:37.498 03:00:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:37.498 03:00:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:37.498 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:37.498 1 heaps totaling size 814.000000 MiB 00:05:37.498 size: 814.000000 MiB heap id: 0 00:05:37.498 end heaps---------- 00:05:37.498 8 mempools totaling size 598.116089 MiB 00:05:37.498 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:37.498 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:37.498 size: 84.521057 MiB name: bdev_io_2332647 00:05:37.498 size: 51.011292 MiB name: evtpool_2332647 00:05:37.498 size: 50.003479 MiB name: msgpool_2332647 00:05:37.498 size: 21.763794 MiB name: PDU_Pool 00:05:37.498 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:37.498 size: 0.026123 MiB name: Session_Pool 00:05:37.498 end mempools------- 00:05:37.498 6 memzones totaling size 4.142822 MiB 00:05:37.498 size: 1.000366 MiB name: RG_ring_0_2332647 00:05:37.498 size: 1.000366 MiB name: RG_ring_1_2332647 00:05:37.498 size: 1.000366 MiB name: RG_ring_4_2332647 00:05:37.498 size: 1.000366 MiB name: RG_ring_5_2332647 00:05:37.498 size: 0.125366 MiB name: RG_ring_2_2332647 00:05:37.498 size: 0.015991 MiB name: RG_ring_3_2332647 00:05:37.498 end memzones------- 00:05:37.498 03:00:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:37.498 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:37.498 list of free elements. size: 12.519348 MiB 00:05:37.498 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:37.498 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:37.498 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:37.498 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:37.498 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:37.498 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:37.498 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:37.498 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:37.498 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:37.498 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:37.498 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:37.498 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:37.498 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:37.498 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:37.498 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:37.498 list of standard malloc elements. size: 199.218079 MiB 00:05:37.498 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:37.498 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:37.498 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:37.498 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:37.498 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:37.498 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:37.498 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:37.498 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:37.498 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:37.499 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:37.499 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:37.499 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:37.499 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:37.499 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:37.499 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:37.499 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:37.499 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:37.499 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:37.499 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:37.499 list of memzone associated elements. size: 602.262573 MiB 00:05:37.499 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:37.499 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:37.499 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:37.499 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:37.499 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:37.499 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2332647_0 00:05:37.499 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:37.499 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2332647_0 00:05:37.499 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:37.499 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2332647_0 00:05:37.499 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:37.499 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:37.499 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:37.499 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:37.499 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:37.499 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2332647 00:05:37.499 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:37.499 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2332647 00:05:37.499 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:37.499 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2332647 00:05:37.499 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:37.499 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:37.499 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:37.499 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:37.499 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:37.499 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:37.499 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:37.499 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:37.499 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:37.499 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2332647 00:05:37.499 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:37.499 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2332647 00:05:37.499 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:37.499 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2332647 00:05:37.499 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:37.499 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2332647 00:05:37.499 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:37.499 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2332647 00:05:37.499 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:37.499 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:37.499 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:37.499 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:37.499 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:37.499 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:37.499 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:37.499 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2332647 00:05:37.499 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:37.499 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:37.499 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:37.499 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:37.499 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:37.499 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2332647 00:05:37.499 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:37.499 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:37.499 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:37.499 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2332647 00:05:37.499 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:37.499 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2332647 00:05:37.499 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:37.499 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:37.499 03:00:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:37.499 03:00:39 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2332647 00:05:37.499 03:00:39 -- common/autotest_common.sh@936 -- # '[' -z 2332647 ']' 00:05:37.499 03:00:39 -- common/autotest_common.sh@940 -- # kill -0 2332647 00:05:37.499 03:00:39 -- common/autotest_common.sh@941 -- # uname 00:05:37.499 03:00:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:37.499 03:00:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2332647 00:05:37.499 03:00:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:37.499 03:00:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:37.499 03:00:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2332647' 00:05:37.499 killing process with pid 2332647 00:05:37.499 03:00:40 -- common/autotest_common.sh@955 -- # kill 2332647 00:05:37.499 03:00:40 -- common/autotest_common.sh@960 -- # wait 2332647 00:05:38.065 00:05:38.065 real 0m1.713s 00:05:38.065 user 0m1.899s 00:05:38.065 sys 0m0.449s 00:05:38.065 03:00:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.065 03:00:40 -- common/autotest_common.sh@10 -- # set +x 00:05:38.065 ************************************ 00:05:38.065 END TEST dpdk_mem_utility 00:05:38.065 ************************************ 00:05:38.065 03:00:40 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:38.065 03:00:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:38.065 03:00:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.065 03:00:40 -- common/autotest_common.sh@10 -- # set +x 00:05:38.065 ************************************ 00:05:38.065 START TEST event 00:05:38.065 ************************************ 00:05:38.065 03:00:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:38.065 * Looking for test storage... 00:05:38.065 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:38.065 03:00:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:38.065 03:00:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:38.065 03:00:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:38.065 03:00:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:38.065 03:00:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:38.066 03:00:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:38.066 03:00:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:38.066 03:00:40 -- scripts/common.sh@335 -- # IFS=.-: 00:05:38.066 03:00:40 -- scripts/common.sh@335 -- # read -ra ver1 00:05:38.066 03:00:40 -- scripts/common.sh@336 -- # IFS=.-: 00:05:38.066 03:00:40 -- scripts/common.sh@336 -- # read -ra ver2 00:05:38.066 03:00:40 -- scripts/common.sh@337 -- # local 'op=<' 00:05:38.066 03:00:40 -- scripts/common.sh@339 -- # ver1_l=2 00:05:38.066 03:00:40 -- scripts/common.sh@340 -- # ver2_l=1 00:05:38.066 03:00:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:38.066 03:00:40 -- scripts/common.sh@343 -- # case "$op" in 00:05:38.066 03:00:40 -- scripts/common.sh@344 -- # : 1 00:05:38.066 03:00:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:38.066 03:00:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:38.066 03:00:40 -- scripts/common.sh@364 -- # decimal 1 00:05:38.066 03:00:40 -- scripts/common.sh@352 -- # local d=1 00:05:38.066 03:00:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:38.066 03:00:40 -- scripts/common.sh@354 -- # echo 1 00:05:38.066 03:00:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:38.066 03:00:40 -- scripts/common.sh@365 -- # decimal 2 00:05:38.066 03:00:40 -- scripts/common.sh@352 -- # local d=2 00:05:38.066 03:00:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:38.066 03:00:40 -- scripts/common.sh@354 -- # echo 2 00:05:38.066 03:00:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:38.066 03:00:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:38.066 03:00:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:38.066 03:00:40 -- scripts/common.sh@367 -- # return 0 00:05:38.066 03:00:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:38.066 03:00:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:38.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.066 --rc genhtml_branch_coverage=1 00:05:38.066 --rc genhtml_function_coverage=1 00:05:38.066 --rc genhtml_legend=1 00:05:38.066 --rc geninfo_all_blocks=1 00:05:38.066 --rc geninfo_unexecuted_blocks=1 00:05:38.066 00:05:38.066 ' 00:05:38.066 03:00:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:38.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.066 --rc genhtml_branch_coverage=1 00:05:38.066 --rc genhtml_function_coverage=1 00:05:38.066 --rc genhtml_legend=1 00:05:38.066 --rc geninfo_all_blocks=1 00:05:38.066 --rc geninfo_unexecuted_blocks=1 00:05:38.066 00:05:38.066 ' 00:05:38.066 03:00:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:38.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.066 --rc genhtml_branch_coverage=1 00:05:38.066 --rc genhtml_function_coverage=1 00:05:38.066 --rc genhtml_legend=1 00:05:38.066 --rc geninfo_all_blocks=1 00:05:38.066 --rc geninfo_unexecuted_blocks=1 00:05:38.066 00:05:38.066 ' 00:05:38.066 03:00:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:38.066 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.066 --rc genhtml_branch_coverage=1 00:05:38.066 --rc genhtml_function_coverage=1 00:05:38.066 --rc genhtml_legend=1 00:05:38.066 --rc geninfo_all_blocks=1 00:05:38.066 --rc geninfo_unexecuted_blocks=1 00:05:38.066 00:05:38.066 ' 00:05:38.066 03:00:40 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:38.066 03:00:40 -- bdev/nbd_common.sh@6 -- # set -e 00:05:38.066 03:00:40 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:38.066 03:00:40 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:38.066 03:00:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.066 03:00:40 -- common/autotest_common.sh@10 -- # set +x 00:05:38.066 ************************************ 00:05:38.066 START TEST event_perf 00:05:38.066 ************************************ 00:05:38.066 03:00:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:38.066 Running I/O for 1 seconds...[2024-11-27 03:00:40.594263] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.066 [2024-11-27 03:00:40.594342] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2332974 ] 00:05:38.066 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.066 [2024-11-27 03:00:40.656419] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:38.324 [2024-11-27 03:00:40.749921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:38.324 [2024-11-27 03:00:40.749990] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:38.324 [2024-11-27 03:00:40.750087] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:38.324 [2024-11-27 03:00:40.750090] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.258 Running I/O for 1 seconds... 00:05:39.259 lcore 0: 230510 00:05:39.259 lcore 1: 230509 00:05:39.259 lcore 2: 230510 00:05:39.259 lcore 3: 230509 00:05:39.259 done. 00:05:39.259 00:05:39.259 real 0m1.247s 00:05:39.259 user 0m4.161s 00:05:39.259 sys 0m0.081s 00:05:39.259 03:00:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.259 03:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:39.259 ************************************ 00:05:39.259 END TEST event_perf 00:05:39.259 ************************************ 00:05:39.259 03:00:41 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:39.259 03:00:41 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:39.259 03:00:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.259 03:00:41 -- common/autotest_common.sh@10 -- # set +x 00:05:39.259 ************************************ 00:05:39.259 START TEST event_reactor 00:05:39.259 ************************************ 00:05:39.259 03:00:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:05:39.259 [2024-11-27 03:00:41.869021] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.259 [2024-11-27 03:00:41.869101] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333137 ] 00:05:39.517 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.517 [2024-11-27 03:00:41.932707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.517 [2024-11-27 03:00:42.023560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.891 test_start 00:05:40.891 oneshot 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 tick 250 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 tick 250 00:05:40.891 tick 500 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 tick 250 00:05:40.891 tick 100 00:05:40.891 tick 100 00:05:40.891 test_end 00:05:40.891 00:05:40.891 real 0m1.252s 00:05:40.891 user 0m1.168s 00:05:40.891 sys 0m0.078s 00:05:40.891 03:00:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.891 03:00:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.891 ************************************ 00:05:40.891 END TEST event_reactor 00:05:40.891 ************************************ 00:05:40.891 03:00:43 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:40.891 03:00:43 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:05:40.891 03:00:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.891 03:00:43 -- common/autotest_common.sh@10 -- # set +x 00:05:40.891 ************************************ 00:05:40.891 START TEST event_reactor_perf 00:05:40.891 ************************************ 00:05:40.891 03:00:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:05:40.891 [2024-11-27 03:00:43.145693] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.891 [2024-11-27 03:00:43.145766] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333292 ] 00:05:40.891 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.891 [2024-11-27 03:00:43.207391] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.891 [2024-11-27 03:00:43.298186] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:41.825 test_start 00:05:41.825 test_end 00:05:41.825 Performance: 353064 events per second 00:05:41.825 00:05:41.825 real 0m1.248s 00:05:41.825 user 0m1.164s 00:05:41.825 sys 0m0.079s 00:05:41.825 03:00:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:41.825 03:00:44 -- common/autotest_common.sh@10 -- # set +x 00:05:41.825 ************************************ 00:05:41.825 END TEST event_reactor_perf 00:05:41.825 ************************************ 00:05:41.825 03:00:44 -- event/event.sh@49 -- # uname -s 00:05:41.825 03:00:44 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:05:41.825 03:00:44 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:41.825 03:00:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:41.825 03:00:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:41.825 03:00:44 -- common/autotest_common.sh@10 -- # set +x 00:05:41.825 ************************************ 00:05:41.825 START TEST event_scheduler 00:05:41.825 ************************************ 00:05:41.825 03:00:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:05:42.084 * Looking for test storage... 00:05:42.084 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:05:42.084 03:00:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:42.084 03:00:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:42.084 03:00:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:42.084 03:00:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:42.084 03:00:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:42.084 03:00:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:42.084 03:00:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:42.084 03:00:44 -- scripts/common.sh@335 -- # IFS=.-: 00:05:42.084 03:00:44 -- scripts/common.sh@335 -- # read -ra ver1 00:05:42.084 03:00:44 -- scripts/common.sh@336 -- # IFS=.-: 00:05:42.084 03:00:44 -- scripts/common.sh@336 -- # read -ra ver2 00:05:42.084 03:00:44 -- scripts/common.sh@337 -- # local 'op=<' 00:05:42.084 03:00:44 -- scripts/common.sh@339 -- # ver1_l=2 00:05:42.084 03:00:44 -- scripts/common.sh@340 -- # ver2_l=1 00:05:42.084 03:00:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:42.084 03:00:44 -- scripts/common.sh@343 -- # case "$op" in 00:05:42.084 03:00:44 -- scripts/common.sh@344 -- # : 1 00:05:42.084 03:00:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:42.084 03:00:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:42.084 03:00:44 -- scripts/common.sh@364 -- # decimal 1 00:05:42.084 03:00:44 -- scripts/common.sh@352 -- # local d=1 00:05:42.084 03:00:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:42.084 03:00:44 -- scripts/common.sh@354 -- # echo 1 00:05:42.084 03:00:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:42.084 03:00:44 -- scripts/common.sh@365 -- # decimal 2 00:05:42.084 03:00:44 -- scripts/common.sh@352 -- # local d=2 00:05:42.084 03:00:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:42.084 03:00:44 -- scripts/common.sh@354 -- # echo 2 00:05:42.084 03:00:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:42.084 03:00:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:42.084 03:00:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:42.084 03:00:44 -- scripts/common.sh@367 -- # return 0 00:05:42.084 03:00:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:42.084 03:00:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:42.084 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.084 --rc genhtml_branch_coverage=1 00:05:42.084 --rc genhtml_function_coverage=1 00:05:42.084 --rc genhtml_legend=1 00:05:42.084 --rc geninfo_all_blocks=1 00:05:42.084 --rc geninfo_unexecuted_blocks=1 00:05:42.084 00:05:42.084 ' 00:05:42.084 03:00:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:42.084 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.084 --rc genhtml_branch_coverage=1 00:05:42.084 --rc genhtml_function_coverage=1 00:05:42.084 --rc genhtml_legend=1 00:05:42.084 --rc geninfo_all_blocks=1 00:05:42.084 --rc geninfo_unexecuted_blocks=1 00:05:42.084 00:05:42.084 ' 00:05:42.084 03:00:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:42.084 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.084 --rc genhtml_branch_coverage=1 00:05:42.084 --rc genhtml_function_coverage=1 00:05:42.084 --rc genhtml_legend=1 00:05:42.084 --rc geninfo_all_blocks=1 00:05:42.084 --rc geninfo_unexecuted_blocks=1 00:05:42.084 00:05:42.084 ' 00:05:42.084 03:00:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:42.084 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:42.084 --rc genhtml_branch_coverage=1 00:05:42.084 --rc genhtml_function_coverage=1 00:05:42.084 --rc genhtml_legend=1 00:05:42.084 --rc geninfo_all_blocks=1 00:05:42.084 --rc geninfo_unexecuted_blocks=1 00:05:42.084 00:05:42.084 ' 00:05:42.084 03:00:44 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:05:42.085 03:00:44 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2333487 00:05:42.085 03:00:44 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:05:42.085 03:00:44 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:05:42.085 03:00:44 -- scheduler/scheduler.sh@37 -- # waitforlisten 2333487 00:05:42.085 03:00:44 -- common/autotest_common.sh@829 -- # '[' -z 2333487 ']' 00:05:42.085 03:00:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:42.085 03:00:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:42.085 03:00:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:42.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:42.085 03:00:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:42.085 03:00:44 -- common/autotest_common.sh@10 -- # set +x 00:05:42.085 [2024-11-27 03:00:44.586003] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.085 [2024-11-27 03:00:44.586093] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2333487 ] 00:05:42.085 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.085 [2024-11-27 03:00:44.643407] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:42.343 [2024-11-27 03:00:44.732111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.343 [2024-11-27 03:00:44.732166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:42.343 [2024-11-27 03:00:44.732230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:42.343 [2024-11-27 03:00:44.732233] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:42.343 03:00:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:42.343 03:00:44 -- common/autotest_common.sh@862 -- # return 0 00:05:42.343 03:00:44 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:05:42.343 03:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.343 03:00:44 -- common/autotest_common.sh@10 -- # set +x 00:05:42.343 POWER: Env isn't set yet! 00:05:42.343 POWER: Attempting to initialise ACPI cpufreq power management... 00:05:42.343 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:05:42.343 POWER: Cannot get available frequencies of lcore 0 00:05:42.343 POWER: Attempting to initialise PSTAT power management... 00:05:42.343 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:05:42.343 POWER: Initialized successfully for lcore 0 power management 00:05:42.343 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:05:42.343 POWER: Initialized successfully for lcore 1 power management 00:05:42.344 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:05:42.344 POWER: Initialized successfully for lcore 2 power management 00:05:42.344 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:05:42.344 POWER: Initialized successfully for lcore 3 power management 00:05:42.344 [2024-11-27 03:00:44.891736] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:05:42.344 [2024-11-27 03:00:44.891753] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:05:42.344 [2024-11-27 03:00:44.891764] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:05:42.344 03:00:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.344 03:00:44 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:05:42.344 03:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.344 03:00:44 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 [2024-11-27 03:00:44.988509] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:05:42.603 03:00:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:44 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:05:42.603 03:00:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:42.603 03:00:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.603 03:00:44 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 ************************************ 00:05:42.603 START TEST scheduler_create_thread 00:05:42.603 ************************************ 00:05:42.603 03:00:44 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:05:42.603 03:00:44 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:05:42.603 03:00:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:44 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 2 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 3 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 4 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 5 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 6 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 7 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 8 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 9 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 10 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:42.603 03:00:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:42.603 03:00:45 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:05:42.603 03:00:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:42.603 03:00:45 -- common/autotest_common.sh@10 -- # set +x 00:05:43.984 03:00:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:43.984 03:00:46 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:43.984 03:00:46 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:43.984 03:00:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:43.984 03:00:46 -- common/autotest_common.sh@10 -- # set +x 00:05:45.357 03:00:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:45.357 00:05:45.357 real 0m2.618s 00:05:45.357 user 0m0.007s 00:05:45.357 sys 0m0.007s 00:05:45.357 03:00:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.357 03:00:47 -- common/autotest_common.sh@10 -- # set +x 00:05:45.357 ************************************ 00:05:45.357 END TEST scheduler_create_thread 00:05:45.357 ************************************ 00:05:45.357 03:00:47 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:45.357 03:00:47 -- scheduler/scheduler.sh@46 -- # killprocess 2333487 00:05:45.357 03:00:47 -- common/autotest_common.sh@936 -- # '[' -z 2333487 ']' 00:05:45.357 03:00:47 -- common/autotest_common.sh@940 -- # kill -0 2333487 00:05:45.357 03:00:47 -- common/autotest_common.sh@941 -- # uname 00:05:45.357 03:00:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:45.357 03:00:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2333487 00:05:45.357 03:00:47 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:45.357 03:00:47 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:45.357 03:00:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2333487' 00:05:45.357 killing process with pid 2333487 00:05:45.357 03:00:47 -- common/autotest_common.sh@955 -- # kill 2333487 00:05:45.358 03:00:47 -- common/autotest_common.sh@960 -- # wait 2333487 00:05:45.615 [2024-11-27 03:00:48.091720] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:45.875 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:05:45.875 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:45.875 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:05:45.875 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:45.875 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:05:45.875 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:45.875 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:05:45.875 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:45.875 00:05:45.875 real 0m3.914s 00:05:45.875 user 0m6.096s 00:05:45.875 sys 0m0.325s 00:05:45.875 03:00:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.875 03:00:48 -- common/autotest_common.sh@10 -- # set +x 00:05:45.875 ************************************ 00:05:45.875 END TEST event_scheduler 00:05:45.875 ************************************ 00:05:45.875 03:00:48 -- event/event.sh@51 -- # modprobe -n nbd 00:05:45.875 03:00:48 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:45.875 03:00:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:45.876 03:00:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.876 03:00:48 -- common/autotest_common.sh@10 -- # set +x 00:05:45.876 ************************************ 00:05:45.876 START TEST app_repeat 00:05:45.876 ************************************ 00:05:45.876 03:00:48 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:05:45.876 03:00:48 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:45.876 03:00:48 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:45.876 03:00:48 -- event/event.sh@13 -- # local nbd_list 00:05:45.876 03:00:48 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:45.876 03:00:48 -- event/event.sh@14 -- # local bdev_list 00:05:45.876 03:00:48 -- event/event.sh@15 -- # local repeat_times=4 00:05:45.876 03:00:48 -- event/event.sh@17 -- # modprobe nbd 00:05:45.876 03:00:48 -- event/event.sh@19 -- # repeat_pid=2334049 00:05:45.876 03:00:48 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:45.876 03:00:48 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:45.876 03:00:48 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2334049' 00:05:45.876 Process app_repeat pid: 2334049 00:05:45.876 03:00:48 -- event/event.sh@23 -- # for i in {0..2} 00:05:45.876 03:00:48 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:45.876 spdk_app_start Round 0 00:05:45.876 03:00:48 -- event/event.sh@25 -- # waitforlisten 2334049 /var/tmp/spdk-nbd.sock 00:05:45.876 03:00:48 -- common/autotest_common.sh@829 -- # '[' -z 2334049 ']' 00:05:45.876 03:00:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:45.876 03:00:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:45.876 03:00:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:45.876 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:45.876 03:00:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:45.876 03:00:48 -- common/autotest_common.sh@10 -- # set +x 00:05:45.876 [2024-11-27 03:00:48.375912] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.876 [2024-11-27 03:00:48.375987] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2334049 ] 00:05:45.876 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.876 [2024-11-27 03:00:48.435379] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:46.134 [2024-11-27 03:00:48.526601] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:46.134 [2024-11-27 03:00:48.526605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.069 03:00:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:47.069 03:00:49 -- common/autotest_common.sh@862 -- # return 0 00:05:47.069 03:00:49 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:47.069 Malloc0 00:05:47.069 03:00:49 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:47.328 Malloc1 00:05:47.328 03:00:49 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@12 -- # local i 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:47.328 03:00:49 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:47.585 /dev/nbd0 00:05:47.585 03:00:50 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:47.843 03:00:50 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:47.843 03:00:50 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:47.843 03:00:50 -- common/autotest_common.sh@867 -- # local i 00:05:47.843 03:00:50 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:47.843 03:00:50 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:47.843 03:00:50 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:47.843 03:00:50 -- common/autotest_common.sh@871 -- # break 00:05:47.843 03:00:50 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:47.843 03:00:50 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:47.843 03:00:50 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:47.843 1+0 records in 00:05:47.843 1+0 records out 00:05:47.843 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.00019158 s, 21.4 MB/s 00:05:47.843 03:00:50 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:47.843 03:00:50 -- common/autotest_common.sh@884 -- # size=4096 00:05:47.843 03:00:50 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:47.843 03:00:50 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:47.843 03:00:50 -- common/autotest_common.sh@887 -- # return 0 00:05:47.843 03:00:50 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:47.843 03:00:50 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:47.843 03:00:50 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:48.102 /dev/nbd1 00:05:48.102 03:00:50 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:48.102 03:00:50 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:48.102 03:00:50 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:48.102 03:00:50 -- common/autotest_common.sh@867 -- # local i 00:05:48.102 03:00:50 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:48.102 03:00:50 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:48.102 03:00:50 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:48.102 03:00:50 -- common/autotest_common.sh@871 -- # break 00:05:48.102 03:00:50 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:48.102 03:00:50 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:48.102 03:00:50 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:48.102 1+0 records in 00:05:48.102 1+0 records out 00:05:48.102 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000174329 s, 23.5 MB/s 00:05:48.102 03:00:50 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:48.102 03:00:50 -- common/autotest_common.sh@884 -- # size=4096 00:05:48.102 03:00:50 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:48.102 03:00:50 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:48.102 03:00:50 -- common/autotest_common.sh@887 -- # return 0 00:05:48.102 03:00:50 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:48.102 03:00:50 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:48.102 03:00:50 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:48.102 03:00:50 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:48.102 03:00:50 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:48.360 { 00:05:48.360 "nbd_device": "/dev/nbd0", 00:05:48.360 "bdev_name": "Malloc0" 00:05:48.360 }, 00:05:48.360 { 00:05:48.360 "nbd_device": "/dev/nbd1", 00:05:48.360 "bdev_name": "Malloc1" 00:05:48.360 } 00:05:48.360 ]' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:48.360 { 00:05:48.360 "nbd_device": "/dev/nbd0", 00:05:48.360 "bdev_name": "Malloc0" 00:05:48.360 }, 00:05:48.360 { 00:05:48.360 "nbd_device": "/dev/nbd1", 00:05:48.360 "bdev_name": "Malloc1" 00:05:48.360 } 00:05:48.360 ]' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:48.360 /dev/nbd1' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:48.360 /dev/nbd1' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@65 -- # count=2 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@95 -- # count=2 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:48.360 256+0 records in 00:05:48.360 256+0 records out 00:05:48.360 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00503268 s, 208 MB/s 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:48.360 256+0 records in 00:05:48.360 256+0 records out 00:05:48.360 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218923 s, 47.9 MB/s 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:48.360 256+0 records in 00:05:48.360 256+0 records out 00:05:48.360 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245631 s, 42.7 MB/s 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@51 -- # local i 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:48.360 03:00:50 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@41 -- # break 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@45 -- # return 0 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:48.619 03:00:51 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@41 -- # break 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@45 -- # return 0 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:48.876 03:00:51 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@65 -- # true 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@65 -- # count=0 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@104 -- # count=0 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:49.134 03:00:51 -- bdev/nbd_common.sh@109 -- # return 0 00:05:49.134 03:00:51 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:49.700 03:00:52 -- event/event.sh@35 -- # sleep 3 00:05:49.700 [2024-11-27 03:00:52.238319] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:49.958 [2024-11-27 03:00:52.327111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.958 [2024-11-27 03:00:52.327112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:49.958 [2024-11-27 03:00:52.389020] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:49.958 [2024-11-27 03:00:52.389114] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:52.483 03:00:55 -- event/event.sh@23 -- # for i in {0..2} 00:05:52.484 03:00:55 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:52.484 spdk_app_start Round 1 00:05:52.484 03:00:55 -- event/event.sh@25 -- # waitforlisten 2334049 /var/tmp/spdk-nbd.sock 00:05:52.484 03:00:55 -- common/autotest_common.sh@829 -- # '[' -z 2334049 ']' 00:05:52.484 03:00:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:52.484 03:00:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:52.484 03:00:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:52.484 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:52.484 03:00:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:52.484 03:00:55 -- common/autotest_common.sh@10 -- # set +x 00:05:52.741 03:00:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:52.741 03:00:55 -- common/autotest_common.sh@862 -- # return 0 00:05:52.741 03:00:55 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:52.999 Malloc0 00:05:52.999 03:00:55 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:53.257 Malloc1 00:05:53.257 03:00:55 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@12 -- # local i 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:53.257 03:00:55 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:53.514 /dev/nbd0 00:05:53.514 03:00:56 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:53.514 03:00:56 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:53.514 03:00:56 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:53.514 03:00:56 -- common/autotest_common.sh@867 -- # local i 00:05:53.514 03:00:56 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:53.514 03:00:56 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:53.514 03:00:56 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:53.514 03:00:56 -- common/autotest_common.sh@871 -- # break 00:05:53.514 03:00:56 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:53.514 03:00:56 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:53.514 03:00:56 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:53.514 1+0 records in 00:05:53.514 1+0 records out 00:05:53.514 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000209095 s, 19.6 MB/s 00:05:53.514 03:00:56 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:53.514 03:00:56 -- common/autotest_common.sh@884 -- # size=4096 00:05:53.514 03:00:56 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:53.514 03:00:56 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:53.514 03:00:56 -- common/autotest_common.sh@887 -- # return 0 00:05:53.515 03:00:56 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:53.515 03:00:56 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:53.515 03:00:56 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:53.773 /dev/nbd1 00:05:53.773 03:00:56 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:53.773 03:00:56 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:53.773 03:00:56 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:53.773 03:00:56 -- common/autotest_common.sh@867 -- # local i 00:05:53.773 03:00:56 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:53.773 03:00:56 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:53.773 03:00:56 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:53.773 03:00:56 -- common/autotest_common.sh@871 -- # break 00:05:53.773 03:00:56 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:53.773 03:00:56 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:53.773 03:00:56 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:53.773 1+0 records in 00:05:53.773 1+0 records out 00:05:53.773 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000192696 s, 21.3 MB/s 00:05:53.773 03:00:56 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:53.773 03:00:56 -- common/autotest_common.sh@884 -- # size=4096 00:05:53.773 03:00:56 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:53.773 03:00:56 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:53.773 03:00:56 -- common/autotest_common.sh@887 -- # return 0 00:05:53.773 03:00:56 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:53.773 03:00:56 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:53.773 03:00:56 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:53.773 03:00:56 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:53.773 03:00:56 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:54.030 03:00:56 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:54.031 { 00:05:54.031 "nbd_device": "/dev/nbd0", 00:05:54.031 "bdev_name": "Malloc0" 00:05:54.031 }, 00:05:54.031 { 00:05:54.031 "nbd_device": "/dev/nbd1", 00:05:54.031 "bdev_name": "Malloc1" 00:05:54.031 } 00:05:54.031 ]' 00:05:54.031 03:00:56 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:54.031 { 00:05:54.031 "nbd_device": "/dev/nbd0", 00:05:54.031 "bdev_name": "Malloc0" 00:05:54.031 }, 00:05:54.031 { 00:05:54.031 "nbd_device": "/dev/nbd1", 00:05:54.031 "bdev_name": "Malloc1" 00:05:54.031 } 00:05:54.031 ]' 00:05:54.031 03:00:56 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:54.288 /dev/nbd1' 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:54.288 /dev/nbd1' 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@65 -- # count=2 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@95 -- # count=2 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:54.288 256+0 records in 00:05:54.288 256+0 records out 00:05:54.288 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00528965 s, 198 MB/s 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:54.288 256+0 records in 00:05:54.288 256+0 records out 00:05:54.288 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0253582 s, 41.4 MB/s 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:54.288 256+0 records in 00:05:54.288 256+0 records out 00:05:54.288 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0250046 s, 41.9 MB/s 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:54.288 03:00:56 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@51 -- # local i 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:54.289 03:00:56 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@41 -- # break 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@45 -- # return 0 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:54.547 03:00:57 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@41 -- # break 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@45 -- # return 0 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:54.804 03:00:57 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@65 -- # true 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@65 -- # count=0 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@104 -- # count=0 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:55.063 03:00:57 -- bdev/nbd_common.sh@109 -- # return 0 00:05:55.063 03:00:57 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:55.320 03:00:57 -- event/event.sh@35 -- # sleep 3 00:05:55.577 [2024-11-27 03:00:58.091727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:55.578 [2024-11-27 03:00:58.179409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:55.578 [2024-11-27 03:00:58.179414] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.840 [2024-11-27 03:00:58.241350] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:55.841 [2024-11-27 03:00:58.241431] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:58.420 03:01:00 -- event/event.sh@23 -- # for i in {0..2} 00:05:58.420 03:01:00 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:58.420 spdk_app_start Round 2 00:05:58.420 03:01:00 -- event/event.sh@25 -- # waitforlisten 2334049 /var/tmp/spdk-nbd.sock 00:05:58.420 03:01:00 -- common/autotest_common.sh@829 -- # '[' -z 2334049 ']' 00:05:58.420 03:01:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:58.420 03:01:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:58.420 03:01:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:58.420 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:58.420 03:01:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:58.420 03:01:00 -- common/autotest_common.sh@10 -- # set +x 00:05:58.678 03:01:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:58.678 03:01:01 -- common/autotest_common.sh@862 -- # return 0 00:05:58.678 03:01:01 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:58.936 Malloc0 00:05:58.936 03:01:01 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:59.194 Malloc1 00:05:59.194 03:01:01 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@12 -- # local i 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:59.194 03:01:01 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:59.195 03:01:01 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:59.452 /dev/nbd0 00:05:59.452 03:01:01 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:59.452 03:01:01 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:59.452 03:01:01 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:59.452 03:01:01 -- common/autotest_common.sh@867 -- # local i 00:05:59.452 03:01:01 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:59.452 03:01:01 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:59.452 03:01:01 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:59.452 03:01:01 -- common/autotest_common.sh@871 -- # break 00:05:59.453 03:01:01 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:59.453 03:01:01 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:59.453 03:01:01 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:59.453 1+0 records in 00:05:59.453 1+0 records out 00:05:59.453 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000188143 s, 21.8 MB/s 00:05:59.453 03:01:01 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.453 03:01:01 -- common/autotest_common.sh@884 -- # size=4096 00:05:59.453 03:01:01 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.453 03:01:01 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:59.453 03:01:01 -- common/autotest_common.sh@887 -- # return 0 00:05:59.453 03:01:01 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:59.453 03:01:01 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:59.453 03:01:01 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:59.711 /dev/nbd1 00:05:59.711 03:01:02 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:59.711 03:01:02 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:59.711 03:01:02 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:59.711 03:01:02 -- common/autotest_common.sh@867 -- # local i 00:05:59.711 03:01:02 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:59.711 03:01:02 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:59.711 03:01:02 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:59.711 03:01:02 -- common/autotest_common.sh@871 -- # break 00:05:59.711 03:01:02 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:59.711 03:01:02 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:59.711 03:01:02 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:59.711 1+0 records in 00:05:59.711 1+0 records out 00:05:59.711 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000195508 s, 21.0 MB/s 00:05:59.711 03:01:02 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.711 03:01:02 -- common/autotest_common.sh@884 -- # size=4096 00:05:59.711 03:01:02 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:59.711 03:01:02 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:59.711 03:01:02 -- common/autotest_common.sh@887 -- # return 0 00:05:59.711 03:01:02 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:59.711 03:01:02 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:59.711 03:01:02 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:59.711 03:01:02 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:59.711 03:01:02 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:59.972 { 00:05:59.972 "nbd_device": "/dev/nbd0", 00:05:59.972 "bdev_name": "Malloc0" 00:05:59.972 }, 00:05:59.972 { 00:05:59.972 "nbd_device": "/dev/nbd1", 00:05:59.972 "bdev_name": "Malloc1" 00:05:59.972 } 00:05:59.972 ]' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:59.972 { 00:05:59.972 "nbd_device": "/dev/nbd0", 00:05:59.972 "bdev_name": "Malloc0" 00:05:59.972 }, 00:05:59.972 { 00:05:59.972 "nbd_device": "/dev/nbd1", 00:05:59.972 "bdev_name": "Malloc1" 00:05:59.972 } 00:05:59.972 ]' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:59.972 /dev/nbd1' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:59.972 /dev/nbd1' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@65 -- # count=2 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@95 -- # count=2 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:59.972 256+0 records in 00:05:59.972 256+0 records out 00:05:59.972 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00496091 s, 211 MB/s 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:59.972 256+0 records in 00:05:59.972 256+0 records out 00:05:59.972 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226141 s, 46.4 MB/s 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:59.972 256+0 records in 00:05:59.972 256+0 records out 00:05:59.972 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.025004 s, 41.9 MB/s 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@51 -- # local i 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:59.972 03:01:02 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@41 -- # break 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@45 -- # return 0 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:00.229 03:01:02 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@41 -- # break 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@45 -- # return 0 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:00.794 03:01:03 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:01.051 03:01:03 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:01.051 03:01:03 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:01.051 03:01:03 -- bdev/nbd_common.sh@65 -- # true 00:06:01.051 03:01:03 -- bdev/nbd_common.sh@65 -- # count=0 00:06:01.051 03:01:03 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:01.051 03:01:03 -- bdev/nbd_common.sh@104 -- # count=0 00:06:01.051 03:01:03 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:01.051 03:01:03 -- bdev/nbd_common.sh@109 -- # return 0 00:06:01.051 03:01:03 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:01.309 03:01:03 -- event/event.sh@35 -- # sleep 3 00:06:01.566 [2024-11-27 03:01:03.929224] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:01.566 [2024-11-27 03:01:04.015969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:01.566 [2024-11-27 03:01:04.015974] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.566 [2024-11-27 03:01:04.072968] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:01.566 [2024-11-27 03:01:04.073041] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:04.094 03:01:06 -- event/event.sh@38 -- # waitforlisten 2334049 /var/tmp/spdk-nbd.sock 00:06:04.094 03:01:06 -- common/autotest_common.sh@829 -- # '[' -z 2334049 ']' 00:06:04.094 03:01:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:04.094 03:01:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:04.094 03:01:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:04.094 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:04.094 03:01:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:04.094 03:01:06 -- common/autotest_common.sh@10 -- # set +x 00:06:04.352 03:01:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:04.352 03:01:06 -- common/autotest_common.sh@862 -- # return 0 00:06:04.352 03:01:06 -- event/event.sh@39 -- # killprocess 2334049 00:06:04.352 03:01:06 -- common/autotest_common.sh@936 -- # '[' -z 2334049 ']' 00:06:04.352 03:01:06 -- common/autotest_common.sh@940 -- # kill -0 2334049 00:06:04.352 03:01:06 -- common/autotest_common.sh@941 -- # uname 00:06:04.353 03:01:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:04.353 03:01:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2334049 00:06:04.612 03:01:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:04.612 03:01:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:04.612 03:01:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2334049' 00:06:04.612 killing process with pid 2334049 00:06:04.612 03:01:06 -- common/autotest_common.sh@955 -- # kill 2334049 00:06:04.612 03:01:06 -- common/autotest_common.sh@960 -- # wait 2334049 00:06:04.612 spdk_app_start is called in Round 0. 00:06:04.612 Shutdown signal received, stop current app iteration 00:06:04.612 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:04.612 spdk_app_start is called in Round 1. 00:06:04.612 Shutdown signal received, stop current app iteration 00:06:04.612 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:04.612 spdk_app_start is called in Round 2. 00:06:04.612 Shutdown signal received, stop current app iteration 00:06:04.612 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:04.612 spdk_app_start is called in Round 3. 00:06:04.612 Shutdown signal received, stop current app iteration 00:06:04.612 03:01:07 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:04.612 03:01:07 -- event/event.sh@42 -- # return 0 00:06:04.612 00:06:04.612 real 0m18.833s 00:06:04.612 user 0m41.297s 00:06:04.612 sys 0m3.153s 00:06:04.612 03:01:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:04.612 03:01:07 -- common/autotest_common.sh@10 -- # set +x 00:06:04.612 ************************************ 00:06:04.612 END TEST app_repeat 00:06:04.612 ************************************ 00:06:04.612 03:01:07 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:04.612 03:01:07 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:04.612 03:01:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:04.612 03:01:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.613 03:01:07 -- common/autotest_common.sh@10 -- # set +x 00:06:04.613 ************************************ 00:06:04.613 START TEST cpu_locks 00:06:04.613 ************************************ 00:06:04.613 03:01:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:04.871 * Looking for test storage... 00:06:04.872 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:04.872 03:01:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:04.872 03:01:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:04.872 03:01:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:04.872 03:01:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:04.872 03:01:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:04.872 03:01:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:04.872 03:01:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:04.872 03:01:07 -- scripts/common.sh@335 -- # IFS=.-: 00:06:04.872 03:01:07 -- scripts/common.sh@335 -- # read -ra ver1 00:06:04.872 03:01:07 -- scripts/common.sh@336 -- # IFS=.-: 00:06:04.872 03:01:07 -- scripts/common.sh@336 -- # read -ra ver2 00:06:04.872 03:01:07 -- scripts/common.sh@337 -- # local 'op=<' 00:06:04.872 03:01:07 -- scripts/common.sh@339 -- # ver1_l=2 00:06:04.872 03:01:07 -- scripts/common.sh@340 -- # ver2_l=1 00:06:04.872 03:01:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:04.872 03:01:07 -- scripts/common.sh@343 -- # case "$op" in 00:06:04.872 03:01:07 -- scripts/common.sh@344 -- # : 1 00:06:04.872 03:01:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:04.872 03:01:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:04.872 03:01:07 -- scripts/common.sh@364 -- # decimal 1 00:06:04.872 03:01:07 -- scripts/common.sh@352 -- # local d=1 00:06:04.872 03:01:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:04.872 03:01:07 -- scripts/common.sh@354 -- # echo 1 00:06:04.872 03:01:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:04.872 03:01:07 -- scripts/common.sh@365 -- # decimal 2 00:06:04.872 03:01:07 -- scripts/common.sh@352 -- # local d=2 00:06:04.872 03:01:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:04.872 03:01:07 -- scripts/common.sh@354 -- # echo 2 00:06:04.872 03:01:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:04.872 03:01:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:04.872 03:01:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:04.872 03:01:07 -- scripts/common.sh@367 -- # return 0 00:06:04.872 03:01:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:04.872 03:01:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:04.872 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.872 --rc genhtml_branch_coverage=1 00:06:04.872 --rc genhtml_function_coverage=1 00:06:04.872 --rc genhtml_legend=1 00:06:04.872 --rc geninfo_all_blocks=1 00:06:04.872 --rc geninfo_unexecuted_blocks=1 00:06:04.872 00:06:04.872 ' 00:06:04.872 03:01:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:04.872 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.872 --rc genhtml_branch_coverage=1 00:06:04.872 --rc genhtml_function_coverage=1 00:06:04.872 --rc genhtml_legend=1 00:06:04.872 --rc geninfo_all_blocks=1 00:06:04.872 --rc geninfo_unexecuted_blocks=1 00:06:04.872 00:06:04.872 ' 00:06:04.872 03:01:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:04.872 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.872 --rc genhtml_branch_coverage=1 00:06:04.872 --rc genhtml_function_coverage=1 00:06:04.872 --rc genhtml_legend=1 00:06:04.872 --rc geninfo_all_blocks=1 00:06:04.872 --rc geninfo_unexecuted_blocks=1 00:06:04.872 00:06:04.872 ' 00:06:04.872 03:01:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:04.872 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:04.872 --rc genhtml_branch_coverage=1 00:06:04.872 --rc genhtml_function_coverage=1 00:06:04.872 --rc genhtml_legend=1 00:06:04.872 --rc geninfo_all_blocks=1 00:06:04.872 --rc geninfo_unexecuted_blocks=1 00:06:04.872 00:06:04.872 ' 00:06:04.872 03:01:07 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:04.872 03:01:07 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:04.872 03:01:07 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:04.872 03:01:07 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:04.872 03:01:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:04.872 03:01:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.872 03:01:07 -- common/autotest_common.sh@10 -- # set +x 00:06:04.872 ************************************ 00:06:04.872 START TEST default_locks 00:06:04.872 ************************************ 00:06:04.872 03:01:07 -- common/autotest_common.sh@1114 -- # default_locks 00:06:04.872 03:01:07 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2336524 00:06:04.872 03:01:07 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:04.872 03:01:07 -- event/cpu_locks.sh@47 -- # waitforlisten 2336524 00:06:04.872 03:01:07 -- common/autotest_common.sh@829 -- # '[' -z 2336524 ']' 00:06:04.872 03:01:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:04.872 03:01:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:04.872 03:01:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:04.872 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:04.872 03:01:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:04.872 03:01:07 -- common/autotest_common.sh@10 -- # set +x 00:06:04.872 [2024-11-27 03:01:07.410323] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.872 [2024-11-27 03:01:07.410407] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2336524 ] 00:06:04.872 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.872 [2024-11-27 03:01:07.472444] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.130 [2024-11-27 03:01:07.564760] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:05.130 [2024-11-27 03:01:07.564941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:06.064 03:01:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:06.064 03:01:08 -- common/autotest_common.sh@862 -- # return 0 00:06:06.064 03:01:08 -- event/cpu_locks.sh@49 -- # locks_exist 2336524 00:06:06.064 03:01:08 -- event/cpu_locks.sh@22 -- # lslocks -p 2336524 00:06:06.064 03:01:08 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:06.322 lslocks: write error 00:06:06.322 03:01:08 -- event/cpu_locks.sh@50 -- # killprocess 2336524 00:06:06.322 03:01:08 -- common/autotest_common.sh@936 -- # '[' -z 2336524 ']' 00:06:06.322 03:01:08 -- common/autotest_common.sh@940 -- # kill -0 2336524 00:06:06.322 03:01:08 -- common/autotest_common.sh@941 -- # uname 00:06:06.322 03:01:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.322 03:01:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2336524 00:06:06.322 03:01:08 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:06.322 03:01:08 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:06.322 03:01:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2336524' 00:06:06.322 killing process with pid 2336524 00:06:06.322 03:01:08 -- common/autotest_common.sh@955 -- # kill 2336524 00:06:06.322 03:01:08 -- common/autotest_common.sh@960 -- # wait 2336524 00:06:06.581 03:01:09 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2336524 00:06:06.581 03:01:09 -- common/autotest_common.sh@650 -- # local es=0 00:06:06.581 03:01:09 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2336524 00:06:06.581 03:01:09 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:06.581 03:01:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:06.581 03:01:09 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:06.581 03:01:09 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:06.581 03:01:09 -- common/autotest_common.sh@653 -- # waitforlisten 2336524 00:06:06.581 03:01:09 -- common/autotest_common.sh@829 -- # '[' -z 2336524 ']' 00:06:06.581 03:01:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:06.581 03:01:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:06.581 03:01:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:06.581 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:06.581 03:01:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:06.581 03:01:09 -- common/autotest_common.sh@10 -- # set +x 00:06:06.581 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2336524) - No such process 00:06:06.581 ERROR: process (pid: 2336524) is no longer running 00:06:06.839 03:01:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:06.839 03:01:09 -- common/autotest_common.sh@862 -- # return 1 00:06:06.839 03:01:09 -- common/autotest_common.sh@653 -- # es=1 00:06:06.839 03:01:09 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:06.839 03:01:09 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:06.839 03:01:09 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:06.839 03:01:09 -- event/cpu_locks.sh@54 -- # no_locks 00:06:06.839 03:01:09 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:06.839 03:01:09 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:06.839 03:01:09 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:06.839 00:06:06.839 real 0m1.839s 00:06:06.839 user 0m1.990s 00:06:06.839 sys 0m0.580s 00:06:06.839 03:01:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.839 03:01:09 -- common/autotest_common.sh@10 -- # set +x 00:06:06.839 ************************************ 00:06:06.839 END TEST default_locks 00:06:06.839 ************************************ 00:06:06.839 03:01:09 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:06.839 03:01:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:06.839 03:01:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:06.839 03:01:09 -- common/autotest_common.sh@10 -- # set +x 00:06:06.839 ************************************ 00:06:06.839 START TEST default_locks_via_rpc 00:06:06.839 ************************************ 00:06:06.839 03:01:09 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:06.839 03:01:09 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2336800 00:06:06.839 03:01:09 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:06.839 03:01:09 -- event/cpu_locks.sh@63 -- # waitforlisten 2336800 00:06:06.839 03:01:09 -- common/autotest_common.sh@829 -- # '[' -z 2336800 ']' 00:06:06.839 03:01:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:06.839 03:01:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:06.839 03:01:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:06.839 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:06.839 03:01:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:06.839 03:01:09 -- common/autotest_common.sh@10 -- # set +x 00:06:06.839 [2024-11-27 03:01:09.280153] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:06.839 [2024-11-27 03:01:09.280244] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2336800 ] 00:06:06.839 EAL: No free 2048 kB hugepages reported on node 1 00:06:06.839 [2024-11-27 03:01:09.339848] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:06.839 [2024-11-27 03:01:09.427412] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:06.839 [2024-11-27 03:01:09.427629] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.771 03:01:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:07.771 03:01:10 -- common/autotest_common.sh@862 -- # return 0 00:06:07.771 03:01:10 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:07.771 03:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:07.771 03:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:07.771 03:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:07.771 03:01:10 -- event/cpu_locks.sh@67 -- # no_locks 00:06:07.771 03:01:10 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:07.771 03:01:10 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:07.771 03:01:10 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:07.771 03:01:10 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:07.771 03:01:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:07.771 03:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:07.771 03:01:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:07.771 03:01:10 -- event/cpu_locks.sh@71 -- # locks_exist 2336800 00:06:07.771 03:01:10 -- event/cpu_locks.sh@22 -- # lslocks -p 2336800 00:06:07.771 03:01:10 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:08.028 03:01:10 -- event/cpu_locks.sh@73 -- # killprocess 2336800 00:06:08.028 03:01:10 -- common/autotest_common.sh@936 -- # '[' -z 2336800 ']' 00:06:08.028 03:01:10 -- common/autotest_common.sh@940 -- # kill -0 2336800 00:06:08.028 03:01:10 -- common/autotest_common.sh@941 -- # uname 00:06:08.028 03:01:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:08.028 03:01:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2336800 00:06:08.028 03:01:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:08.028 03:01:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:08.028 03:01:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2336800' 00:06:08.028 killing process with pid 2336800 00:06:08.028 03:01:10 -- common/autotest_common.sh@955 -- # kill 2336800 00:06:08.028 03:01:10 -- common/autotest_common.sh@960 -- # wait 2336800 00:06:08.595 00:06:08.595 real 0m1.725s 00:06:08.595 user 0m1.926s 00:06:08.595 sys 0m0.561s 00:06:08.595 03:01:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:08.595 03:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:08.595 ************************************ 00:06:08.595 END TEST default_locks_via_rpc 00:06:08.595 ************************************ 00:06:08.595 03:01:10 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:08.595 03:01:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:08.595 03:01:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.595 03:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:08.595 ************************************ 00:06:08.595 START TEST non_locking_app_on_locked_coremask 00:06:08.595 ************************************ 00:06:08.595 03:01:10 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:08.595 03:01:10 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2337097 00:06:08.595 03:01:10 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:08.595 03:01:10 -- event/cpu_locks.sh@81 -- # waitforlisten 2337097 /var/tmp/spdk.sock 00:06:08.595 03:01:10 -- common/autotest_common.sh@829 -- # '[' -z 2337097 ']' 00:06:08.595 03:01:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:08.595 03:01:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:08.595 03:01:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:08.595 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:08.595 03:01:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:08.595 03:01:10 -- common/autotest_common.sh@10 -- # set +x 00:06:08.595 [2024-11-27 03:01:11.029678] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.595 [2024-11-27 03:01:11.029777] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337097 ] 00:06:08.595 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.595 [2024-11-27 03:01:11.089098] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.595 [2024-11-27 03:01:11.177682] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:08.595 [2024-11-27 03:01:11.177855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.529 03:01:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:09.529 03:01:11 -- common/autotest_common.sh@862 -- # return 0 00:06:09.529 03:01:11 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2337238 00:06:09.529 03:01:11 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:09.529 03:01:11 -- event/cpu_locks.sh@85 -- # waitforlisten 2337238 /var/tmp/spdk2.sock 00:06:09.529 03:01:11 -- common/autotest_common.sh@829 -- # '[' -z 2337238 ']' 00:06:09.529 03:01:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:09.529 03:01:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:09.529 03:01:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:09.529 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:09.529 03:01:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:09.529 03:01:11 -- common/autotest_common.sh@10 -- # set +x 00:06:09.529 [2024-11-27 03:01:12.038632] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.529 [2024-11-27 03:01:12.038718] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337238 ] 00:06:09.529 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.529 [2024-11-27 03:01:12.132675] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:09.529 [2024-11-27 03:01:12.132708] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.787 [2024-11-27 03:01:12.310207] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:09.787 [2024-11-27 03:01:12.310392] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.721 03:01:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:10.721 03:01:12 -- common/autotest_common.sh@862 -- # return 0 00:06:10.721 03:01:12 -- event/cpu_locks.sh@87 -- # locks_exist 2337097 00:06:10.721 03:01:12 -- event/cpu_locks.sh@22 -- # lslocks -p 2337097 00:06:10.721 03:01:12 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:10.979 lslocks: write error 00:06:10.979 03:01:13 -- event/cpu_locks.sh@89 -- # killprocess 2337097 00:06:10.979 03:01:13 -- common/autotest_common.sh@936 -- # '[' -z 2337097 ']' 00:06:10.979 03:01:13 -- common/autotest_common.sh@940 -- # kill -0 2337097 00:06:10.979 03:01:13 -- common/autotest_common.sh@941 -- # uname 00:06:10.979 03:01:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:10.979 03:01:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2337097 00:06:10.979 03:01:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:10.979 03:01:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:10.979 03:01:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2337097' 00:06:10.979 killing process with pid 2337097 00:06:10.979 03:01:13 -- common/autotest_common.sh@955 -- # kill 2337097 00:06:10.979 03:01:13 -- common/autotest_common.sh@960 -- # wait 2337097 00:06:11.914 03:01:14 -- event/cpu_locks.sh@90 -- # killprocess 2337238 00:06:11.914 03:01:14 -- common/autotest_common.sh@936 -- # '[' -z 2337238 ']' 00:06:11.914 03:01:14 -- common/autotest_common.sh@940 -- # kill -0 2337238 00:06:11.914 03:01:14 -- common/autotest_common.sh@941 -- # uname 00:06:11.914 03:01:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:11.914 03:01:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2337238 00:06:11.914 03:01:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:11.914 03:01:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:11.914 03:01:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2337238' 00:06:11.914 killing process with pid 2337238 00:06:11.914 03:01:14 -- common/autotest_common.sh@955 -- # kill 2337238 00:06:11.914 03:01:14 -- common/autotest_common.sh@960 -- # wait 2337238 00:06:12.172 00:06:12.172 real 0m3.655s 00:06:12.172 user 0m3.982s 00:06:12.172 sys 0m1.072s 00:06:12.172 03:01:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:12.172 03:01:14 -- common/autotest_common.sh@10 -- # set +x 00:06:12.172 ************************************ 00:06:12.172 END TEST non_locking_app_on_locked_coremask 00:06:12.172 ************************************ 00:06:12.172 03:01:14 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:12.172 03:01:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:12.172 03:01:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:12.172 03:01:14 -- common/autotest_common.sh@10 -- # set +x 00:06:12.172 ************************************ 00:06:12.172 START TEST locking_app_on_unlocked_coremask 00:06:12.172 ************************************ 00:06:12.172 03:01:14 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:12.172 03:01:14 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2337545 00:06:12.172 03:01:14 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:12.172 03:01:14 -- event/cpu_locks.sh@99 -- # waitforlisten 2337545 /var/tmp/spdk.sock 00:06:12.172 03:01:14 -- common/autotest_common.sh@829 -- # '[' -z 2337545 ']' 00:06:12.172 03:01:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:12.172 03:01:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:12.172 03:01:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:12.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:12.172 03:01:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:12.172 03:01:14 -- common/autotest_common.sh@10 -- # set +x 00:06:12.172 [2024-11-27 03:01:14.714327] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.172 [2024-11-27 03:01:14.714419] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337545 ] 00:06:12.172 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.172 [2024-11-27 03:01:14.776829] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:12.172 [2024-11-27 03:01:14.776870] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.430 [2024-11-27 03:01:14.863735] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:12.430 [2024-11-27 03:01:14.863920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.365 03:01:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:13.365 03:01:15 -- common/autotest_common.sh@862 -- # return 0 00:06:13.365 03:01:15 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2337685 00:06:13.365 03:01:15 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:13.365 03:01:15 -- event/cpu_locks.sh@103 -- # waitforlisten 2337685 /var/tmp/spdk2.sock 00:06:13.365 03:01:15 -- common/autotest_common.sh@829 -- # '[' -z 2337685 ']' 00:06:13.365 03:01:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:13.365 03:01:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.365 03:01:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:13.365 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:13.365 03:01:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.365 03:01:15 -- common/autotest_common.sh@10 -- # set +x 00:06:13.365 [2024-11-27 03:01:15.692853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.365 [2024-11-27 03:01:15.692933] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337685 ] 00:06:13.365 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.365 [2024-11-27 03:01:15.788532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.365 [2024-11-27 03:01:15.965718] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:13.365 [2024-11-27 03:01:15.965914] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:14.299 03:01:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:14.299 03:01:16 -- common/autotest_common.sh@862 -- # return 0 00:06:14.299 03:01:16 -- event/cpu_locks.sh@105 -- # locks_exist 2337685 00:06:14.299 03:01:16 -- event/cpu_locks.sh@22 -- # lslocks -p 2337685 00:06:14.299 03:01:16 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:14.557 lslocks: write error 00:06:14.557 03:01:17 -- event/cpu_locks.sh@107 -- # killprocess 2337545 00:06:14.557 03:01:17 -- common/autotest_common.sh@936 -- # '[' -z 2337545 ']' 00:06:14.557 03:01:17 -- common/autotest_common.sh@940 -- # kill -0 2337545 00:06:14.557 03:01:17 -- common/autotest_common.sh@941 -- # uname 00:06:14.557 03:01:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:14.557 03:01:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2337545 00:06:14.815 03:01:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:14.815 03:01:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:14.815 03:01:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2337545' 00:06:14.815 killing process with pid 2337545 00:06:14.815 03:01:17 -- common/autotest_common.sh@955 -- # kill 2337545 00:06:14.815 03:01:17 -- common/autotest_common.sh@960 -- # wait 2337545 00:06:15.381 03:01:17 -- event/cpu_locks.sh@108 -- # killprocess 2337685 00:06:15.381 03:01:17 -- common/autotest_common.sh@936 -- # '[' -z 2337685 ']' 00:06:15.381 03:01:17 -- common/autotest_common.sh@940 -- # kill -0 2337685 00:06:15.381 03:01:17 -- common/autotest_common.sh@941 -- # uname 00:06:15.381 03:01:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:15.381 03:01:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2337685 00:06:15.639 03:01:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:15.639 03:01:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:15.639 03:01:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2337685' 00:06:15.639 killing process with pid 2337685 00:06:15.639 03:01:18 -- common/autotest_common.sh@955 -- # kill 2337685 00:06:15.639 03:01:18 -- common/autotest_common.sh@960 -- # wait 2337685 00:06:15.898 00:06:15.898 real 0m3.769s 00:06:15.898 user 0m4.127s 00:06:15.898 sys 0m1.081s 00:06:15.898 03:01:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:15.898 03:01:18 -- common/autotest_common.sh@10 -- # set +x 00:06:15.898 ************************************ 00:06:15.898 END TEST locking_app_on_unlocked_coremask 00:06:15.898 ************************************ 00:06:15.898 03:01:18 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:15.898 03:01:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:15.898 03:01:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:15.898 03:01:18 -- common/autotest_common.sh@10 -- # set +x 00:06:15.898 ************************************ 00:06:15.898 START TEST locking_app_on_locked_coremask 00:06:15.898 ************************************ 00:06:15.898 03:01:18 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:15.898 03:01:18 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2338000 00:06:15.898 03:01:18 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:15.898 03:01:18 -- event/cpu_locks.sh@116 -- # waitforlisten 2338000 /var/tmp/spdk.sock 00:06:15.898 03:01:18 -- common/autotest_common.sh@829 -- # '[' -z 2338000 ']' 00:06:15.898 03:01:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:15.898 03:01:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:15.898 03:01:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:15.898 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:15.898 03:01:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:15.898 03:01:18 -- common/autotest_common.sh@10 -- # set +x 00:06:15.898 [2024-11-27 03:01:18.511395] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.898 [2024-11-27 03:01:18.511496] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338000 ] 00:06:16.156 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.156 [2024-11-27 03:01:18.572849] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.157 [2024-11-27 03:01:18.658405] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:16.157 [2024-11-27 03:01:18.658597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.093 03:01:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:17.093 03:01:19 -- common/autotest_common.sh@862 -- # return 0 00:06:17.093 03:01:19 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2338138 00:06:17.093 03:01:19 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:17.093 03:01:19 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2338138 /var/tmp/spdk2.sock 00:06:17.093 03:01:19 -- common/autotest_common.sh@650 -- # local es=0 00:06:17.093 03:01:19 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2338138 /var/tmp/spdk2.sock 00:06:17.093 03:01:19 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:17.093 03:01:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:17.093 03:01:19 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:17.093 03:01:19 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:17.093 03:01:19 -- common/autotest_common.sh@653 -- # waitforlisten 2338138 /var/tmp/spdk2.sock 00:06:17.093 03:01:19 -- common/autotest_common.sh@829 -- # '[' -z 2338138 ']' 00:06:17.093 03:01:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:17.093 03:01:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:17.093 03:01:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:17.093 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:17.093 03:01:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:17.093 03:01:19 -- common/autotest_common.sh@10 -- # set +x 00:06:17.093 [2024-11-27 03:01:19.515700] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.093 [2024-11-27 03:01:19.515773] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338138 ] 00:06:17.093 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.093 [2024-11-27 03:01:19.613469] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2338000 has claimed it. 00:06:17.093 [2024-11-27 03:01:19.613539] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:17.659 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2338138) - No such process 00:06:17.659 ERROR: process (pid: 2338138) is no longer running 00:06:17.659 03:01:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:17.659 03:01:20 -- common/autotest_common.sh@862 -- # return 1 00:06:17.659 03:01:20 -- common/autotest_common.sh@653 -- # es=1 00:06:17.659 03:01:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:17.659 03:01:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:17.659 03:01:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:17.659 03:01:20 -- event/cpu_locks.sh@122 -- # locks_exist 2338000 00:06:17.659 03:01:20 -- event/cpu_locks.sh@22 -- # lslocks -p 2338000 00:06:17.659 03:01:20 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:18.241 lslocks: write error 00:06:18.241 03:01:20 -- event/cpu_locks.sh@124 -- # killprocess 2338000 00:06:18.241 03:01:20 -- common/autotest_common.sh@936 -- # '[' -z 2338000 ']' 00:06:18.241 03:01:20 -- common/autotest_common.sh@940 -- # kill -0 2338000 00:06:18.241 03:01:20 -- common/autotest_common.sh@941 -- # uname 00:06:18.241 03:01:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:18.241 03:01:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2338000 00:06:18.241 03:01:20 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:18.241 03:01:20 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:18.241 03:01:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2338000' 00:06:18.241 killing process with pid 2338000 00:06:18.241 03:01:20 -- common/autotest_common.sh@955 -- # kill 2338000 00:06:18.241 03:01:20 -- common/autotest_common.sh@960 -- # wait 2338000 00:06:18.499 00:06:18.499 real 0m2.529s 00:06:18.499 user 0m2.908s 00:06:18.499 sys 0m0.670s 00:06:18.499 03:01:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:18.499 03:01:20 -- common/autotest_common.sh@10 -- # set +x 00:06:18.499 ************************************ 00:06:18.499 END TEST locking_app_on_locked_coremask 00:06:18.499 ************************************ 00:06:18.499 03:01:21 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:18.499 03:01:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:18.499 03:01:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:18.499 03:01:21 -- common/autotest_common.sh@10 -- # set +x 00:06:18.499 ************************************ 00:06:18.499 START TEST locking_overlapped_coremask 00:06:18.499 ************************************ 00:06:18.499 03:01:21 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:18.499 03:01:21 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2338438 00:06:18.499 03:01:21 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:18.499 03:01:21 -- event/cpu_locks.sh@133 -- # waitforlisten 2338438 /var/tmp/spdk.sock 00:06:18.499 03:01:21 -- common/autotest_common.sh@829 -- # '[' -z 2338438 ']' 00:06:18.499 03:01:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:18.499 03:01:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:18.500 03:01:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:18.500 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:18.500 03:01:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:18.500 03:01:21 -- common/autotest_common.sh@10 -- # set +x 00:06:18.500 [2024-11-27 03:01:21.063768] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:18.500 [2024-11-27 03:01:21.063867] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338438 ] 00:06:18.500 EAL: No free 2048 kB hugepages reported on node 1 00:06:18.759 [2024-11-27 03:01:21.124586] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:18.759 [2024-11-27 03:01:21.214054] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:18.759 [2024-11-27 03:01:21.214259] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:18.759 [2024-11-27 03:01:21.214322] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:18.759 [2024-11-27 03:01:21.214324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.693 03:01:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:19.693 03:01:22 -- common/autotest_common.sh@862 -- # return 0 00:06:19.693 03:01:22 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2338500 00:06:19.693 03:01:22 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2338500 /var/tmp/spdk2.sock 00:06:19.693 03:01:22 -- common/autotest_common.sh@650 -- # local es=0 00:06:19.693 03:01:22 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:19.693 03:01:22 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2338500 /var/tmp/spdk2.sock 00:06:19.693 03:01:22 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:19.693 03:01:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:19.693 03:01:22 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:19.693 03:01:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:19.693 03:01:22 -- common/autotest_common.sh@653 -- # waitforlisten 2338500 /var/tmp/spdk2.sock 00:06:19.693 03:01:22 -- common/autotest_common.sh@829 -- # '[' -z 2338500 ']' 00:06:19.693 03:01:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:19.693 03:01:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:19.693 03:01:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:19.693 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:19.693 03:01:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:19.693 03:01:22 -- common/autotest_common.sh@10 -- # set +x 00:06:19.693 [2024-11-27 03:01:22.086626] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.693 [2024-11-27 03:01:22.086707] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338500 ] 00:06:19.693 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.693 [2024-11-27 03:01:22.177231] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2338438 has claimed it. 00:06:19.693 [2024-11-27 03:01:22.177302] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:20.260 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2338500) - No such process 00:06:20.260 ERROR: process (pid: 2338500) is no longer running 00:06:20.260 03:01:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.260 03:01:22 -- common/autotest_common.sh@862 -- # return 1 00:06:20.260 03:01:22 -- common/autotest_common.sh@653 -- # es=1 00:06:20.260 03:01:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:20.260 03:01:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:20.260 03:01:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:20.260 03:01:22 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:20.260 03:01:22 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:20.260 03:01:22 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:20.260 03:01:22 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:20.260 03:01:22 -- event/cpu_locks.sh@141 -- # killprocess 2338438 00:06:20.260 03:01:22 -- common/autotest_common.sh@936 -- # '[' -z 2338438 ']' 00:06:20.260 03:01:22 -- common/autotest_common.sh@940 -- # kill -0 2338438 00:06:20.260 03:01:22 -- common/autotest_common.sh@941 -- # uname 00:06:20.260 03:01:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:20.260 03:01:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2338438 00:06:20.260 03:01:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:20.260 03:01:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:20.260 03:01:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2338438' 00:06:20.260 killing process with pid 2338438 00:06:20.260 03:01:22 -- common/autotest_common.sh@955 -- # kill 2338438 00:06:20.260 03:01:22 -- common/autotest_common.sh@960 -- # wait 2338438 00:06:20.826 00:06:20.826 real 0m2.206s 00:06:20.826 user 0m6.354s 00:06:20.826 sys 0m0.527s 00:06:20.826 03:01:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:20.826 03:01:23 -- common/autotest_common.sh@10 -- # set +x 00:06:20.826 ************************************ 00:06:20.826 END TEST locking_overlapped_coremask 00:06:20.826 ************************************ 00:06:20.826 03:01:23 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:20.826 03:01:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:20.826 03:01:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.826 03:01:23 -- common/autotest_common.sh@10 -- # set +x 00:06:20.826 ************************************ 00:06:20.826 START TEST locking_overlapped_coremask_via_rpc 00:06:20.826 ************************************ 00:06:20.826 03:01:23 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:20.826 03:01:23 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2338744 00:06:20.826 03:01:23 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:20.826 03:01:23 -- event/cpu_locks.sh@149 -- # waitforlisten 2338744 /var/tmp/spdk.sock 00:06:20.826 03:01:23 -- common/autotest_common.sh@829 -- # '[' -z 2338744 ']' 00:06:20.826 03:01:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:20.826 03:01:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:20.826 03:01:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:20.826 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:20.826 03:01:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:20.826 03:01:23 -- common/autotest_common.sh@10 -- # set +x 00:06:20.826 [2024-11-27 03:01:23.298079] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.826 [2024-11-27 03:01:23.298170] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338744 ] 00:06:20.827 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.827 [2024-11-27 03:01:23.356641] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:20.827 [2024-11-27 03:01:23.356679] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:21.084 [2024-11-27 03:01:23.445515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:21.084 [2024-11-27 03:01:23.445714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:21.085 [2024-11-27 03:01:23.445776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:21.085 [2024-11-27 03:01:23.445779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.018 03:01:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:22.018 03:01:24 -- common/autotest_common.sh@862 -- # return 0 00:06:22.018 03:01:24 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2338813 00:06:22.018 03:01:24 -- event/cpu_locks.sh@153 -- # waitforlisten 2338813 /var/tmp/spdk2.sock 00:06:22.018 03:01:24 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:22.018 03:01:24 -- common/autotest_common.sh@829 -- # '[' -z 2338813 ']' 00:06:22.018 03:01:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:22.018 03:01:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:22.018 03:01:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:22.018 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:22.018 03:01:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:22.018 03:01:24 -- common/autotest_common.sh@10 -- # set +x 00:06:22.018 [2024-11-27 03:01:24.345056] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.018 [2024-11-27 03:01:24.345153] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2338813 ] 00:06:22.018 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.018 [2024-11-27 03:01:24.438266] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:22.018 [2024-11-27 03:01:24.438317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:22.018 [2024-11-27 03:01:24.614242] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:22.018 [2024-11-27 03:01:24.614537] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:22.018 [2024-11-27 03:01:24.614577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:22.018 [2024-11-27 03:01:24.614578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:23.023 03:01:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:23.023 03:01:25 -- common/autotest_common.sh@862 -- # return 0 00:06:23.023 03:01:25 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:23.023 03:01:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:23.023 03:01:25 -- common/autotest_common.sh@10 -- # set +x 00:06:23.023 03:01:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:23.023 03:01:25 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:23.023 03:01:25 -- common/autotest_common.sh@650 -- # local es=0 00:06:23.023 03:01:25 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:23.023 03:01:25 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:23.023 03:01:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:23.023 03:01:25 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:23.023 03:01:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:23.023 03:01:25 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:23.023 03:01:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:23.023 03:01:25 -- common/autotest_common.sh@10 -- # set +x 00:06:23.023 [2024-11-27 03:01:25.305622] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2338744 has claimed it. 00:06:23.023 request: 00:06:23.023 { 00:06:23.023 "method": "framework_enable_cpumask_locks", 00:06:23.023 "req_id": 1 00:06:23.023 } 00:06:23.023 Got JSON-RPC error response 00:06:23.023 response: 00:06:23.023 { 00:06:23.023 "code": -32603, 00:06:23.023 "message": "Failed to claim CPU core: 2" 00:06:23.023 } 00:06:23.023 03:01:25 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:23.023 03:01:25 -- common/autotest_common.sh@653 -- # es=1 00:06:23.023 03:01:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:23.023 03:01:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:23.023 03:01:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:23.023 03:01:25 -- event/cpu_locks.sh@158 -- # waitforlisten 2338744 /var/tmp/spdk.sock 00:06:23.023 03:01:25 -- common/autotest_common.sh@829 -- # '[' -z 2338744 ']' 00:06:23.023 03:01:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:23.023 03:01:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.023 03:01:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:23.023 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:23.023 03:01:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.023 03:01:25 -- common/autotest_common.sh@10 -- # set +x 00:06:23.023 03:01:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:23.023 03:01:25 -- common/autotest_common.sh@862 -- # return 0 00:06:23.023 03:01:25 -- event/cpu_locks.sh@159 -- # waitforlisten 2338813 /var/tmp/spdk2.sock 00:06:23.023 03:01:25 -- common/autotest_common.sh@829 -- # '[' -z 2338813 ']' 00:06:23.023 03:01:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:23.023 03:01:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:23.023 03:01:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:23.023 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:23.023 03:01:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:23.023 03:01:25 -- common/autotest_common.sh@10 -- # set +x 00:06:23.280 03:01:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:23.280 03:01:25 -- common/autotest_common.sh@862 -- # return 0 00:06:23.280 03:01:25 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:23.280 03:01:25 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:23.280 03:01:25 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:23.280 03:01:25 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:23.280 00:06:23.280 real 0m2.588s 00:06:23.280 user 0m1.296s 00:06:23.280 sys 0m0.219s 00:06:23.280 03:01:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.280 03:01:25 -- common/autotest_common.sh@10 -- # set +x 00:06:23.280 ************************************ 00:06:23.280 END TEST locking_overlapped_coremask_via_rpc 00:06:23.280 ************************************ 00:06:23.280 03:01:25 -- event/cpu_locks.sh@174 -- # cleanup 00:06:23.280 03:01:25 -- event/cpu_locks.sh@15 -- # [[ -z 2338744 ]] 00:06:23.280 03:01:25 -- event/cpu_locks.sh@15 -- # killprocess 2338744 00:06:23.280 03:01:25 -- common/autotest_common.sh@936 -- # '[' -z 2338744 ']' 00:06:23.280 03:01:25 -- common/autotest_common.sh@940 -- # kill -0 2338744 00:06:23.280 03:01:25 -- common/autotest_common.sh@941 -- # uname 00:06:23.280 03:01:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:23.280 03:01:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2338744 00:06:23.280 03:01:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:23.280 03:01:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:23.280 03:01:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2338744' 00:06:23.280 killing process with pid 2338744 00:06:23.280 03:01:25 -- common/autotest_common.sh@955 -- # kill 2338744 00:06:23.280 03:01:25 -- common/autotest_common.sh@960 -- # wait 2338744 00:06:23.844 03:01:26 -- event/cpu_locks.sh@16 -- # [[ -z 2338813 ]] 00:06:23.844 03:01:26 -- event/cpu_locks.sh@16 -- # killprocess 2338813 00:06:23.844 03:01:26 -- common/autotest_common.sh@936 -- # '[' -z 2338813 ']' 00:06:23.844 03:01:26 -- common/autotest_common.sh@940 -- # kill -0 2338813 00:06:23.844 03:01:26 -- common/autotest_common.sh@941 -- # uname 00:06:23.844 03:01:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:23.844 03:01:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2338813 00:06:23.844 03:01:26 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:23.844 03:01:26 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:23.844 03:01:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2338813' 00:06:23.844 killing process with pid 2338813 00:06:23.844 03:01:26 -- common/autotest_common.sh@955 -- # kill 2338813 00:06:23.844 03:01:26 -- common/autotest_common.sh@960 -- # wait 2338813 00:06:24.411 03:01:26 -- event/cpu_locks.sh@18 -- # rm -f 00:06:24.411 03:01:26 -- event/cpu_locks.sh@1 -- # cleanup 00:06:24.411 03:01:26 -- event/cpu_locks.sh@15 -- # [[ -z 2338744 ]] 00:06:24.411 03:01:26 -- event/cpu_locks.sh@15 -- # killprocess 2338744 00:06:24.411 03:01:26 -- common/autotest_common.sh@936 -- # '[' -z 2338744 ']' 00:06:24.411 03:01:26 -- common/autotest_common.sh@940 -- # kill -0 2338744 00:06:24.411 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2338744) - No such process 00:06:24.411 03:01:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2338744 is not found' 00:06:24.411 Process with pid 2338744 is not found 00:06:24.411 03:01:26 -- event/cpu_locks.sh@16 -- # [[ -z 2338813 ]] 00:06:24.411 03:01:26 -- event/cpu_locks.sh@16 -- # killprocess 2338813 00:06:24.411 03:01:26 -- common/autotest_common.sh@936 -- # '[' -z 2338813 ']' 00:06:24.411 03:01:26 -- common/autotest_common.sh@940 -- # kill -0 2338813 00:06:24.411 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2338813) - No such process 00:06:24.411 03:01:26 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2338813 is not found' 00:06:24.411 Process with pid 2338813 is not found 00:06:24.411 03:01:26 -- event/cpu_locks.sh@18 -- # rm -f 00:06:24.411 00:06:24.411 real 0m19.509s 00:06:24.411 user 0m35.318s 00:06:24.411 sys 0m5.576s 00:06:24.411 03:01:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.411 03:01:26 -- common/autotest_common.sh@10 -- # set +x 00:06:24.411 ************************************ 00:06:24.411 END TEST cpu_locks 00:06:24.411 ************************************ 00:06:24.411 00:06:24.411 real 0m46.306s 00:06:24.411 user 1m29.357s 00:06:24.411 sys 0m9.476s 00:06:24.411 03:01:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.411 03:01:26 -- common/autotest_common.sh@10 -- # set +x 00:06:24.411 ************************************ 00:06:24.411 END TEST event 00:06:24.411 ************************************ 00:06:24.411 03:01:26 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:24.411 03:01:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:24.411 03:01:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.411 03:01:26 -- common/autotest_common.sh@10 -- # set +x 00:06:24.411 ************************************ 00:06:24.411 START TEST thread 00:06:24.411 ************************************ 00:06:24.411 03:01:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:24.411 * Looking for test storage... 00:06:24.411 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:24.411 03:01:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:24.411 03:01:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:24.411 03:01:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:24.411 03:01:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:24.411 03:01:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:24.411 03:01:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:24.411 03:01:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:24.411 03:01:26 -- scripts/common.sh@335 -- # IFS=.-: 00:06:24.411 03:01:26 -- scripts/common.sh@335 -- # read -ra ver1 00:06:24.411 03:01:26 -- scripts/common.sh@336 -- # IFS=.-: 00:06:24.411 03:01:26 -- scripts/common.sh@336 -- # read -ra ver2 00:06:24.411 03:01:26 -- scripts/common.sh@337 -- # local 'op=<' 00:06:24.411 03:01:26 -- scripts/common.sh@339 -- # ver1_l=2 00:06:24.411 03:01:26 -- scripts/common.sh@340 -- # ver2_l=1 00:06:24.411 03:01:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:24.411 03:01:26 -- scripts/common.sh@343 -- # case "$op" in 00:06:24.411 03:01:26 -- scripts/common.sh@344 -- # : 1 00:06:24.411 03:01:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:24.411 03:01:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:24.411 03:01:26 -- scripts/common.sh@364 -- # decimal 1 00:06:24.411 03:01:26 -- scripts/common.sh@352 -- # local d=1 00:06:24.411 03:01:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:24.411 03:01:26 -- scripts/common.sh@354 -- # echo 1 00:06:24.411 03:01:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:24.411 03:01:26 -- scripts/common.sh@365 -- # decimal 2 00:06:24.411 03:01:26 -- scripts/common.sh@352 -- # local d=2 00:06:24.411 03:01:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:24.411 03:01:26 -- scripts/common.sh@354 -- # echo 2 00:06:24.411 03:01:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:24.411 03:01:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:24.411 03:01:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:24.411 03:01:26 -- scripts/common.sh@367 -- # return 0 00:06:24.411 03:01:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:24.411 03:01:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:24.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.411 --rc genhtml_branch_coverage=1 00:06:24.411 --rc genhtml_function_coverage=1 00:06:24.411 --rc genhtml_legend=1 00:06:24.411 --rc geninfo_all_blocks=1 00:06:24.411 --rc geninfo_unexecuted_blocks=1 00:06:24.411 00:06:24.411 ' 00:06:24.411 03:01:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:24.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.411 --rc genhtml_branch_coverage=1 00:06:24.411 --rc genhtml_function_coverage=1 00:06:24.411 --rc genhtml_legend=1 00:06:24.411 --rc geninfo_all_blocks=1 00:06:24.411 --rc geninfo_unexecuted_blocks=1 00:06:24.411 00:06:24.411 ' 00:06:24.411 03:01:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:24.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.411 --rc genhtml_branch_coverage=1 00:06:24.411 --rc genhtml_function_coverage=1 00:06:24.411 --rc genhtml_legend=1 00:06:24.411 --rc geninfo_all_blocks=1 00:06:24.411 --rc geninfo_unexecuted_blocks=1 00:06:24.411 00:06:24.411 ' 00:06:24.411 03:01:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:24.411 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:24.411 --rc genhtml_branch_coverage=1 00:06:24.411 --rc genhtml_function_coverage=1 00:06:24.411 --rc genhtml_legend=1 00:06:24.411 --rc geninfo_all_blocks=1 00:06:24.411 --rc geninfo_unexecuted_blocks=1 00:06:24.411 00:06:24.411 ' 00:06:24.411 03:01:26 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:24.412 03:01:26 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:24.412 03:01:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.412 03:01:26 -- common/autotest_common.sh@10 -- # set +x 00:06:24.412 ************************************ 00:06:24.412 START TEST thread_poller_perf 00:06:24.412 ************************************ 00:06:24.412 03:01:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:24.412 [2024-11-27 03:01:26.925456] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.412 [2024-11-27 03:01:26.925555] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339272 ] 00:06:24.412 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.412 [2024-11-27 03:01:26.990597] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:24.670 [2024-11-27 03:01:27.085170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:24.670 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:25.603 [2024-11-27T02:01:28.222Z] ====================================== 00:06:25.603 [2024-11-27T02:01:28.222Z] busy:2710159898 (cyc) 00:06:25.603 [2024-11-27T02:01:28.222Z] total_run_count: 279000 00:06:25.603 [2024-11-27T02:01:28.222Z] tsc_hz: 2700000000 (cyc) 00:06:25.604 [2024-11-27T02:01:28.223Z] ====================================== 00:06:25.604 [2024-11-27T02:01:28.223Z] poller_cost: 9713 (cyc), 3597 (nsec) 00:06:25.604 00:06:25.604 real 0m1.265s 00:06:25.604 user 0m1.178s 00:06:25.604 sys 0m0.080s 00:06:25.604 03:01:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.604 03:01:28 -- common/autotest_common.sh@10 -- # set +x 00:06:25.604 ************************************ 00:06:25.604 END TEST thread_poller_perf 00:06:25.604 ************************************ 00:06:25.604 03:01:28 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:25.604 03:01:28 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:25.604 03:01:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.604 03:01:28 -- common/autotest_common.sh@10 -- # set +x 00:06:25.604 ************************************ 00:06:25.604 START TEST thread_poller_perf 00:06:25.604 ************************************ 00:06:25.604 03:01:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:25.604 [2024-11-27 03:01:28.217744] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.604 [2024-11-27 03:01:28.217822] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339426 ] 00:06:25.862 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.862 [2024-11-27 03:01:28.283878] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:25.862 [2024-11-27 03:01:28.374454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.862 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:27.263 [2024-11-27T02:01:29.882Z] ====================================== 00:06:27.263 [2024-11-27T02:01:29.882Z] busy:2703217629 (cyc) 00:06:27.263 [2024-11-27T02:01:29.882Z] total_run_count: 3831000 00:06:27.263 [2024-11-27T02:01:29.882Z] tsc_hz: 2700000000 (cyc) 00:06:27.263 [2024-11-27T02:01:29.882Z] ====================================== 00:06:27.263 [2024-11-27T02:01:29.882Z] poller_cost: 705 (cyc), 261 (nsec) 00:06:27.263 00:06:27.263 real 0m1.253s 00:06:27.263 user 0m1.158s 00:06:27.263 sys 0m0.088s 00:06:27.263 03:01:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.263 03:01:29 -- common/autotest_common.sh@10 -- # set +x 00:06:27.263 ************************************ 00:06:27.263 END TEST thread_poller_perf 00:06:27.263 ************************************ 00:06:27.263 03:01:29 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:27.263 00:06:27.263 real 0m2.708s 00:06:27.263 user 0m2.458s 00:06:27.263 sys 0m0.255s 00:06:27.263 03:01:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.263 03:01:29 -- common/autotest_common.sh@10 -- # set +x 00:06:27.263 ************************************ 00:06:27.263 END TEST thread 00:06:27.263 ************************************ 00:06:27.264 03:01:29 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:27.264 03:01:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.264 03:01:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.264 03:01:29 -- common/autotest_common.sh@10 -- # set +x 00:06:27.264 ************************************ 00:06:27.264 START TEST accel 00:06:27.264 ************************************ 00:06:27.264 03:01:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:27.264 * Looking for test storage... 00:06:27.264 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:27.264 03:01:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:27.264 03:01:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:27.264 03:01:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:27.264 03:01:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:27.264 03:01:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:27.264 03:01:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:27.264 03:01:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:27.264 03:01:29 -- scripts/common.sh@335 -- # IFS=.-: 00:06:27.264 03:01:29 -- scripts/common.sh@335 -- # read -ra ver1 00:06:27.264 03:01:29 -- scripts/common.sh@336 -- # IFS=.-: 00:06:27.264 03:01:29 -- scripts/common.sh@336 -- # read -ra ver2 00:06:27.264 03:01:29 -- scripts/common.sh@337 -- # local 'op=<' 00:06:27.264 03:01:29 -- scripts/common.sh@339 -- # ver1_l=2 00:06:27.264 03:01:29 -- scripts/common.sh@340 -- # ver2_l=1 00:06:27.264 03:01:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:27.264 03:01:29 -- scripts/common.sh@343 -- # case "$op" in 00:06:27.264 03:01:29 -- scripts/common.sh@344 -- # : 1 00:06:27.264 03:01:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:27.264 03:01:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:27.264 03:01:29 -- scripts/common.sh@364 -- # decimal 1 00:06:27.264 03:01:29 -- scripts/common.sh@352 -- # local d=1 00:06:27.264 03:01:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:27.264 03:01:29 -- scripts/common.sh@354 -- # echo 1 00:06:27.264 03:01:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:27.264 03:01:29 -- scripts/common.sh@365 -- # decimal 2 00:06:27.264 03:01:29 -- scripts/common.sh@352 -- # local d=2 00:06:27.264 03:01:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:27.264 03:01:29 -- scripts/common.sh@354 -- # echo 2 00:06:27.264 03:01:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:27.264 03:01:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:27.264 03:01:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:27.264 03:01:29 -- scripts/common.sh@367 -- # return 0 00:06:27.264 03:01:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:27.264 03:01:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:27.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.264 --rc genhtml_branch_coverage=1 00:06:27.264 --rc genhtml_function_coverage=1 00:06:27.264 --rc genhtml_legend=1 00:06:27.264 --rc geninfo_all_blocks=1 00:06:27.264 --rc geninfo_unexecuted_blocks=1 00:06:27.264 00:06:27.264 ' 00:06:27.264 03:01:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:27.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.264 --rc genhtml_branch_coverage=1 00:06:27.264 --rc genhtml_function_coverage=1 00:06:27.264 --rc genhtml_legend=1 00:06:27.264 --rc geninfo_all_blocks=1 00:06:27.264 --rc geninfo_unexecuted_blocks=1 00:06:27.264 00:06:27.264 ' 00:06:27.264 03:01:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:27.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.264 --rc genhtml_branch_coverage=1 00:06:27.264 --rc genhtml_function_coverage=1 00:06:27.264 --rc genhtml_legend=1 00:06:27.264 --rc geninfo_all_blocks=1 00:06:27.264 --rc geninfo_unexecuted_blocks=1 00:06:27.264 00:06:27.264 ' 00:06:27.264 03:01:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:27.264 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:27.264 --rc genhtml_branch_coverage=1 00:06:27.264 --rc genhtml_function_coverage=1 00:06:27.264 --rc genhtml_legend=1 00:06:27.264 --rc geninfo_all_blocks=1 00:06:27.264 --rc geninfo_unexecuted_blocks=1 00:06:27.264 00:06:27.264 ' 00:06:27.264 03:01:29 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:27.264 03:01:29 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:27.264 03:01:29 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:27.264 03:01:29 -- accel/accel.sh@59 -- # spdk_tgt_pid=2339628 00:06:27.264 03:01:29 -- accel/accel.sh@60 -- # waitforlisten 2339628 00:06:27.264 03:01:29 -- common/autotest_common.sh@829 -- # '[' -z 2339628 ']' 00:06:27.264 03:01:29 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:27.264 03:01:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.264 03:01:29 -- accel/accel.sh@58 -- # build_accel_config 00:06:27.264 03:01:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.264 03:01:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.264 03:01:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.264 03:01:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.264 03:01:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.264 03:01:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.264 03:01:29 -- common/autotest_common.sh@10 -- # set +x 00:06:27.264 03:01:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.264 03:01:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.264 03:01:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.264 03:01:29 -- accel/accel.sh@42 -- # jq -r . 00:06:27.264 [2024-11-27 03:01:29.692356] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.264 [2024-11-27 03:01:29.692438] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339628 ] 00:06:27.264 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.264 [2024-11-27 03:01:29.751447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.264 [2024-11-27 03:01:29.839124] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.264 [2024-11-27 03:01:29.839283] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.198 03:01:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.198 03:01:30 -- common/autotest_common.sh@862 -- # return 0 00:06:28.198 03:01:30 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:28.198 03:01:30 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:28.198 03:01:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.198 03:01:30 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:28.198 03:01:30 -- common/autotest_common.sh@10 -- # set +x 00:06:28.198 03:01:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # IFS== 00:06:28.198 03:01:30 -- accel/accel.sh@64 -- # read -r opc module 00:06:28.198 03:01:30 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:28.198 03:01:30 -- accel/accel.sh@67 -- # killprocess 2339628 00:06:28.198 03:01:30 -- common/autotest_common.sh@936 -- # '[' -z 2339628 ']' 00:06:28.198 03:01:30 -- common/autotest_common.sh@940 -- # kill -0 2339628 00:06:28.198 03:01:30 -- common/autotest_common.sh@941 -- # uname 00:06:28.198 03:01:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:28.198 03:01:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2339628 00:06:28.198 03:01:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:28.198 03:01:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:28.198 03:01:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2339628' 00:06:28.198 killing process with pid 2339628 00:06:28.198 03:01:30 -- common/autotest_common.sh@955 -- # kill 2339628 00:06:28.198 03:01:30 -- common/autotest_common.sh@960 -- # wait 2339628 00:06:28.765 03:01:31 -- accel/accel.sh@68 -- # trap - ERR 00:06:28.765 03:01:31 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:28.765 03:01:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:28.765 03:01:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.765 03:01:31 -- common/autotest_common.sh@10 -- # set +x 00:06:28.765 03:01:31 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:28.765 03:01:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:28.765 03:01:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:28.765 03:01:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.765 03:01:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.765 03:01:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.765 03:01:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.765 03:01:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.765 03:01:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.765 03:01:31 -- accel/accel.sh@42 -- # jq -r . 00:06:28.765 03:01:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:28.765 03:01:31 -- common/autotest_common.sh@10 -- # set +x 00:06:28.765 03:01:31 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:28.765 03:01:31 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:28.765 03:01:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:28.765 03:01:31 -- common/autotest_common.sh@10 -- # set +x 00:06:28.765 ************************************ 00:06:28.765 START TEST accel_missing_filename 00:06:28.765 ************************************ 00:06:28.765 03:01:31 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:28.765 03:01:31 -- common/autotest_common.sh@650 -- # local es=0 00:06:28.765 03:01:31 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:28.765 03:01:31 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:28.765 03:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:28.765 03:01:31 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:28.765 03:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:28.765 03:01:31 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:28.765 03:01:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:28.765 03:01:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:28.765 03:01:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.765 03:01:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.765 03:01:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.765 03:01:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.765 03:01:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.765 03:01:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.765 03:01:31 -- accel/accel.sh@42 -- # jq -r . 00:06:28.765 [2024-11-27 03:01:31.182280] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:28.765 [2024-11-27 03:01:31.182369] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339932 ] 00:06:28.765 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.765 [2024-11-27 03:01:31.241548] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:28.765 [2024-11-27 03:01:31.331829] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.024 [2024-11-27 03:01:31.393728] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:29.024 [2024-11-27 03:01:31.477928] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:29.024 A filename is required. 00:06:29.024 03:01:31 -- common/autotest_common.sh@653 -- # es=234 00:06:29.024 03:01:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.024 03:01:31 -- common/autotest_common.sh@662 -- # es=106 00:06:29.024 03:01:31 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:29.024 03:01:31 -- common/autotest_common.sh@670 -- # es=1 00:06:29.024 03:01:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.024 00:06:29.024 real 0m0.396s 00:06:29.024 user 0m0.288s 00:06:29.024 sys 0m0.142s 00:06:29.024 03:01:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.024 03:01:31 -- common/autotest_common.sh@10 -- # set +x 00:06:29.024 ************************************ 00:06:29.024 END TEST accel_missing_filename 00:06:29.024 ************************************ 00:06:29.024 03:01:31 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.024 03:01:31 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:29.024 03:01:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.024 03:01:31 -- common/autotest_common.sh@10 -- # set +x 00:06:29.024 ************************************ 00:06:29.024 START TEST accel_compress_verify 00:06:29.024 ************************************ 00:06:29.024 03:01:31 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.024 03:01:31 -- common/autotest_common.sh@650 -- # local es=0 00:06:29.024 03:01:31 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.024 03:01:31 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:29.024 03:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.024 03:01:31 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:29.024 03:01:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.024 03:01:31 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.024 03:01:31 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:29.024 03:01:31 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.024 03:01:31 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.024 03:01:31 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.024 03:01:31 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.024 03:01:31 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.024 03:01:31 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.024 03:01:31 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.024 03:01:31 -- accel/accel.sh@42 -- # jq -r . 00:06:29.024 [2024-11-27 03:01:31.602324] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.024 [2024-11-27 03:01:31.602403] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2339952 ] 00:06:29.024 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.282 [2024-11-27 03:01:31.664554] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.282 [2024-11-27 03:01:31.756893] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.282 [2024-11-27 03:01:31.819029] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:29.541 [2024-11-27 03:01:31.906690] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:29.541 00:06:29.541 Compression does not support the verify option, aborting. 00:06:29.541 03:01:31 -- common/autotest_common.sh@653 -- # es=161 00:06:29.541 03:01:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.541 03:01:31 -- common/autotest_common.sh@662 -- # es=33 00:06:29.541 03:01:31 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:29.541 03:01:31 -- common/autotest_common.sh@670 -- # es=1 00:06:29.541 03:01:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.541 00:06:29.541 real 0m0.404s 00:06:29.541 user 0m0.298s 00:06:29.541 sys 0m0.140s 00:06:29.541 03:01:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.541 03:01:31 -- common/autotest_common.sh@10 -- # set +x 00:06:29.541 ************************************ 00:06:29.541 END TEST accel_compress_verify 00:06:29.541 ************************************ 00:06:29.541 03:01:32 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:29.541 03:01:32 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:29.541 03:01:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.541 03:01:32 -- common/autotest_common.sh@10 -- # set +x 00:06:29.541 ************************************ 00:06:29.541 START TEST accel_wrong_workload 00:06:29.541 ************************************ 00:06:29.541 03:01:32 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:29.541 03:01:32 -- common/autotest_common.sh@650 -- # local es=0 00:06:29.541 03:01:32 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:29.541 03:01:32 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:29.541 03:01:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.541 03:01:32 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:29.541 03:01:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.541 03:01:32 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:29.541 03:01:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:29.541 03:01:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.541 03:01:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.541 03:01:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.541 03:01:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.541 03:01:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.541 03:01:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.541 03:01:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.541 03:01:32 -- accel/accel.sh@42 -- # jq -r . 00:06:29.541 Unsupported workload type: foobar 00:06:29.541 [2024-11-27 03:01:32.034363] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:29.541 accel_perf options: 00:06:29.541 [-h help message] 00:06:29.541 [-q queue depth per core] 00:06:29.541 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:29.541 [-T number of threads per core 00:06:29.541 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:29.541 [-t time in seconds] 00:06:29.541 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:29.541 [ dif_verify, , dif_generate, dif_generate_copy 00:06:29.541 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:29.541 [-l for compress/decompress workloads, name of uncompressed input file 00:06:29.541 [-S for crc32c workload, use this seed value (default 0) 00:06:29.541 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:29.541 [-f for fill workload, use this BYTE value (default 255) 00:06:29.541 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:29.541 [-y verify result if this switch is on] 00:06:29.541 [-a tasks to allocate per core (default: same value as -q)] 00:06:29.541 Can be used to spread operations across a wider range of memory. 00:06:29.541 03:01:32 -- common/autotest_common.sh@653 -- # es=1 00:06:29.541 03:01:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.541 03:01:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:29.541 03:01:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.541 00:06:29.541 real 0m0.024s 00:06:29.541 user 0m0.012s 00:06:29.541 sys 0m0.011s 00:06:29.541 03:01:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.541 03:01:32 -- common/autotest_common.sh@10 -- # set +x 00:06:29.541 ************************************ 00:06:29.541 END TEST accel_wrong_workload 00:06:29.541 ************************************ 00:06:29.541 Error: writing output failed: Broken pipe 00:06:29.541 03:01:32 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:29.541 03:01:32 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:29.541 03:01:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.541 03:01:32 -- common/autotest_common.sh@10 -- # set +x 00:06:29.541 ************************************ 00:06:29.541 START TEST accel_negative_buffers 00:06:29.542 ************************************ 00:06:29.542 03:01:32 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:29.542 03:01:32 -- common/autotest_common.sh@650 -- # local es=0 00:06:29.542 03:01:32 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:29.542 03:01:32 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:29.542 03:01:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.542 03:01:32 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:29.542 03:01:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:29.542 03:01:32 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:29.542 03:01:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:29.542 03:01:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.542 03:01:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.542 03:01:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.542 03:01:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.542 03:01:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.542 03:01:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.542 03:01:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.542 03:01:32 -- accel/accel.sh@42 -- # jq -r . 00:06:29.542 -x option must be non-negative. 00:06:29.542 [2024-11-27 03:01:32.079650] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:29.542 accel_perf options: 00:06:29.542 [-h help message] 00:06:29.542 [-q queue depth per core] 00:06:29.542 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:29.542 [-T number of threads per core 00:06:29.542 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:29.542 [-t time in seconds] 00:06:29.542 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:29.542 [ dif_verify, , dif_generate, dif_generate_copy 00:06:29.542 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:29.542 [-l for compress/decompress workloads, name of uncompressed input file 00:06:29.542 [-S for crc32c workload, use this seed value (default 0) 00:06:29.542 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:29.542 [-f for fill workload, use this BYTE value (default 255) 00:06:29.542 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:29.542 [-y verify result if this switch is on] 00:06:29.542 [-a tasks to allocate per core (default: same value as -q)] 00:06:29.542 Can be used to spread operations across a wider range of memory. 00:06:29.542 03:01:32 -- common/autotest_common.sh@653 -- # es=1 00:06:29.542 03:01:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:29.542 03:01:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:29.542 03:01:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:29.542 00:06:29.542 real 0m0.022s 00:06:29.542 user 0m0.015s 00:06:29.542 sys 0m0.007s 00:06:29.542 03:01:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.542 03:01:32 -- common/autotest_common.sh@10 -- # set +x 00:06:29.542 ************************************ 00:06:29.542 END TEST accel_negative_buffers 00:06:29.542 ************************************ 00:06:29.542 Error: writing output failed: Broken pipe 00:06:29.542 03:01:32 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:29.542 03:01:32 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:29.542 03:01:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.542 03:01:32 -- common/autotest_common.sh@10 -- # set +x 00:06:29.542 ************************************ 00:06:29.542 START TEST accel_crc32c 00:06:29.542 ************************************ 00:06:29.542 03:01:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:29.542 03:01:32 -- accel/accel.sh@16 -- # local accel_opc 00:06:29.542 03:01:32 -- accel/accel.sh@17 -- # local accel_module 00:06:29.542 03:01:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:29.542 03:01:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:29.542 03:01:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.542 03:01:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.542 03:01:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.542 03:01:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.542 03:01:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.542 03:01:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.542 03:01:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.542 03:01:32 -- accel/accel.sh@42 -- # jq -r . 00:06:29.542 [2024-11-27 03:01:32.120786] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.542 [2024-11-27 03:01:32.120867] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340058 ] 00:06:29.542 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.800 [2024-11-27 03:01:32.186772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.800 [2024-11-27 03:01:32.281803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.175 03:01:33 -- accel/accel.sh@18 -- # out=' 00:06:31.175 SPDK Configuration: 00:06:31.175 Core mask: 0x1 00:06:31.175 00:06:31.175 Accel Perf Configuration: 00:06:31.175 Workload Type: crc32c 00:06:31.175 CRC-32C seed: 32 00:06:31.175 Transfer size: 4096 bytes 00:06:31.175 Vector count 1 00:06:31.175 Module: software 00:06:31.175 Queue depth: 32 00:06:31.175 Allocate depth: 32 00:06:31.175 # threads/core: 1 00:06:31.175 Run time: 1 seconds 00:06:31.175 Verify: Yes 00:06:31.175 00:06:31.175 Running for 1 seconds... 00:06:31.175 00:06:31.175 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:31.175 ------------------------------------------------------------------------------------ 00:06:31.175 0,0 404832/s 1581 MiB/s 0 0 00:06:31.175 ==================================================================================== 00:06:31.175 Total 404832/s 1581 MiB/s 0 0' 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:31.175 03:01:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.175 03:01:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:31.175 03:01:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.175 03:01:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.175 03:01:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:31.175 03:01:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:31.175 03:01:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:31.175 03:01:33 -- accel/accel.sh@42 -- # jq -r . 00:06:31.175 [2024-11-27 03:01:33.523427] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:31.175 [2024-11-27 03:01:33.523505] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340279 ] 00:06:31.175 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.175 [2024-11-27 03:01:33.585944] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.175 [2024-11-27 03:01:33.674938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val= 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val= 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val=0x1 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val= 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val= 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val=crc32c 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val=32 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val= 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val=software 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@23 -- # accel_module=software 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val=32 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val=32 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val=1 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.175 03:01:33 -- accel/accel.sh@21 -- # val=Yes 00:06:31.175 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.175 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.176 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.176 03:01:33 -- accel/accel.sh@21 -- # val= 00:06:31.176 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.176 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.176 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:31.176 03:01:33 -- accel/accel.sh@21 -- # val= 00:06:31.176 03:01:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.176 03:01:33 -- accel/accel.sh@20 -- # IFS=: 00:06:31.176 03:01:33 -- accel/accel.sh@20 -- # read -r var val 00:06:32.550 03:01:34 -- accel/accel.sh@21 -- # val= 00:06:32.550 03:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # IFS=: 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # read -r var val 00:06:32.550 03:01:34 -- accel/accel.sh@21 -- # val= 00:06:32.550 03:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # IFS=: 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # read -r var val 00:06:32.550 03:01:34 -- accel/accel.sh@21 -- # val= 00:06:32.550 03:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # IFS=: 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # read -r var val 00:06:32.550 03:01:34 -- accel/accel.sh@21 -- # val= 00:06:32.550 03:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # IFS=: 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # read -r var val 00:06:32.550 03:01:34 -- accel/accel.sh@21 -- # val= 00:06:32.550 03:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # IFS=: 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # read -r var val 00:06:32.550 03:01:34 -- accel/accel.sh@21 -- # val= 00:06:32.550 03:01:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # IFS=: 00:06:32.550 03:01:34 -- accel/accel.sh@20 -- # read -r var val 00:06:32.550 03:01:34 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:32.550 03:01:34 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:32.550 03:01:34 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:32.550 00:06:32.550 real 0m2.805s 00:06:32.550 user 0m2.529s 00:06:32.550 sys 0m0.268s 00:06:32.550 03:01:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.550 03:01:34 -- common/autotest_common.sh@10 -- # set +x 00:06:32.550 ************************************ 00:06:32.550 END TEST accel_crc32c 00:06:32.550 ************************************ 00:06:32.550 03:01:34 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:32.550 03:01:34 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:32.550 03:01:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.550 03:01:34 -- common/autotest_common.sh@10 -- # set +x 00:06:32.550 ************************************ 00:06:32.550 START TEST accel_crc32c_C2 00:06:32.550 ************************************ 00:06:32.550 03:01:34 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:32.550 03:01:34 -- accel/accel.sh@16 -- # local accel_opc 00:06:32.550 03:01:34 -- accel/accel.sh@17 -- # local accel_module 00:06:32.550 03:01:34 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:32.550 03:01:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:32.550 03:01:34 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.550 03:01:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.550 03:01:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.550 03:01:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.550 03:01:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.550 03:01:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.550 03:01:34 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.550 03:01:34 -- accel/accel.sh@42 -- # jq -r . 00:06:32.550 [2024-11-27 03:01:34.958259] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:32.550 [2024-11-27 03:01:34.958346] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340433 ] 00:06:32.550 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.550 [2024-11-27 03:01:35.022522] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.550 [2024-11-27 03:01:35.112735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:33.924 03:01:36 -- accel/accel.sh@18 -- # out=' 00:06:33.924 SPDK Configuration: 00:06:33.924 Core mask: 0x1 00:06:33.924 00:06:33.924 Accel Perf Configuration: 00:06:33.924 Workload Type: crc32c 00:06:33.924 CRC-32C seed: 0 00:06:33.924 Transfer size: 4096 bytes 00:06:33.924 Vector count 2 00:06:33.924 Module: software 00:06:33.924 Queue depth: 32 00:06:33.924 Allocate depth: 32 00:06:33.924 # threads/core: 1 00:06:33.924 Run time: 1 seconds 00:06:33.924 Verify: Yes 00:06:33.924 00:06:33.924 Running for 1 seconds... 00:06:33.924 00:06:33.924 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:33.924 ------------------------------------------------------------------------------------ 00:06:33.924 0,0 317088/s 2477 MiB/s 0 0 00:06:33.924 ==================================================================================== 00:06:33.924 Total 317088/s 1238 MiB/s 0 0' 00:06:33.924 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:33.924 03:01:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:33.924 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:33.924 03:01:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:33.924 03:01:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.924 03:01:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.924 03:01:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.924 03:01:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.924 03:01:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.924 03:01:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.924 03:01:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.924 03:01:36 -- accel/accel.sh@42 -- # jq -r . 00:06:33.924 [2024-11-27 03:01:36.366709] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.924 [2024-11-27 03:01:36.366784] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340579 ] 00:06:33.924 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.924 [2024-11-27 03:01:36.430021] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.924 [2024-11-27 03:01:36.520339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val= 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val= 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val=0x1 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val= 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val= 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val=crc32c 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val=0 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val= 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val=software 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@23 -- # accel_module=software 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val=32 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val=32 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val=1 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val=Yes 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val= 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:34.183 03:01:36 -- accel/accel.sh@21 -- # val= 00:06:34.183 03:01:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # IFS=: 00:06:34.183 03:01:36 -- accel/accel.sh@20 -- # read -r var val 00:06:35.556 03:01:37 -- accel/accel.sh@21 -- # val= 00:06:35.556 03:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.556 03:01:37 -- accel/accel.sh@20 -- # IFS=: 00:06:35.556 03:01:37 -- accel/accel.sh@20 -- # read -r var val 00:06:35.556 03:01:37 -- accel/accel.sh@21 -- # val= 00:06:35.556 03:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.556 03:01:37 -- accel/accel.sh@20 -- # IFS=: 00:06:35.556 03:01:37 -- accel/accel.sh@20 -- # read -r var val 00:06:35.556 03:01:37 -- accel/accel.sh@21 -- # val= 00:06:35.556 03:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.556 03:01:37 -- accel/accel.sh@20 -- # IFS=: 00:06:35.556 03:01:37 -- accel/accel.sh@20 -- # read -r var val 00:06:35.556 03:01:37 -- accel/accel.sh@21 -- # val= 00:06:35.556 03:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.556 03:01:37 -- accel/accel.sh@20 -- # IFS=: 00:06:35.557 03:01:37 -- accel/accel.sh@20 -- # read -r var val 00:06:35.557 03:01:37 -- accel/accel.sh@21 -- # val= 00:06:35.557 03:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.557 03:01:37 -- accel/accel.sh@20 -- # IFS=: 00:06:35.557 03:01:37 -- accel/accel.sh@20 -- # read -r var val 00:06:35.557 03:01:37 -- accel/accel.sh@21 -- # val= 00:06:35.557 03:01:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.557 03:01:37 -- accel/accel.sh@20 -- # IFS=: 00:06:35.557 03:01:37 -- accel/accel.sh@20 -- # read -r var val 00:06:35.557 03:01:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:35.557 03:01:37 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:35.557 03:01:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:35.557 00:06:35.557 real 0m2.815s 00:06:35.557 user 0m2.506s 00:06:35.557 sys 0m0.300s 00:06:35.557 03:01:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.557 03:01:37 -- common/autotest_common.sh@10 -- # set +x 00:06:35.557 ************************************ 00:06:35.557 END TEST accel_crc32c_C2 00:06:35.557 ************************************ 00:06:35.557 03:01:37 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:35.557 03:01:37 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:35.557 03:01:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.557 03:01:37 -- common/autotest_common.sh@10 -- # set +x 00:06:35.557 ************************************ 00:06:35.557 START TEST accel_copy 00:06:35.557 ************************************ 00:06:35.557 03:01:37 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:35.557 03:01:37 -- accel/accel.sh@16 -- # local accel_opc 00:06:35.557 03:01:37 -- accel/accel.sh@17 -- # local accel_module 00:06:35.557 03:01:37 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:35.557 03:01:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:35.557 03:01:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:35.557 03:01:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.557 03:01:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.557 03:01:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.557 03:01:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.557 03:01:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.557 03:01:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.557 03:01:37 -- accel/accel.sh@42 -- # jq -r . 00:06:35.557 [2024-11-27 03:01:37.794443] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:35.557 [2024-11-27 03:01:37.794534] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2340768 ] 00:06:35.557 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.557 [2024-11-27 03:01:37.856719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:35.557 [2024-11-27 03:01:37.951448] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.930 03:01:39 -- accel/accel.sh@18 -- # out=' 00:06:36.930 SPDK Configuration: 00:06:36.930 Core mask: 0x1 00:06:36.930 00:06:36.930 Accel Perf Configuration: 00:06:36.930 Workload Type: copy 00:06:36.930 Transfer size: 4096 bytes 00:06:36.930 Vector count 1 00:06:36.930 Module: software 00:06:36.930 Queue depth: 32 00:06:36.930 Allocate depth: 32 00:06:36.930 # threads/core: 1 00:06:36.930 Run time: 1 seconds 00:06:36.930 Verify: Yes 00:06:36.930 00:06:36.930 Running for 1 seconds... 00:06:36.930 00:06:36.930 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:36.930 ------------------------------------------------------------------------------------ 00:06:36.930 0,0 279360/s 1091 MiB/s 0 0 00:06:36.930 ==================================================================================== 00:06:36.930 Total 279360/s 1091 MiB/s 0 0' 00:06:36.930 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.930 03:01:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:36.930 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.930 03:01:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:36.930 03:01:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:36.931 03:01:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:36.931 03:01:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:36.931 03:01:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:36.931 03:01:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:36.931 03:01:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:36.931 03:01:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:36.931 03:01:39 -- accel/accel.sh@42 -- # jq -r . 00:06:36.931 [2024-11-27 03:01:39.188843] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.931 [2024-11-27 03:01:39.188931] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341006 ] 00:06:36.931 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.931 [2024-11-27 03:01:39.252649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.931 [2024-11-27 03:01:39.343336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val= 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val= 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val=0x1 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val= 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val= 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val=copy 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val= 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val=software 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@23 -- # accel_module=software 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val=32 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val=32 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val=1 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val=Yes 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val= 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:36.931 03:01:39 -- accel/accel.sh@21 -- # val= 00:06:36.931 03:01:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # IFS=: 00:06:36.931 03:01:39 -- accel/accel.sh@20 -- # read -r var val 00:06:38.305 03:01:40 -- accel/accel.sh@21 -- # val= 00:06:38.305 03:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # IFS=: 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # read -r var val 00:06:38.305 03:01:40 -- accel/accel.sh@21 -- # val= 00:06:38.305 03:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # IFS=: 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # read -r var val 00:06:38.305 03:01:40 -- accel/accel.sh@21 -- # val= 00:06:38.305 03:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # IFS=: 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # read -r var val 00:06:38.305 03:01:40 -- accel/accel.sh@21 -- # val= 00:06:38.305 03:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # IFS=: 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # read -r var val 00:06:38.305 03:01:40 -- accel/accel.sh@21 -- # val= 00:06:38.305 03:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # IFS=: 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # read -r var val 00:06:38.305 03:01:40 -- accel/accel.sh@21 -- # val= 00:06:38.305 03:01:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # IFS=: 00:06:38.305 03:01:40 -- accel/accel.sh@20 -- # read -r var val 00:06:38.305 03:01:40 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:38.305 03:01:40 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:38.305 03:01:40 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:38.305 00:06:38.305 real 0m2.798s 00:06:38.305 user 0m2.514s 00:06:38.305 sys 0m0.275s 00:06:38.305 03:01:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.305 03:01:40 -- common/autotest_common.sh@10 -- # set +x 00:06:38.305 ************************************ 00:06:38.305 END TEST accel_copy 00:06:38.305 ************************************ 00:06:38.305 03:01:40 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:38.305 03:01:40 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:38.305 03:01:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.305 03:01:40 -- common/autotest_common.sh@10 -- # set +x 00:06:38.305 ************************************ 00:06:38.305 START TEST accel_fill 00:06:38.305 ************************************ 00:06:38.305 03:01:40 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:38.305 03:01:40 -- accel/accel.sh@16 -- # local accel_opc 00:06:38.305 03:01:40 -- accel/accel.sh@17 -- # local accel_module 00:06:38.305 03:01:40 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:38.305 03:01:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:38.305 03:01:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:38.305 03:01:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:38.305 03:01:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:38.305 03:01:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:38.305 03:01:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:38.305 03:01:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:38.305 03:01:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:38.305 03:01:40 -- accel/accel.sh@42 -- # jq -r . 00:06:38.305 [2024-11-27 03:01:40.617947] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:38.305 [2024-11-27 03:01:40.618021] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341160 ] 00:06:38.305 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.305 [2024-11-27 03:01:40.680322] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.305 [2024-11-27 03:01:40.771073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.678 03:01:42 -- accel/accel.sh@18 -- # out=' 00:06:39.678 SPDK Configuration: 00:06:39.678 Core mask: 0x1 00:06:39.678 00:06:39.678 Accel Perf Configuration: 00:06:39.678 Workload Type: fill 00:06:39.678 Fill pattern: 0x80 00:06:39.678 Transfer size: 4096 bytes 00:06:39.678 Vector count 1 00:06:39.678 Module: software 00:06:39.678 Queue depth: 64 00:06:39.678 Allocate depth: 64 00:06:39.678 # threads/core: 1 00:06:39.678 Run time: 1 seconds 00:06:39.678 Verify: Yes 00:06:39.678 00:06:39.678 Running for 1 seconds... 00:06:39.678 00:06:39.678 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:39.678 ------------------------------------------------------------------------------------ 00:06:39.678 0,0 403520/s 1576 MiB/s 0 0 00:06:39.678 ==================================================================================== 00:06:39.678 Total 403520/s 1576 MiB/s 0 0' 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:39.678 03:01:42 -- accel/accel.sh@12 -- # build_accel_config 00:06:39.678 03:01:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:39.678 03:01:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:39.678 03:01:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:39.678 03:01:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:39.678 03:01:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:39.678 03:01:42 -- accel/accel.sh@41 -- # local IFS=, 00:06:39.678 03:01:42 -- accel/accel.sh@42 -- # jq -r . 00:06:39.678 [2024-11-27 03:01:42.022661] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.678 [2024-11-27 03:01:42.022738] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341300 ] 00:06:39.678 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.678 [2024-11-27 03:01:42.085367] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:39.678 [2024-11-27 03:01:42.175830] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val= 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val= 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val=0x1 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val= 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val= 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val=fill 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@24 -- # accel_opc=fill 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val=0x80 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val= 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val=software 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@23 -- # accel_module=software 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val=64 00:06:39.678 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.678 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.678 03:01:42 -- accel/accel.sh@21 -- # val=64 00:06:39.679 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.679 03:01:42 -- accel/accel.sh@21 -- # val=1 00:06:39.679 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.679 03:01:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:39.679 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.679 03:01:42 -- accel/accel.sh@21 -- # val=Yes 00:06:39.679 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.679 03:01:42 -- accel/accel.sh@21 -- # val= 00:06:39.679 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:39.679 03:01:42 -- accel/accel.sh@21 -- # val= 00:06:39.679 03:01:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # IFS=: 00:06:39.679 03:01:42 -- accel/accel.sh@20 -- # read -r var val 00:06:41.098 03:01:43 -- accel/accel.sh@21 -- # val= 00:06:41.098 03:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # IFS=: 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # read -r var val 00:06:41.098 03:01:43 -- accel/accel.sh@21 -- # val= 00:06:41.098 03:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # IFS=: 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # read -r var val 00:06:41.098 03:01:43 -- accel/accel.sh@21 -- # val= 00:06:41.098 03:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # IFS=: 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # read -r var val 00:06:41.098 03:01:43 -- accel/accel.sh@21 -- # val= 00:06:41.098 03:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # IFS=: 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # read -r var val 00:06:41.098 03:01:43 -- accel/accel.sh@21 -- # val= 00:06:41.098 03:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # IFS=: 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # read -r var val 00:06:41.098 03:01:43 -- accel/accel.sh@21 -- # val= 00:06:41.098 03:01:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # IFS=: 00:06:41.098 03:01:43 -- accel/accel.sh@20 -- # read -r var val 00:06:41.098 03:01:43 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:41.098 03:01:43 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:06:41.098 03:01:43 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:41.098 00:06:41.098 real 0m2.812s 00:06:41.098 user 0m2.515s 00:06:41.098 sys 0m0.287s 00:06:41.098 03:01:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.098 03:01:43 -- common/autotest_common.sh@10 -- # set +x 00:06:41.098 ************************************ 00:06:41.098 END TEST accel_fill 00:06:41.098 ************************************ 00:06:41.098 03:01:43 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:06:41.098 03:01:43 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:41.098 03:01:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.098 03:01:43 -- common/autotest_common.sh@10 -- # set +x 00:06:41.098 ************************************ 00:06:41.098 START TEST accel_copy_crc32c 00:06:41.098 ************************************ 00:06:41.098 03:01:43 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:06:41.098 03:01:43 -- accel/accel.sh@16 -- # local accel_opc 00:06:41.098 03:01:43 -- accel/accel.sh@17 -- # local accel_module 00:06:41.098 03:01:43 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:41.098 03:01:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:41.098 03:01:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:41.098 03:01:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:41.098 03:01:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:41.098 03:01:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:41.098 03:01:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:41.098 03:01:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:41.098 03:01:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:41.098 03:01:43 -- accel/accel.sh@42 -- # jq -r . 00:06:41.098 [2024-11-27 03:01:43.453343] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:41.098 [2024-11-27 03:01:43.453419] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341478 ] 00:06:41.098 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.098 [2024-11-27 03:01:43.516998] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:41.098 [2024-11-27 03:01:43.607177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.472 03:01:44 -- accel/accel.sh@18 -- # out=' 00:06:42.472 SPDK Configuration: 00:06:42.472 Core mask: 0x1 00:06:42.472 00:06:42.472 Accel Perf Configuration: 00:06:42.472 Workload Type: copy_crc32c 00:06:42.472 CRC-32C seed: 0 00:06:42.472 Vector size: 4096 bytes 00:06:42.472 Transfer size: 4096 bytes 00:06:42.472 Vector count 1 00:06:42.472 Module: software 00:06:42.472 Queue depth: 32 00:06:42.472 Allocate depth: 32 00:06:42.472 # threads/core: 1 00:06:42.472 Run time: 1 seconds 00:06:42.472 Verify: Yes 00:06:42.472 00:06:42.472 Running for 1 seconds... 00:06:42.472 00:06:42.472 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:42.472 ------------------------------------------------------------------------------------ 00:06:42.472 0,0 222048/s 867 MiB/s 0 0 00:06:42.472 ==================================================================================== 00:06:42.472 Total 222048/s 867 MiB/s 0 0' 00:06:42.472 03:01:44 -- accel/accel.sh@20 -- # IFS=: 00:06:42.472 03:01:44 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:06:42.472 03:01:44 -- accel/accel.sh@20 -- # read -r var val 00:06:42.472 03:01:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:06:42.472 03:01:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:42.472 03:01:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:42.472 03:01:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:42.472 03:01:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:42.472 03:01:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:42.472 03:01:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:42.472 03:01:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:42.472 03:01:44 -- accel/accel.sh@42 -- # jq -r . 00:06:42.472 [2024-11-27 03:01:44.852459] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:42.472 [2024-11-27 03:01:44.852551] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341723 ] 00:06:42.472 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.472 [2024-11-27 03:01:44.912658] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:42.472 [2024-11-27 03:01:44.998503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.472 03:01:45 -- accel/accel.sh@21 -- # val= 00:06:42.472 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.472 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.472 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.472 03:01:45 -- accel/accel.sh@21 -- # val= 00:06:42.472 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.472 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.472 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.472 03:01:45 -- accel/accel.sh@21 -- # val=0x1 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val= 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val= 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val=0 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val= 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val=software 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@23 -- # accel_module=software 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val=32 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val=32 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val=1 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val=Yes 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val= 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:42.473 03:01:45 -- accel/accel.sh@21 -- # val= 00:06:42.473 03:01:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # IFS=: 00:06:42.473 03:01:45 -- accel/accel.sh@20 -- # read -r var val 00:06:43.846 03:01:46 -- accel/accel.sh@21 -- # val= 00:06:43.846 03:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.846 03:01:46 -- accel/accel.sh@20 -- # IFS=: 00:06:43.846 03:01:46 -- accel/accel.sh@20 -- # read -r var val 00:06:43.846 03:01:46 -- accel/accel.sh@21 -- # val= 00:06:43.846 03:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.846 03:01:46 -- accel/accel.sh@20 -- # IFS=: 00:06:43.846 03:01:46 -- accel/accel.sh@20 -- # read -r var val 00:06:43.846 03:01:46 -- accel/accel.sh@21 -- # val= 00:06:43.846 03:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.846 03:01:46 -- accel/accel.sh@20 -- # IFS=: 00:06:43.846 03:01:46 -- accel/accel.sh@20 -- # read -r var val 00:06:43.847 03:01:46 -- accel/accel.sh@21 -- # val= 00:06:43.847 03:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.847 03:01:46 -- accel/accel.sh@20 -- # IFS=: 00:06:43.847 03:01:46 -- accel/accel.sh@20 -- # read -r var val 00:06:43.847 03:01:46 -- accel/accel.sh@21 -- # val= 00:06:43.847 03:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.847 03:01:46 -- accel/accel.sh@20 -- # IFS=: 00:06:43.847 03:01:46 -- accel/accel.sh@20 -- # read -r var val 00:06:43.847 03:01:46 -- accel/accel.sh@21 -- # val= 00:06:43.847 03:01:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:43.847 03:01:46 -- accel/accel.sh@20 -- # IFS=: 00:06:43.847 03:01:46 -- accel/accel.sh@20 -- # read -r var val 00:06:43.847 03:01:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:43.847 03:01:46 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:43.847 03:01:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:43.847 00:06:43.847 real 0m2.791s 00:06:43.847 user 0m2.500s 00:06:43.847 sys 0m0.283s 00:06:43.847 03:01:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:43.847 03:01:46 -- common/autotest_common.sh@10 -- # set +x 00:06:43.847 ************************************ 00:06:43.847 END TEST accel_copy_crc32c 00:06:43.847 ************************************ 00:06:43.847 03:01:46 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:06:43.847 03:01:46 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:43.847 03:01:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:43.847 03:01:46 -- common/autotest_common.sh@10 -- # set +x 00:06:43.847 ************************************ 00:06:43.847 START TEST accel_copy_crc32c_C2 00:06:43.847 ************************************ 00:06:43.847 03:01:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:06:43.847 03:01:46 -- accel/accel.sh@16 -- # local accel_opc 00:06:43.847 03:01:46 -- accel/accel.sh@17 -- # local accel_module 00:06:43.847 03:01:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:43.847 03:01:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:43.847 03:01:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:43.847 03:01:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:43.847 03:01:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:43.847 03:01:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:43.847 03:01:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:43.847 03:01:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:43.847 03:01:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:43.847 03:01:46 -- accel/accel.sh@42 -- # jq -r . 00:06:43.847 [2024-11-27 03:01:46.269651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:43.847 [2024-11-27 03:01:46.269726] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2341888 ] 00:06:43.847 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.847 [2024-11-27 03:01:46.332236] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:43.847 [2024-11-27 03:01:46.422707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.221 03:01:47 -- accel/accel.sh@18 -- # out=' 00:06:45.221 SPDK Configuration: 00:06:45.221 Core mask: 0x1 00:06:45.221 00:06:45.221 Accel Perf Configuration: 00:06:45.221 Workload Type: copy_crc32c 00:06:45.221 CRC-32C seed: 0 00:06:45.221 Vector size: 4096 bytes 00:06:45.221 Transfer size: 8192 bytes 00:06:45.221 Vector count 2 00:06:45.221 Module: software 00:06:45.221 Queue depth: 32 00:06:45.221 Allocate depth: 32 00:06:45.221 # threads/core: 1 00:06:45.221 Run time: 1 seconds 00:06:45.221 Verify: Yes 00:06:45.221 00:06:45.221 Running for 1 seconds... 00:06:45.221 00:06:45.221 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:45.221 ------------------------------------------------------------------------------------ 00:06:45.221 0,0 155488/s 1214 MiB/s 0 0 00:06:45.221 ==================================================================================== 00:06:45.221 Total 155488/s 607 MiB/s 0 0' 00:06:45.221 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.221 03:01:47 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:06:45.221 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.221 03:01:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:06:45.221 03:01:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:45.221 03:01:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:45.221 03:01:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:45.221 03:01:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:45.221 03:01:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:45.221 03:01:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:45.221 03:01:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:45.221 03:01:47 -- accel/accel.sh@42 -- # jq -r . 00:06:45.221 [2024-11-27 03:01:47.674205] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:45.221 [2024-11-27 03:01:47.674285] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2342028 ] 00:06:45.221 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.221 [2024-11-27 03:01:47.736506] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.221 [2024-11-27 03:01:47.826940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val= 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val= 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val=0x1 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val= 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val= 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val=copy_crc32c 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val=0 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val='8192 bytes' 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val= 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val=software 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@23 -- # accel_module=software 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val=32 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val=32 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val=1 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val=Yes 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val= 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:45.480 03:01:47 -- accel/accel.sh@21 -- # val= 00:06:45.480 03:01:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # IFS=: 00:06:45.480 03:01:47 -- accel/accel.sh@20 -- # read -r var val 00:06:46.853 03:01:49 -- accel/accel.sh@21 -- # val= 00:06:46.853 03:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # IFS=: 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # read -r var val 00:06:46.853 03:01:49 -- accel/accel.sh@21 -- # val= 00:06:46.853 03:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # IFS=: 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # read -r var val 00:06:46.853 03:01:49 -- accel/accel.sh@21 -- # val= 00:06:46.853 03:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # IFS=: 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # read -r var val 00:06:46.853 03:01:49 -- accel/accel.sh@21 -- # val= 00:06:46.853 03:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # IFS=: 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # read -r var val 00:06:46.853 03:01:49 -- accel/accel.sh@21 -- # val= 00:06:46.853 03:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # IFS=: 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # read -r var val 00:06:46.853 03:01:49 -- accel/accel.sh@21 -- # val= 00:06:46.853 03:01:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # IFS=: 00:06:46.853 03:01:49 -- accel/accel.sh@20 -- # read -r var val 00:06:46.853 03:01:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:46.853 03:01:49 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:06:46.853 03:01:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:46.853 00:06:46.853 real 0m2.811s 00:06:46.853 user 0m2.514s 00:06:46.853 sys 0m0.289s 00:06:46.853 03:01:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:46.854 03:01:49 -- common/autotest_common.sh@10 -- # set +x 00:06:46.854 ************************************ 00:06:46.854 END TEST accel_copy_crc32c_C2 00:06:46.854 ************************************ 00:06:46.854 03:01:49 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:06:46.854 03:01:49 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:46.854 03:01:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:46.854 03:01:49 -- common/autotest_common.sh@10 -- # set +x 00:06:46.854 ************************************ 00:06:46.854 START TEST accel_dualcast 00:06:46.854 ************************************ 00:06:46.854 03:01:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:06:46.854 03:01:49 -- accel/accel.sh@16 -- # local accel_opc 00:06:46.854 03:01:49 -- accel/accel.sh@17 -- # local accel_module 00:06:46.854 03:01:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:06:46.854 03:01:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:46.854 03:01:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:46.854 03:01:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:46.854 03:01:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:46.854 03:01:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:46.854 03:01:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:46.854 03:01:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:46.854 03:01:49 -- accel/accel.sh@41 -- # local IFS=, 00:06:46.854 03:01:49 -- accel/accel.sh@42 -- # jq -r . 00:06:46.854 [2024-11-27 03:01:49.109243] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:46.854 [2024-11-27 03:01:49.109334] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2342187 ] 00:06:46.854 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.854 [2024-11-27 03:01:49.174659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:46.854 [2024-11-27 03:01:49.268098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.227 03:01:50 -- accel/accel.sh@18 -- # out=' 00:06:48.227 SPDK Configuration: 00:06:48.227 Core mask: 0x1 00:06:48.227 00:06:48.227 Accel Perf Configuration: 00:06:48.227 Workload Type: dualcast 00:06:48.227 Transfer size: 4096 bytes 00:06:48.227 Vector count 1 00:06:48.227 Module: software 00:06:48.227 Queue depth: 32 00:06:48.227 Allocate depth: 32 00:06:48.227 # threads/core: 1 00:06:48.227 Run time: 1 seconds 00:06:48.227 Verify: Yes 00:06:48.227 00:06:48.227 Running for 1 seconds... 00:06:48.227 00:06:48.227 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:48.227 ------------------------------------------------------------------------------------ 00:06:48.227 0,0 303040/s 1183 MiB/s 0 0 00:06:48.227 ==================================================================================== 00:06:48.227 Total 303040/s 1183 MiB/s 0 0' 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:06:48.227 03:01:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:48.227 03:01:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.227 03:01:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.227 03:01:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.227 03:01:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.227 03:01:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.227 03:01:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.227 03:01:50 -- accel/accel.sh@42 -- # jq -r . 00:06:48.227 [2024-11-27 03:01:50.522496] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:48.227 [2024-11-27 03:01:50.522708] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2342448 ] 00:06:48.227 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.227 [2024-11-27 03:01:50.585802] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.227 [2024-11-27 03:01:50.677100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val= 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val= 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val=0x1 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val= 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val= 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val=dualcast 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val= 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val=software 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@23 -- # accel_module=software 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val=32 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val=32 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val=1 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val=Yes 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val= 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:48.227 03:01:50 -- accel/accel.sh@21 -- # val= 00:06:48.227 03:01:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # IFS=: 00:06:48.227 03:01:50 -- accel/accel.sh@20 -- # read -r var val 00:06:49.602 03:01:51 -- accel/accel.sh@21 -- # val= 00:06:49.602 03:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.602 03:01:51 -- accel/accel.sh@21 -- # val= 00:06:49.602 03:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.602 03:01:51 -- accel/accel.sh@21 -- # val= 00:06:49.602 03:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.602 03:01:51 -- accel/accel.sh@21 -- # val= 00:06:49.602 03:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.602 03:01:51 -- accel/accel.sh@21 -- # val= 00:06:49.602 03:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.602 03:01:51 -- accel/accel.sh@21 -- # val= 00:06:49.602 03:01:51 -- accel/accel.sh@22 -- # case "$var" in 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # IFS=: 00:06:49.602 03:01:51 -- accel/accel.sh@20 -- # read -r var val 00:06:49.602 03:01:51 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:49.602 03:01:51 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:49.602 03:01:51 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:49.602 00:06:49.602 real 0m2.803s 00:06:49.602 user 0m2.493s 00:06:49.602 sys 0m0.300s 00:06:49.602 03:01:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:49.602 03:01:51 -- common/autotest_common.sh@10 -- # set +x 00:06:49.602 ************************************ 00:06:49.602 END TEST accel_dualcast 00:06:49.602 ************************************ 00:06:49.602 03:01:51 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:49.602 03:01:51 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:49.602 03:01:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.602 03:01:51 -- common/autotest_common.sh@10 -- # set +x 00:06:49.602 ************************************ 00:06:49.602 START TEST accel_compare 00:06:49.602 ************************************ 00:06:49.602 03:01:51 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:06:49.602 03:01:51 -- accel/accel.sh@16 -- # local accel_opc 00:06:49.602 03:01:51 -- accel/accel.sh@17 -- # local accel_module 00:06:49.602 03:01:51 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:49.602 03:01:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:49.602 03:01:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.602 03:01:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.602 03:01:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.602 03:01:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.602 03:01:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.602 03:01:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.602 03:01:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.602 03:01:51 -- accel/accel.sh@42 -- # jq -r . 00:06:49.602 [2024-11-27 03:01:51.940048] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:49.602 [2024-11-27 03:01:51.940145] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2342609 ] 00:06:49.602 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.602 [2024-11-27 03:01:52.004170] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:49.602 [2024-11-27 03:01:52.093904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.988 03:01:53 -- accel/accel.sh@18 -- # out=' 00:06:50.988 SPDK Configuration: 00:06:50.988 Core mask: 0x1 00:06:50.988 00:06:50.988 Accel Perf Configuration: 00:06:50.988 Workload Type: compare 00:06:50.988 Transfer size: 4096 bytes 00:06:50.988 Vector count 1 00:06:50.988 Module: software 00:06:50.988 Queue depth: 32 00:06:50.988 Allocate depth: 32 00:06:50.988 # threads/core: 1 00:06:50.988 Run time: 1 seconds 00:06:50.988 Verify: Yes 00:06:50.988 00:06:50.988 Running for 1 seconds... 00:06:50.988 00:06:50.988 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:50.988 ------------------------------------------------------------------------------------ 00:06:50.988 0,0 396672/s 1549 MiB/s 0 0 00:06:50.988 ==================================================================================== 00:06:50.988 Total 396672/s 1549 MiB/s 0 0' 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.988 03:01:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:50.988 03:01:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.988 03:01:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.988 03:01:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.988 03:01:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.988 03:01:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.988 03:01:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.988 03:01:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.988 03:01:53 -- accel/accel.sh@42 -- # jq -r . 00:06:50.988 [2024-11-27 03:01:53.342181] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.988 [2024-11-27 03:01:53.342260] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2342753 ] 00:06:50.988 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.988 [2024-11-27 03:01:53.405013] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.988 [2024-11-27 03:01:53.495922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.988 03:01:53 -- accel/accel.sh@21 -- # val= 00:06:50.988 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.988 03:01:53 -- accel/accel.sh@21 -- # val= 00:06:50.988 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.988 03:01:53 -- accel/accel.sh@21 -- # val=0x1 00:06:50.988 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.988 03:01:53 -- accel/accel.sh@21 -- # val= 00:06:50.988 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.988 03:01:53 -- accel/accel.sh@21 -- # val= 00:06:50.988 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.988 03:01:53 -- accel/accel.sh@21 -- # val=compare 00:06:50.988 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.988 03:01:53 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.988 03:01:53 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:50.988 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.988 03:01:53 -- accel/accel.sh@21 -- # val= 00:06:50.988 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.988 03:01:53 -- accel/accel.sh@21 -- # val=software 00:06:50.988 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.988 03:01:53 -- accel/accel.sh@23 -- # accel_module=software 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.988 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.989 03:01:53 -- accel/accel.sh@21 -- # val=32 00:06:50.989 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.989 03:01:53 -- accel/accel.sh@21 -- # val=32 00:06:50.989 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.989 03:01:53 -- accel/accel.sh@21 -- # val=1 00:06:50.989 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.989 03:01:53 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:50.989 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.989 03:01:53 -- accel/accel.sh@21 -- # val=Yes 00:06:50.989 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.989 03:01:53 -- accel/accel.sh@21 -- # val= 00:06:50.989 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:50.989 03:01:53 -- accel/accel.sh@21 -- # val= 00:06:50.989 03:01:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # IFS=: 00:06:50.989 03:01:53 -- accel/accel.sh@20 -- # read -r var val 00:06:52.373 03:01:54 -- accel/accel.sh@21 -- # val= 00:06:52.373 03:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.373 03:01:54 -- accel/accel.sh@21 -- # val= 00:06:52.373 03:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.373 03:01:54 -- accel/accel.sh@21 -- # val= 00:06:52.373 03:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.373 03:01:54 -- accel/accel.sh@21 -- # val= 00:06:52.373 03:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.373 03:01:54 -- accel/accel.sh@21 -- # val= 00:06:52.373 03:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.373 03:01:54 -- accel/accel.sh@21 -- # val= 00:06:52.373 03:01:54 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # IFS=: 00:06:52.373 03:01:54 -- accel/accel.sh@20 -- # read -r var val 00:06:52.373 03:01:54 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:52.373 03:01:54 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:52.373 03:01:54 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:52.373 00:06:52.373 real 0m2.812s 00:06:52.373 user 0m2.503s 00:06:52.373 sys 0m0.300s 00:06:52.373 03:01:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:52.373 03:01:54 -- common/autotest_common.sh@10 -- # set +x 00:06:52.373 ************************************ 00:06:52.373 END TEST accel_compare 00:06:52.373 ************************************ 00:06:52.373 03:01:54 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:52.373 03:01:54 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:52.373 03:01:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:52.373 03:01:54 -- common/autotest_common.sh@10 -- # set +x 00:06:52.373 ************************************ 00:06:52.373 START TEST accel_xor 00:06:52.373 ************************************ 00:06:52.373 03:01:54 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:52.373 03:01:54 -- accel/accel.sh@16 -- # local accel_opc 00:06:52.373 03:01:54 -- accel/accel.sh@17 -- # local accel_module 00:06:52.373 03:01:54 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:52.373 03:01:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:52.373 03:01:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:52.373 03:01:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:52.373 03:01:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:52.373 03:01:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:52.373 03:01:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:52.373 03:01:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:52.373 03:01:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:52.373 03:01:54 -- accel/accel.sh@42 -- # jq -r . 00:06:52.373 [2024-11-27 03:01:54.773609] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:52.373 [2024-11-27 03:01:54.773684] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2342913 ] 00:06:52.373 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.373 [2024-11-27 03:01:54.840678] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.374 [2024-11-27 03:01:54.931540] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:53.755 03:01:56 -- accel/accel.sh@18 -- # out=' 00:06:53.755 SPDK Configuration: 00:06:53.755 Core mask: 0x1 00:06:53.755 00:06:53.755 Accel Perf Configuration: 00:06:53.755 Workload Type: xor 00:06:53.755 Source buffers: 2 00:06:53.755 Transfer size: 4096 bytes 00:06:53.755 Vector count 1 00:06:53.755 Module: software 00:06:53.755 Queue depth: 32 00:06:53.755 Allocate depth: 32 00:06:53.755 # threads/core: 1 00:06:53.755 Run time: 1 seconds 00:06:53.755 Verify: Yes 00:06:53.755 00:06:53.755 Running for 1 seconds... 00:06:53.755 00:06:53.755 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:53.755 ------------------------------------------------------------------------------------ 00:06:53.755 0,0 192672/s 752 MiB/s 0 0 00:06:53.755 ==================================================================================== 00:06:53.755 Total 192672/s 752 MiB/s 0 0' 00:06:53.755 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:53.755 03:01:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:53.755 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:53.755 03:01:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:53.755 03:01:56 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.755 03:01:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.755 03:01:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.755 03:01:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.755 03:01:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.755 03:01:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.755 03:01:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.755 03:01:56 -- accel/accel.sh@42 -- # jq -r . 00:06:53.756 [2024-11-27 03:01:56.181102] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:53.756 [2024-11-27 03:01:56.181182] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2343165 ] 00:06:53.756 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.756 [2024-11-27 03:01:56.244171] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.756 [2024-11-27 03:01:56.333610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val= 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val= 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val=0x1 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val= 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val= 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val=xor 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val=2 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val= 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val=software 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@23 -- # accel_module=software 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val=32 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val=32 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val=1 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val=Yes 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val= 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.016 03:01:56 -- accel/accel.sh@21 -- # val= 00:06:54.016 03:01:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # IFS=: 00:06:54.016 03:01:56 -- accel/accel.sh@20 -- # read -r var val 00:06:54.958 03:01:57 -- accel/accel.sh@21 -- # val= 00:06:54.958 03:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # IFS=: 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # read -r var val 00:06:54.958 03:01:57 -- accel/accel.sh@21 -- # val= 00:06:54.958 03:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # IFS=: 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # read -r var val 00:06:54.958 03:01:57 -- accel/accel.sh@21 -- # val= 00:06:54.958 03:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # IFS=: 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # read -r var val 00:06:54.958 03:01:57 -- accel/accel.sh@21 -- # val= 00:06:54.958 03:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # IFS=: 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # read -r var val 00:06:54.958 03:01:57 -- accel/accel.sh@21 -- # val= 00:06:54.958 03:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # IFS=: 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # read -r var val 00:06:54.958 03:01:57 -- accel/accel.sh@21 -- # val= 00:06:54.958 03:01:57 -- accel/accel.sh@22 -- # case "$var" in 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # IFS=: 00:06:54.958 03:01:57 -- accel/accel.sh@20 -- # read -r var val 00:06:54.958 03:01:57 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:54.958 03:01:57 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:54.958 03:01:57 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:54.958 00:06:54.958 real 0m2.797s 00:06:54.958 user 0m2.494s 00:06:54.958 sys 0m0.294s 00:06:54.958 03:01:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:54.958 03:01:57 -- common/autotest_common.sh@10 -- # set +x 00:06:54.958 ************************************ 00:06:54.958 END TEST accel_xor 00:06:54.958 ************************************ 00:06:54.958 03:01:57 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:54.958 03:01:57 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:54.958 03:01:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:54.958 03:01:57 -- common/autotest_common.sh@10 -- # set +x 00:06:55.219 ************************************ 00:06:55.219 START TEST accel_xor 00:06:55.219 ************************************ 00:06:55.219 03:01:57 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:55.219 03:01:57 -- accel/accel.sh@16 -- # local accel_opc 00:06:55.219 03:01:57 -- accel/accel.sh@17 -- # local accel_module 00:06:55.219 03:01:57 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:55.220 03:01:57 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:55.220 03:01:57 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.220 03:01:57 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.220 03:01:57 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.220 03:01:57 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.220 03:01:57 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.220 03:01:57 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.220 03:01:57 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.220 03:01:57 -- accel/accel.sh@42 -- # jq -r . 00:06:55.220 [2024-11-27 03:01:57.596139] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:55.220 [2024-11-27 03:01:57.596232] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2343335 ] 00:06:55.220 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.220 [2024-11-27 03:01:57.654059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.220 [2024-11-27 03:01:57.744272] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.603 03:01:58 -- accel/accel.sh@18 -- # out=' 00:06:56.603 SPDK Configuration: 00:06:56.603 Core mask: 0x1 00:06:56.603 00:06:56.603 Accel Perf Configuration: 00:06:56.603 Workload Type: xor 00:06:56.603 Source buffers: 3 00:06:56.603 Transfer size: 4096 bytes 00:06:56.603 Vector count 1 00:06:56.603 Module: software 00:06:56.603 Queue depth: 32 00:06:56.603 Allocate depth: 32 00:06:56.603 # threads/core: 1 00:06:56.603 Run time: 1 seconds 00:06:56.603 Verify: Yes 00:06:56.603 00:06:56.603 Running for 1 seconds... 00:06:56.603 00:06:56.603 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:56.603 ------------------------------------------------------------------------------------ 00:06:56.603 0,0 185024/s 722 MiB/s 0 0 00:06:56.603 ==================================================================================== 00:06:56.603 Total 185024/s 722 MiB/s 0 0' 00:06:56.603 03:01:58 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:56.603 03:01:58 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:56.603 03:01:58 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.603 03:01:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.603 03:01:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.603 03:01:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.603 03:01:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.603 03:01:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.603 03:01:58 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.603 03:01:58 -- accel/accel.sh@42 -- # jq -r . 00:06:56.603 [2024-11-27 03:01:58.994005] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:56.603 [2024-11-27 03:01:58.994087] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2343474 ] 00:06:56.603 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.603 [2024-11-27 03:01:59.056723] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.603 [2024-11-27 03:01:59.147843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val= 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val= 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val=0x1 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val= 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val= 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val=xor 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val=3 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val= 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val=software 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@23 -- # accel_module=software 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val=32 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val=32 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val=1 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val=Yes 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.603 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.603 03:01:59 -- accel/accel.sh@21 -- # val= 00:06:56.603 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.604 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.604 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:56.604 03:01:59 -- accel/accel.sh@21 -- # val= 00:06:56.604 03:01:59 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.604 03:01:59 -- accel/accel.sh@20 -- # IFS=: 00:06:56.604 03:01:59 -- accel/accel.sh@20 -- # read -r var val 00:06:57.987 03:02:00 -- accel/accel.sh@21 -- # val= 00:06:57.987 03:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # IFS=: 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # read -r var val 00:06:57.987 03:02:00 -- accel/accel.sh@21 -- # val= 00:06:57.987 03:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # IFS=: 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # read -r var val 00:06:57.987 03:02:00 -- accel/accel.sh@21 -- # val= 00:06:57.987 03:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # IFS=: 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # read -r var val 00:06:57.987 03:02:00 -- accel/accel.sh@21 -- # val= 00:06:57.987 03:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # IFS=: 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # read -r var val 00:06:57.987 03:02:00 -- accel/accel.sh@21 -- # val= 00:06:57.987 03:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # IFS=: 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # read -r var val 00:06:57.987 03:02:00 -- accel/accel.sh@21 -- # val= 00:06:57.987 03:02:00 -- accel/accel.sh@22 -- # case "$var" in 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # IFS=: 00:06:57.987 03:02:00 -- accel/accel.sh@20 -- # read -r var val 00:06:57.987 03:02:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:57.987 03:02:00 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:57.987 03:02:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:57.987 00:06:57.987 real 0m2.803s 00:06:57.987 user 0m2.502s 00:06:57.987 sys 0m0.291s 00:06:57.987 03:02:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:57.987 03:02:00 -- common/autotest_common.sh@10 -- # set +x 00:06:57.987 ************************************ 00:06:57.987 END TEST accel_xor 00:06:57.987 ************************************ 00:06:57.987 03:02:00 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:57.987 03:02:00 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:57.987 03:02:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:57.987 03:02:00 -- common/autotest_common.sh@10 -- # set +x 00:06:57.987 ************************************ 00:06:57.987 START TEST accel_dif_verify 00:06:57.987 ************************************ 00:06:57.987 03:02:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:57.987 03:02:00 -- accel/accel.sh@16 -- # local accel_opc 00:06:57.987 03:02:00 -- accel/accel.sh@17 -- # local accel_module 00:06:57.987 03:02:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:57.987 03:02:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:57.987 03:02:00 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.987 03:02:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.987 03:02:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.987 03:02:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.987 03:02:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.987 03:02:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.987 03:02:00 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.987 03:02:00 -- accel/accel.sh@42 -- # jq -r . 00:06:57.987 [2024-11-27 03:02:00.419984] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:57.987 [2024-11-27 03:02:00.420049] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2343635 ] 00:06:57.987 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.987 [2024-11-27 03:02:00.482157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.987 [2024-11-27 03:02:00.571232] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.372 03:02:01 -- accel/accel.sh@18 -- # out=' 00:06:59.372 SPDK Configuration: 00:06:59.372 Core mask: 0x1 00:06:59.372 00:06:59.372 Accel Perf Configuration: 00:06:59.372 Workload Type: dif_verify 00:06:59.372 Vector size: 4096 bytes 00:06:59.372 Transfer size: 4096 bytes 00:06:59.372 Block size: 512 bytes 00:06:59.372 Metadata size: 8 bytes 00:06:59.372 Vector count 1 00:06:59.372 Module: software 00:06:59.372 Queue depth: 32 00:06:59.372 Allocate depth: 32 00:06:59.372 # threads/core: 1 00:06:59.372 Run time: 1 seconds 00:06:59.372 Verify: No 00:06:59.372 00:06:59.372 Running for 1 seconds... 00:06:59.372 00:06:59.372 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:59.372 ------------------------------------------------------------------------------------ 00:06:59.372 0,0 81440/s 323 MiB/s 0 0 00:06:59.372 ==================================================================================== 00:06:59.372 Total 81440/s 318 MiB/s 0 0' 00:06:59.372 03:02:01 -- accel/accel.sh@20 -- # IFS=: 00:06:59.372 03:02:01 -- accel/accel.sh@20 -- # read -r var val 00:06:59.372 03:02:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:59.372 03:02:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:59.372 03:02:01 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.372 03:02:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.372 03:02:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.372 03:02:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.372 03:02:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.372 03:02:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.372 03:02:01 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.372 03:02:01 -- accel/accel.sh@42 -- # jq -r . 00:06:59.372 [2024-11-27 03:02:01.812405] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:59.372 [2024-11-27 03:02:01.812486] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2343892 ] 00:06:59.372 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.372 [2024-11-27 03:02:01.873479] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.372 [2024-11-27 03:02:01.964383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val= 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val= 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val=0x1 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val= 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val= 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val=dif_verify 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val= 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val=software 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@23 -- # accel_module=software 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val=32 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val=32 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val=1 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val=No 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val= 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:06:59.630 03:02:02 -- accel/accel.sh@21 -- # val= 00:06:59.630 03:02:02 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.630 03:02:02 -- accel/accel.sh@20 -- # IFS=: 00:06:59.631 03:02:02 -- accel/accel.sh@20 -- # read -r var val 00:07:01.012 03:02:03 -- accel/accel.sh@21 -- # val= 00:07:01.012 03:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:01.012 03:02:03 -- accel/accel.sh@21 -- # val= 00:07:01.012 03:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:01.012 03:02:03 -- accel/accel.sh@21 -- # val= 00:07:01.012 03:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:01.012 03:02:03 -- accel/accel.sh@21 -- # val= 00:07:01.012 03:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:01.012 03:02:03 -- accel/accel.sh@21 -- # val= 00:07:01.012 03:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:01.012 03:02:03 -- accel/accel.sh@21 -- # val= 00:07:01.012 03:02:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # IFS=: 00:07:01.012 03:02:03 -- accel/accel.sh@20 -- # read -r var val 00:07:01.012 03:02:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:01.012 03:02:03 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:01.012 03:02:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:01.012 00:07:01.012 real 0m2.787s 00:07:01.012 user 0m2.498s 00:07:01.012 sys 0m0.282s 00:07:01.012 03:02:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:01.012 03:02:03 -- common/autotest_common.sh@10 -- # set +x 00:07:01.012 ************************************ 00:07:01.012 END TEST accel_dif_verify 00:07:01.012 ************************************ 00:07:01.012 03:02:03 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:01.012 03:02:03 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:01.012 03:02:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:01.012 03:02:03 -- common/autotest_common.sh@10 -- # set +x 00:07:01.012 ************************************ 00:07:01.012 START TEST accel_dif_generate 00:07:01.012 ************************************ 00:07:01.012 03:02:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:01.012 03:02:03 -- accel/accel.sh@16 -- # local accel_opc 00:07:01.012 03:02:03 -- accel/accel.sh@17 -- # local accel_module 00:07:01.012 03:02:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:01.012 03:02:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:01.012 03:02:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:01.012 03:02:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:01.012 03:02:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:01.012 03:02:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:01.012 03:02:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:01.012 03:02:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:01.012 03:02:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:01.012 03:02:03 -- accel/accel.sh@42 -- # jq -r . 00:07:01.012 [2024-11-27 03:02:03.234705] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:01.012 [2024-11-27 03:02:03.234776] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2344051 ] 00:07:01.012 EAL: No free 2048 kB hugepages reported on node 1 00:07:01.012 [2024-11-27 03:02:03.296917] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:01.012 [2024-11-27 03:02:03.385919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.394 03:02:04 -- accel/accel.sh@18 -- # out=' 00:07:02.394 SPDK Configuration: 00:07:02.394 Core mask: 0x1 00:07:02.394 00:07:02.394 Accel Perf Configuration: 00:07:02.394 Workload Type: dif_generate 00:07:02.394 Vector size: 4096 bytes 00:07:02.394 Transfer size: 4096 bytes 00:07:02.394 Block size: 512 bytes 00:07:02.394 Metadata size: 8 bytes 00:07:02.394 Vector count 1 00:07:02.394 Module: software 00:07:02.394 Queue depth: 32 00:07:02.394 Allocate depth: 32 00:07:02.394 # threads/core: 1 00:07:02.394 Run time: 1 seconds 00:07:02.394 Verify: No 00:07:02.394 00:07:02.394 Running for 1 seconds... 00:07:02.394 00:07:02.394 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:02.394 ------------------------------------------------------------------------------------ 00:07:02.394 0,0 95744/s 379 MiB/s 0 0 00:07:02.394 ==================================================================================== 00:07:02.394 Total 95744/s 374 MiB/s 0 0' 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:02.394 03:02:04 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.394 03:02:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.394 03:02:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.394 03:02:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.394 03:02:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.394 03:02:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.394 03:02:04 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.394 03:02:04 -- accel/accel.sh@42 -- # jq -r . 00:07:02.394 [2024-11-27 03:02:04.622274] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:02.394 [2024-11-27 03:02:04.622355] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2344201 ] 00:07:02.394 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.394 [2024-11-27 03:02:04.684651] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.394 [2024-11-27 03:02:04.775388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val= 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val= 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val=0x1 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val= 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val= 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val=dif_generate 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val= 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val=software 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@23 -- # accel_module=software 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val=32 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val=32 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val=1 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val=No 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val= 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:02.394 03:02:04 -- accel/accel.sh@21 -- # val= 00:07:02.394 03:02:04 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # IFS=: 00:07:02.394 03:02:04 -- accel/accel.sh@20 -- # read -r var val 00:07:03.777 03:02:06 -- accel/accel.sh@21 -- # val= 00:07:03.777 03:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:03.777 03:02:06 -- accel/accel.sh@21 -- # val= 00:07:03.777 03:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:03.777 03:02:06 -- accel/accel.sh@21 -- # val= 00:07:03.777 03:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:03.777 03:02:06 -- accel/accel.sh@21 -- # val= 00:07:03.777 03:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:03.777 03:02:06 -- accel/accel.sh@21 -- # val= 00:07:03.777 03:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:03.777 03:02:06 -- accel/accel.sh@21 -- # val= 00:07:03.777 03:02:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # IFS=: 00:07:03.777 03:02:06 -- accel/accel.sh@20 -- # read -r var val 00:07:03.777 03:02:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:03.777 03:02:06 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:03.777 03:02:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:03.777 00:07:03.777 real 0m2.797s 00:07:03.777 user 0m2.511s 00:07:03.777 sys 0m0.279s 00:07:03.777 03:02:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:03.777 03:02:06 -- common/autotest_common.sh@10 -- # set +x 00:07:03.777 ************************************ 00:07:03.777 END TEST accel_dif_generate 00:07:03.777 ************************************ 00:07:03.777 03:02:06 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:03.777 03:02:06 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:03.777 03:02:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:03.777 03:02:06 -- common/autotest_common.sh@10 -- # set +x 00:07:03.777 ************************************ 00:07:03.777 START TEST accel_dif_generate_copy 00:07:03.777 ************************************ 00:07:03.777 03:02:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:03.777 03:02:06 -- accel/accel.sh@16 -- # local accel_opc 00:07:03.777 03:02:06 -- accel/accel.sh@17 -- # local accel_module 00:07:03.777 03:02:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:03.777 03:02:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:03.777 03:02:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.777 03:02:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.777 03:02:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.777 03:02:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.777 03:02:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.777 03:02:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.777 03:02:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.777 03:02:06 -- accel/accel.sh@42 -- # jq -r . 00:07:03.777 [2024-11-27 03:02:06.052598] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:03.777 [2024-11-27 03:02:06.052673] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2344356 ] 00:07:03.777 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.777 [2024-11-27 03:02:06.115298] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.777 [2024-11-27 03:02:06.210836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.159 03:02:07 -- accel/accel.sh@18 -- # out=' 00:07:05.159 SPDK Configuration: 00:07:05.159 Core mask: 0x1 00:07:05.159 00:07:05.159 Accel Perf Configuration: 00:07:05.159 Workload Type: dif_generate_copy 00:07:05.159 Vector size: 4096 bytes 00:07:05.159 Transfer size: 4096 bytes 00:07:05.159 Vector count 1 00:07:05.159 Module: software 00:07:05.159 Queue depth: 32 00:07:05.159 Allocate depth: 32 00:07:05.159 # threads/core: 1 00:07:05.159 Run time: 1 seconds 00:07:05.159 Verify: No 00:07:05.159 00:07:05.159 Running for 1 seconds... 00:07:05.159 00:07:05.159 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:05.159 ------------------------------------------------------------------------------------ 00:07:05.159 0,0 76064/s 301 MiB/s 0 0 00:07:05.159 ==================================================================================== 00:07:05.159 Total 76064/s 297 MiB/s 0 0' 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:05.159 03:02:07 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.159 03:02:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.159 03:02:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.159 03:02:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.159 03:02:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.159 03:02:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.159 03:02:07 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.159 03:02:07 -- accel/accel.sh@42 -- # jq -r . 00:07:05.159 [2024-11-27 03:02:07.448702] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.159 [2024-11-27 03:02:07.448783] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2344619 ] 00:07:05.159 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.159 [2024-11-27 03:02:07.510666] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.159 [2024-11-27 03:02:07.601375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val= 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val= 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val=0x1 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val= 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val= 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val= 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val=software 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@23 -- # accel_module=software 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val=32 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val=32 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val=1 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val=No 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val= 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:05.159 03:02:07 -- accel/accel.sh@21 -- # val= 00:07:05.159 03:02:07 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # IFS=: 00:07:05.159 03:02:07 -- accel/accel.sh@20 -- # read -r var val 00:07:06.549 03:02:08 -- accel/accel.sh@21 -- # val= 00:07:06.549 03:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:06.549 03:02:08 -- accel/accel.sh@21 -- # val= 00:07:06.549 03:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:06.549 03:02:08 -- accel/accel.sh@21 -- # val= 00:07:06.549 03:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:06.549 03:02:08 -- accel/accel.sh@21 -- # val= 00:07:06.549 03:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:06.549 03:02:08 -- accel/accel.sh@21 -- # val= 00:07:06.549 03:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:06.549 03:02:08 -- accel/accel.sh@21 -- # val= 00:07:06.549 03:02:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # IFS=: 00:07:06.549 03:02:08 -- accel/accel.sh@20 -- # read -r var val 00:07:06.549 03:02:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:06.549 03:02:08 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:06.549 03:02:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:06.549 00:07:06.549 real 0m2.801s 00:07:06.549 user 0m2.511s 00:07:06.549 sys 0m0.282s 00:07:06.549 03:02:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:06.549 03:02:08 -- common/autotest_common.sh@10 -- # set +x 00:07:06.549 ************************************ 00:07:06.549 END TEST accel_dif_generate_copy 00:07:06.549 ************************************ 00:07:06.549 03:02:08 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:06.549 03:02:08 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.549 03:02:08 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:06.549 03:02:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:06.549 03:02:08 -- common/autotest_common.sh@10 -- # set +x 00:07:06.549 ************************************ 00:07:06.549 START TEST accel_comp 00:07:06.549 ************************************ 00:07:06.549 03:02:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.549 03:02:08 -- accel/accel.sh@16 -- # local accel_opc 00:07:06.549 03:02:08 -- accel/accel.sh@17 -- # local accel_module 00:07:06.549 03:02:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.549 03:02:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:06.549 03:02:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.549 03:02:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.549 03:02:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.549 03:02:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.549 03:02:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.549 03:02:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.549 03:02:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.549 03:02:08 -- accel/accel.sh@42 -- # jq -r . 00:07:06.549 [2024-11-27 03:02:08.879237] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:06.549 [2024-11-27 03:02:08.879303] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2344776 ] 00:07:06.549 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.549 [2024-11-27 03:02:08.943198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.549 [2024-11-27 03:02:09.032258] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.936 03:02:10 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:07.936 00:07:07.936 SPDK Configuration: 00:07:07.936 Core mask: 0x1 00:07:07.936 00:07:07.936 Accel Perf Configuration: 00:07:07.936 Workload Type: compress 00:07:07.936 Transfer size: 4096 bytes 00:07:07.936 Vector count 1 00:07:07.936 Module: software 00:07:07.936 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:07.936 Queue depth: 32 00:07:07.936 Allocate depth: 32 00:07:07.936 # threads/core: 1 00:07:07.936 Run time: 1 seconds 00:07:07.936 Verify: No 00:07:07.936 00:07:07.936 Running for 1 seconds... 00:07:07.936 00:07:07.936 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:07.936 ------------------------------------------------------------------------------------ 00:07:07.936 0,0 31648/s 131 MiB/s 0 0 00:07:07.936 ==================================================================================== 00:07:07.936 Total 31648/s 123 MiB/s 0 0' 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.936 03:02:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.936 03:02:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:07.936 03:02:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.936 03:02:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.936 03:02:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.936 03:02:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.936 03:02:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.936 03:02:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.936 03:02:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.936 03:02:10 -- accel/accel.sh@42 -- # jq -r . 00:07:07.936 [2024-11-27 03:02:10.271238] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:07.936 [2024-11-27 03:02:10.271316] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2344921 ] 00:07:07.936 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.936 [2024-11-27 03:02:10.333839] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.936 [2024-11-27 03:02:10.424045] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:07.936 03:02:10 -- accel/accel.sh@21 -- # val= 00:07:07.936 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.936 03:02:10 -- accel/accel.sh@21 -- # val= 00:07:07.936 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.936 03:02:10 -- accel/accel.sh@21 -- # val= 00:07:07.936 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.936 03:02:10 -- accel/accel.sh@21 -- # val=0x1 00:07:07.936 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.936 03:02:10 -- accel/accel.sh@21 -- # val= 00:07:07.936 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.936 03:02:10 -- accel/accel.sh@21 -- # val= 00:07:07.936 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.936 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.936 03:02:10 -- accel/accel.sh@21 -- # val=compress 00:07:07.936 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.936 03:02:10 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val= 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val=software 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@23 -- # accel_module=software 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val=32 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val=32 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val=1 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val=No 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val= 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:07.937 03:02:10 -- accel/accel.sh@21 -- # val= 00:07:07.937 03:02:10 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # IFS=: 00:07:07.937 03:02:10 -- accel/accel.sh@20 -- # read -r var val 00:07:09.320 03:02:11 -- accel/accel.sh@21 -- # val= 00:07:09.320 03:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.320 03:02:11 -- accel/accel.sh@21 -- # val= 00:07:09.320 03:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.320 03:02:11 -- accel/accel.sh@21 -- # val= 00:07:09.320 03:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.320 03:02:11 -- accel/accel.sh@21 -- # val= 00:07:09.320 03:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.320 03:02:11 -- accel/accel.sh@21 -- # val= 00:07:09.320 03:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.320 03:02:11 -- accel/accel.sh@21 -- # val= 00:07:09.320 03:02:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # IFS=: 00:07:09.320 03:02:11 -- accel/accel.sh@20 -- # read -r var val 00:07:09.320 03:02:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:09.320 03:02:11 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:09.320 03:02:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:09.320 00:07:09.320 real 0m2.801s 00:07:09.320 user 0m2.508s 00:07:09.320 sys 0m0.285s 00:07:09.320 03:02:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:09.320 03:02:11 -- common/autotest_common.sh@10 -- # set +x 00:07:09.320 ************************************ 00:07:09.320 END TEST accel_comp 00:07:09.320 ************************************ 00:07:09.320 03:02:11 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:09.320 03:02:11 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:09.320 03:02:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:09.320 03:02:11 -- common/autotest_common.sh@10 -- # set +x 00:07:09.320 ************************************ 00:07:09.320 START TEST accel_decomp 00:07:09.320 ************************************ 00:07:09.320 03:02:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:09.320 03:02:11 -- accel/accel.sh@16 -- # local accel_opc 00:07:09.320 03:02:11 -- accel/accel.sh@17 -- # local accel_module 00:07:09.320 03:02:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:09.320 03:02:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:09.320 03:02:11 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.320 03:02:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.320 03:02:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.320 03:02:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.320 03:02:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.320 03:02:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.320 03:02:11 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.320 03:02:11 -- accel/accel.sh@42 -- # jq -r . 00:07:09.320 [2024-11-27 03:02:11.706086] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.320 [2024-11-27 03:02:11.706164] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2345083 ] 00:07:09.320 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.320 [2024-11-27 03:02:11.768185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.320 [2024-11-27 03:02:11.858559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.704 03:02:13 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:10.704 00:07:10.704 SPDK Configuration: 00:07:10.704 Core mask: 0x1 00:07:10.704 00:07:10.704 Accel Perf Configuration: 00:07:10.704 Workload Type: decompress 00:07:10.704 Transfer size: 4096 bytes 00:07:10.704 Vector count 1 00:07:10.704 Module: software 00:07:10.704 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.704 Queue depth: 32 00:07:10.704 Allocate depth: 32 00:07:10.704 # threads/core: 1 00:07:10.704 Run time: 1 seconds 00:07:10.704 Verify: Yes 00:07:10.704 00:07:10.704 Running for 1 seconds... 00:07:10.704 00:07:10.704 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:10.704 ------------------------------------------------------------------------------------ 00:07:10.704 0,0 55360/s 102 MiB/s 0 0 00:07:10.704 ==================================================================================== 00:07:10.704 Total 55360/s 216 MiB/s 0 0' 00:07:10.704 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.704 03:02:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:10.704 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.704 03:02:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:10.704 03:02:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.704 03:02:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.704 03:02:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.705 03:02:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.705 03:02:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.705 03:02:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.705 03:02:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.705 03:02:13 -- accel/accel.sh@42 -- # jq -r . 00:07:10.705 [2024-11-27 03:02:13.099781] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:10.705 [2024-11-27 03:02:13.099871] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2345341 ] 00:07:10.705 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.705 [2024-11-27 03:02:13.163160] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.705 [2024-11-27 03:02:13.253360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:10.705 03:02:13 -- accel/accel.sh@21 -- # val= 00:07:10.705 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.705 03:02:13 -- accel/accel.sh@21 -- # val= 00:07:10.705 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.705 03:02:13 -- accel/accel.sh@21 -- # val= 00:07:10.705 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.705 03:02:13 -- accel/accel.sh@21 -- # val=0x1 00:07:10.705 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.705 03:02:13 -- accel/accel.sh@21 -- # val= 00:07:10.705 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.705 03:02:13 -- accel/accel.sh@21 -- # val= 00:07:10.705 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.705 03:02:13 -- accel/accel.sh@21 -- # val=decompress 00:07:10.705 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.705 03:02:13 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.705 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.705 03:02:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val= 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val=software 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@23 -- # accel_module=software 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val=32 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val=32 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val=1 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val=Yes 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val= 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:10.964 03:02:13 -- accel/accel.sh@21 -- # val= 00:07:10.964 03:02:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # IFS=: 00:07:10.964 03:02:13 -- accel/accel.sh@20 -- # read -r var val 00:07:11.905 03:02:14 -- accel/accel.sh@21 -- # val= 00:07:11.905 03:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # IFS=: 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # read -r var val 00:07:11.905 03:02:14 -- accel/accel.sh@21 -- # val= 00:07:11.905 03:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # IFS=: 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # read -r var val 00:07:11.905 03:02:14 -- accel/accel.sh@21 -- # val= 00:07:11.905 03:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # IFS=: 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # read -r var val 00:07:11.905 03:02:14 -- accel/accel.sh@21 -- # val= 00:07:11.905 03:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # IFS=: 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # read -r var val 00:07:11.905 03:02:14 -- accel/accel.sh@21 -- # val= 00:07:11.905 03:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # IFS=: 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # read -r var val 00:07:11.905 03:02:14 -- accel/accel.sh@21 -- # val= 00:07:11.905 03:02:14 -- accel/accel.sh@22 -- # case "$var" in 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # IFS=: 00:07:11.905 03:02:14 -- accel/accel.sh@20 -- # read -r var val 00:07:11.905 03:02:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:11.905 03:02:14 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:11.905 03:02:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:11.905 00:07:11.905 real 0m2.803s 00:07:11.905 user 0m2.500s 00:07:11.905 sys 0m0.296s 00:07:11.905 03:02:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:11.905 03:02:14 -- common/autotest_common.sh@10 -- # set +x 00:07:11.905 ************************************ 00:07:11.905 END TEST accel_decomp 00:07:11.905 ************************************ 00:07:11.905 03:02:14 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:11.905 03:02:14 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:11.905 03:02:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.905 03:02:14 -- common/autotest_common.sh@10 -- # set +x 00:07:11.905 ************************************ 00:07:11.905 START TEST accel_decmop_full 00:07:11.905 ************************************ 00:07:11.905 03:02:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:11.905 03:02:14 -- accel/accel.sh@16 -- # local accel_opc 00:07:11.905 03:02:14 -- accel/accel.sh@17 -- # local accel_module 00:07:11.905 03:02:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:11.905 03:02:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:11.905 03:02:14 -- accel/accel.sh@12 -- # build_accel_config 00:07:11.905 03:02:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:11.905 03:02:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:11.905 03:02:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:11.905 03:02:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:11.905 03:02:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:11.905 03:02:14 -- accel/accel.sh@41 -- # local IFS=, 00:07:11.905 03:02:14 -- accel/accel.sh@42 -- # jq -r . 00:07:12.164 [2024-11-27 03:02:14.531986] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:12.164 [2024-11-27 03:02:14.532062] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2345502 ] 00:07:12.164 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.164 [2024-11-27 03:02:14.594578] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.164 [2024-11-27 03:02:14.684061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.577 03:02:15 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:13.577 00:07:13.577 SPDK Configuration: 00:07:13.577 Core mask: 0x1 00:07:13.577 00:07:13.577 Accel Perf Configuration: 00:07:13.577 Workload Type: decompress 00:07:13.577 Transfer size: 111250 bytes 00:07:13.577 Vector count 1 00:07:13.577 Module: software 00:07:13.577 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.577 Queue depth: 32 00:07:13.577 Allocate depth: 32 00:07:13.577 # threads/core: 1 00:07:13.577 Run time: 1 seconds 00:07:13.577 Verify: Yes 00:07:13.577 00:07:13.577 Running for 1 seconds... 00:07:13.577 00:07:13.577 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:13.577 ------------------------------------------------------------------------------------ 00:07:13.577 0,0 3808/s 157 MiB/s 0 0 00:07:13.577 ==================================================================================== 00:07:13.577 Total 3808/s 404 MiB/s 0 0' 00:07:13.577 03:02:15 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:13.577 03:02:15 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:13.577 03:02:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.577 03:02:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.577 03:02:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.577 03:02:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.577 03:02:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.577 03:02:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.577 03:02:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.577 03:02:15 -- accel/accel.sh@42 -- # jq -r . 00:07:13.577 [2024-11-27 03:02:15.940784] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:13.577 [2024-11-27 03:02:15.940865] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2345649 ] 00:07:13.577 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.577 [2024-11-27 03:02:16.001189] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.577 [2024-11-27 03:02:16.094732] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val= 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val= 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val= 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val=0x1 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val= 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val= 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val=decompress 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val= 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val=software 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@23 -- # accel_module=software 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val=32 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val=32 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val=1 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val=Yes 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val= 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:13.577 03:02:16 -- accel/accel.sh@21 -- # val= 00:07:13.577 03:02:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # IFS=: 00:07:13.577 03:02:16 -- accel/accel.sh@20 -- # read -r var val 00:07:14.954 03:02:17 -- accel/accel.sh@21 -- # val= 00:07:14.954 03:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # IFS=: 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # read -r var val 00:07:14.954 03:02:17 -- accel/accel.sh@21 -- # val= 00:07:14.954 03:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # IFS=: 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # read -r var val 00:07:14.954 03:02:17 -- accel/accel.sh@21 -- # val= 00:07:14.954 03:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # IFS=: 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # read -r var val 00:07:14.954 03:02:17 -- accel/accel.sh@21 -- # val= 00:07:14.954 03:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # IFS=: 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # read -r var val 00:07:14.954 03:02:17 -- accel/accel.sh@21 -- # val= 00:07:14.954 03:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # IFS=: 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # read -r var val 00:07:14.954 03:02:17 -- accel/accel.sh@21 -- # val= 00:07:14.954 03:02:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # IFS=: 00:07:14.954 03:02:17 -- accel/accel.sh@20 -- # read -r var val 00:07:14.954 03:02:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:14.954 03:02:17 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:14.954 03:02:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:14.954 00:07:14.954 real 0m2.839s 00:07:14.954 user 0m2.551s 00:07:14.954 sys 0m0.282s 00:07:14.954 03:02:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:14.954 03:02:17 -- common/autotest_common.sh@10 -- # set +x 00:07:14.954 ************************************ 00:07:14.954 END TEST accel_decmop_full 00:07:14.954 ************************************ 00:07:14.954 03:02:17 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:14.954 03:02:17 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:14.954 03:02:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:14.954 03:02:17 -- common/autotest_common.sh@10 -- # set +x 00:07:14.954 ************************************ 00:07:14.954 START TEST accel_decomp_mcore 00:07:14.954 ************************************ 00:07:14.954 03:02:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:14.954 03:02:17 -- accel/accel.sh@16 -- # local accel_opc 00:07:14.954 03:02:17 -- accel/accel.sh@17 -- # local accel_module 00:07:14.954 03:02:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:14.954 03:02:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:14.954 03:02:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.954 03:02:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.954 03:02:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.954 03:02:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.954 03:02:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.954 03:02:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.954 03:02:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.954 03:02:17 -- accel/accel.sh@42 -- # jq -r . 00:07:14.954 [2024-11-27 03:02:17.395190] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:14.954 [2024-11-27 03:02:17.395272] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2345803 ] 00:07:14.954 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.954 [2024-11-27 03:02:17.460699] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:14.955 [2024-11-27 03:02:17.559826] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:14.955 [2024-11-27 03:02:17.559892] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:14.955 [2024-11-27 03:02:17.559917] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:14.955 [2024-11-27 03:02:17.559920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.335 03:02:18 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:16.335 00:07:16.335 SPDK Configuration: 00:07:16.335 Core mask: 0xf 00:07:16.335 00:07:16.335 Accel Perf Configuration: 00:07:16.335 Workload Type: decompress 00:07:16.335 Transfer size: 4096 bytes 00:07:16.335 Vector count 1 00:07:16.335 Module: software 00:07:16.335 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:16.335 Queue depth: 32 00:07:16.335 Allocate depth: 32 00:07:16.335 # threads/core: 1 00:07:16.335 Run time: 1 seconds 00:07:16.335 Verify: Yes 00:07:16.335 00:07:16.335 Running for 1 seconds... 00:07:16.335 00:07:16.335 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:16.335 ------------------------------------------------------------------------------------ 00:07:16.335 0,0 50208/s 92 MiB/s 0 0 00:07:16.335 3,0 50496/s 93 MiB/s 0 0 00:07:16.335 2,0 50432/s 92 MiB/s 0 0 00:07:16.335 1,0 50336/s 92 MiB/s 0 0 00:07:16.335 ==================================================================================== 00:07:16.335 Total 201472/s 787 MiB/s 0 0' 00:07:16.335 03:02:18 -- accel/accel.sh@20 -- # IFS=: 00:07:16.335 03:02:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:16.335 03:02:18 -- accel/accel.sh@20 -- # read -r var val 00:07:16.335 03:02:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:16.335 03:02:18 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.335 03:02:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.335 03:02:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.335 03:02:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.335 03:02:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.335 03:02:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.335 03:02:18 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.335 03:02:18 -- accel/accel.sh@42 -- # jq -r . 00:07:16.335 [2024-11-27 03:02:18.814769] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:16.335 [2024-11-27 03:02:18.814860] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2346071 ] 00:07:16.335 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.335 [2024-11-27 03:02:18.878203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:16.595 [2024-11-27 03:02:18.977485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:16.595 [2024-11-27 03:02:18.977585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:16.595 [2024-11-27 03:02:18.977588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:16.595 [2024-11-27 03:02:18.977553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val= 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val= 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val= 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val=0xf 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val= 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val= 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val=decompress 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val= 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val=software 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@23 -- # accel_module=software 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val=32 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val=32 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val=1 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val=Yes 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val= 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:16.595 03:02:19 -- accel/accel.sh@21 -- # val= 00:07:16.595 03:02:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # IFS=: 00:07:16.595 03:02:19 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@21 -- # val= 00:07:17.979 03:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@21 -- # val= 00:07:17.979 03:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@21 -- # val= 00:07:17.979 03:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@21 -- # val= 00:07:17.979 03:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@21 -- # val= 00:07:17.979 03:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@21 -- # val= 00:07:17.979 03:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@21 -- # val= 00:07:17.979 03:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@21 -- # val= 00:07:17.979 03:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@21 -- # val= 00:07:17.979 03:02:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # IFS=: 00:07:17.979 03:02:20 -- accel/accel.sh@20 -- # read -r var val 00:07:17.979 03:02:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:17.979 03:02:20 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:17.979 03:02:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:17.979 00:07:17.979 real 0m2.849s 00:07:17.979 user 0m9.449s 00:07:17.979 sys 0m0.306s 00:07:17.979 03:02:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.979 03:02:20 -- common/autotest_common.sh@10 -- # set +x 00:07:17.979 ************************************ 00:07:17.979 END TEST accel_decomp_mcore 00:07:17.979 ************************************ 00:07:17.979 03:02:20 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:17.979 03:02:20 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:17.979 03:02:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.979 03:02:20 -- common/autotest_common.sh@10 -- # set +x 00:07:17.979 ************************************ 00:07:17.979 START TEST accel_decomp_full_mcore 00:07:17.979 ************************************ 00:07:17.979 03:02:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:17.979 03:02:20 -- accel/accel.sh@16 -- # local accel_opc 00:07:17.979 03:02:20 -- accel/accel.sh@17 -- # local accel_module 00:07:17.979 03:02:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:17.979 03:02:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:17.979 03:02:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.979 03:02:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.979 03:02:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.979 03:02:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.979 03:02:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.979 03:02:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.979 03:02:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.979 03:02:20 -- accel/accel.sh@42 -- # jq -r . 00:07:17.979 [2024-11-27 03:02:20.275556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.979 [2024-11-27 03:02:20.275652] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2346227 ] 00:07:17.979 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.979 [2024-11-27 03:02:20.340791] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:17.979 [2024-11-27 03:02:20.441769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:17.979 [2024-11-27 03:02:20.441844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:17.979 [2024-11-27 03:02:20.441847] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.979 [2024-11-27 03:02:20.441797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:19.368 03:02:21 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:19.368 00:07:19.368 SPDK Configuration: 00:07:19.368 Core mask: 0xf 00:07:19.368 00:07:19.368 Accel Perf Configuration: 00:07:19.368 Workload Type: decompress 00:07:19.368 Transfer size: 111250 bytes 00:07:19.368 Vector count 1 00:07:19.368 Module: software 00:07:19.368 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:19.368 Queue depth: 32 00:07:19.368 Allocate depth: 32 00:07:19.368 # threads/core: 1 00:07:19.368 Run time: 1 seconds 00:07:19.368 Verify: Yes 00:07:19.368 00:07:19.368 Running for 1 seconds... 00:07:19.368 00:07:19.368 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:19.368 ------------------------------------------------------------------------------------ 00:07:19.368 0,0 3776/s 155 MiB/s 0 0 00:07:19.368 3,0 3776/s 155 MiB/s 0 0 00:07:19.368 2,0 3776/s 155 MiB/s 0 0 00:07:19.368 1,0 3776/s 155 MiB/s 0 0 00:07:19.368 ==================================================================================== 00:07:19.368 Total 15104/s 1602 MiB/s 0 0' 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.368 03:02:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:19.368 03:02:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:19.368 03:02:21 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.368 03:02:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.368 03:02:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.368 03:02:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.368 03:02:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.368 03:02:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.368 03:02:21 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.368 03:02:21 -- accel/accel.sh@42 -- # jq -r . 00:07:19.368 [2024-11-27 03:02:21.701225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:19.368 [2024-11-27 03:02:21.701306] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2346385 ] 00:07:19.368 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.368 [2024-11-27 03:02:21.763461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:19.368 [2024-11-27 03:02:21.860179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:19.368 [2024-11-27 03:02:21.860237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:19.368 [2024-11-27 03:02:21.860288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:19.368 [2024-11-27 03:02:21.860291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:19.368 03:02:21 -- accel/accel.sh@21 -- # val= 00:07:19.368 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.368 03:02:21 -- accel/accel.sh@21 -- # val= 00:07:19.368 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.368 03:02:21 -- accel/accel.sh@21 -- # val= 00:07:19.368 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.368 03:02:21 -- accel/accel.sh@21 -- # val=0xf 00:07:19.368 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.368 03:02:21 -- accel/accel.sh@21 -- # val= 00:07:19.368 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.368 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.368 03:02:21 -- accel/accel.sh@21 -- # val= 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val=decompress 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val= 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val=software 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@23 -- # accel_module=software 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val=32 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val=32 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val=1 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val=Yes 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val= 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:19.369 03:02:21 -- accel/accel.sh@21 -- # val= 00:07:19.369 03:02:21 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # IFS=: 00:07:19.369 03:02:21 -- accel/accel.sh@20 -- # read -r var val 00:07:20.759 03:02:23 -- accel/accel.sh@21 -- # val= 00:07:20.759 03:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.759 03:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.759 03:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.759 03:02:23 -- accel/accel.sh@21 -- # val= 00:07:20.759 03:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.759 03:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.759 03:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.759 03:02:23 -- accel/accel.sh@21 -- # val= 00:07:20.759 03:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.759 03:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.759 03:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.759 03:02:23 -- accel/accel.sh@21 -- # val= 00:07:20.759 03:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.759 03:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.760 03:02:23 -- accel/accel.sh@21 -- # val= 00:07:20.760 03:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.760 03:02:23 -- accel/accel.sh@21 -- # val= 00:07:20.760 03:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.760 03:02:23 -- accel/accel.sh@21 -- # val= 00:07:20.760 03:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.760 03:02:23 -- accel/accel.sh@21 -- # val= 00:07:20.760 03:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.760 03:02:23 -- accel/accel.sh@21 -- # val= 00:07:20.760 03:02:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # IFS=: 00:07:20.760 03:02:23 -- accel/accel.sh@20 -- # read -r var val 00:07:20.760 03:02:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:20.760 03:02:23 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:20.760 03:02:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:20.760 00:07:20.760 real 0m2.873s 00:07:20.760 user 0m9.562s 00:07:20.760 sys 0m0.296s 00:07:20.760 03:02:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:20.760 03:02:23 -- common/autotest_common.sh@10 -- # set +x 00:07:20.760 ************************************ 00:07:20.760 END TEST accel_decomp_full_mcore 00:07:20.760 ************************************ 00:07:20.760 03:02:23 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:20.760 03:02:23 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:20.760 03:02:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:20.760 03:02:23 -- common/autotest_common.sh@10 -- # set +x 00:07:20.760 ************************************ 00:07:20.760 START TEST accel_decomp_mthread 00:07:20.760 ************************************ 00:07:20.760 03:02:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:20.760 03:02:23 -- accel/accel.sh@16 -- # local accel_opc 00:07:20.760 03:02:23 -- accel/accel.sh@17 -- # local accel_module 00:07:20.760 03:02:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:20.760 03:02:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:20.760 03:02:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.760 03:02:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.760 03:02:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.760 03:02:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.760 03:02:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.760 03:02:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.760 03:02:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.760 03:02:23 -- accel/accel.sh@42 -- # jq -r . 00:07:20.760 [2024-11-27 03:02:23.173833] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.760 [2024-11-27 03:02:23.173915] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2346543 ] 00:07:20.760 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.760 [2024-11-27 03:02:23.237512] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.760 [2024-11-27 03:02:23.330752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.141 03:02:24 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:22.141 00:07:22.141 SPDK Configuration: 00:07:22.141 Core mask: 0x1 00:07:22.141 00:07:22.141 Accel Perf Configuration: 00:07:22.141 Workload Type: decompress 00:07:22.141 Transfer size: 4096 bytes 00:07:22.141 Vector count 1 00:07:22.141 Module: software 00:07:22.141 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:22.141 Queue depth: 32 00:07:22.141 Allocate depth: 32 00:07:22.141 # threads/core: 2 00:07:22.141 Run time: 1 seconds 00:07:22.141 Verify: Yes 00:07:22.141 00:07:22.141 Running for 1 seconds... 00:07:22.141 00:07:22.141 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:22.141 ------------------------------------------------------------------------------------ 00:07:22.141 0,1 28032/s 51 MiB/s 0 0 00:07:22.141 0,0 27936/s 51 MiB/s 0 0 00:07:22.141 ==================================================================================== 00:07:22.141 Total 55968/s 218 MiB/s 0 0' 00:07:22.141 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.141 03:02:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:22.141 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.141 03:02:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:22.141 03:02:24 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.141 03:02:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.141 03:02:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.141 03:02:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.141 03:02:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.141 03:02:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.141 03:02:24 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.141 03:02:24 -- accel/accel.sh@42 -- # jq -r . 00:07:22.141 [2024-11-27 03:02:24.594614] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:22.141 [2024-11-27 03:02:24.594699] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2346802 ] 00:07:22.141 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.141 [2024-11-27 03:02:24.656817] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.141 [2024-11-27 03:02:24.750329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:22.400 03:02:24 -- accel/accel.sh@21 -- # val= 00:07:22.400 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.400 03:02:24 -- accel/accel.sh@21 -- # val= 00:07:22.400 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.400 03:02:24 -- accel/accel.sh@21 -- # val= 00:07:22.400 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.400 03:02:24 -- accel/accel.sh@21 -- # val=0x1 00:07:22.400 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.400 03:02:24 -- accel/accel.sh@21 -- # val= 00:07:22.400 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.400 03:02:24 -- accel/accel.sh@21 -- # val= 00:07:22.400 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.400 03:02:24 -- accel/accel.sh@21 -- # val=decompress 00:07:22.400 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.400 03:02:24 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.400 03:02:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:22.400 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.400 03:02:24 -- accel/accel.sh@21 -- # val= 00:07:22.400 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.400 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.401 03:02:24 -- accel/accel.sh@21 -- # val=software 00:07:22.401 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.401 03:02:24 -- accel/accel.sh@23 -- # accel_module=software 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.401 03:02:24 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:22.401 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.401 03:02:24 -- accel/accel.sh@21 -- # val=32 00:07:22.401 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.401 03:02:24 -- accel/accel.sh@21 -- # val=32 00:07:22.401 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.401 03:02:24 -- accel/accel.sh@21 -- # val=2 00:07:22.401 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.401 03:02:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:22.401 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.401 03:02:24 -- accel/accel.sh@21 -- # val=Yes 00:07:22.401 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.401 03:02:24 -- accel/accel.sh@21 -- # val= 00:07:22.401 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:22.401 03:02:24 -- accel/accel.sh@21 -- # val= 00:07:22.401 03:02:24 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # IFS=: 00:07:22.401 03:02:24 -- accel/accel.sh@20 -- # read -r var val 00:07:23.783 03:02:25 -- accel/accel.sh@21 -- # val= 00:07:23.783 03:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:23.783 03:02:25 -- accel/accel.sh@21 -- # val= 00:07:23.783 03:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:23.783 03:02:25 -- accel/accel.sh@21 -- # val= 00:07:23.783 03:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:23.783 03:02:25 -- accel/accel.sh@21 -- # val= 00:07:23.783 03:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:23.783 03:02:25 -- accel/accel.sh@21 -- # val= 00:07:23.783 03:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:23.783 03:02:25 -- accel/accel.sh@21 -- # val= 00:07:23.783 03:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:23.783 03:02:25 -- accel/accel.sh@21 -- # val= 00:07:23.783 03:02:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # IFS=: 00:07:23.783 03:02:25 -- accel/accel.sh@20 -- # read -r var val 00:07:23.783 03:02:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:23.783 03:02:25 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:23.783 03:02:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:23.783 00:07:23.783 real 0m2.845s 00:07:23.783 user 0m2.549s 00:07:23.783 sys 0m0.289s 00:07:23.783 03:02:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:23.783 03:02:25 -- common/autotest_common.sh@10 -- # set +x 00:07:23.783 ************************************ 00:07:23.783 END TEST accel_decomp_mthread 00:07:23.783 ************************************ 00:07:23.783 03:02:26 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.783 03:02:26 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:23.783 03:02:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.783 03:02:26 -- common/autotest_common.sh@10 -- # set +x 00:07:23.783 ************************************ 00:07:23.783 START TEST accel_deomp_full_mthread 00:07:23.783 ************************************ 00:07:23.783 03:02:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.783 03:02:26 -- accel/accel.sh@16 -- # local accel_opc 00:07:23.783 03:02:26 -- accel/accel.sh@17 -- # local accel_module 00:07:23.783 03:02:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.783 03:02:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:23.783 03:02:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.783 03:02:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.783 03:02:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.783 03:02:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.783 03:02:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.783 03:02:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.783 03:02:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.783 03:02:26 -- accel/accel.sh@42 -- # jq -r . 00:07:23.783 [2024-11-27 03:02:26.045465] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:23.783 [2024-11-27 03:02:26.045557] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2346961 ] 00:07:23.783 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.783 [2024-11-27 03:02:26.108614] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.783 [2024-11-27 03:02:26.205450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.164 03:02:27 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:25.164 00:07:25.164 SPDK Configuration: 00:07:25.164 Core mask: 0x1 00:07:25.164 00:07:25.164 Accel Perf Configuration: 00:07:25.164 Workload Type: decompress 00:07:25.164 Transfer size: 111250 bytes 00:07:25.164 Vector count 1 00:07:25.164 Module: software 00:07:25.164 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.164 Queue depth: 32 00:07:25.164 Allocate depth: 32 00:07:25.164 # threads/core: 2 00:07:25.164 Run time: 1 seconds 00:07:25.164 Verify: Yes 00:07:25.164 00:07:25.164 Running for 1 seconds... 00:07:25.165 00:07:25.165 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:25.165 ------------------------------------------------------------------------------------ 00:07:25.165 0,1 1952/s 80 MiB/s 0 0 00:07:25.165 0,0 1952/s 80 MiB/s 0 0 00:07:25.165 ==================================================================================== 00:07:25.165 Total 3904/s 414 MiB/s 0 0' 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:25.165 03:02:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:25.165 03:02:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:25.165 03:02:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:25.165 03:02:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:25.165 03:02:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:25.165 03:02:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:25.165 03:02:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:25.165 03:02:27 -- accel/accel.sh@42 -- # jq -r . 00:07:25.165 [2024-11-27 03:02:27.490989] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:25.165 [2024-11-27 03:02:27.491072] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2347110 ] 00:07:25.165 EAL: No free 2048 kB hugepages reported on node 1 00:07:25.165 [2024-11-27 03:02:27.552774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:25.165 [2024-11-27 03:02:27.646694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val= 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val= 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val= 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val=0x1 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val= 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val= 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val=decompress 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val= 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val=software 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@23 -- # accel_module=software 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val=32 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val=32 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val=2 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val=Yes 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val= 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:25.165 03:02:27 -- accel/accel.sh@21 -- # val= 00:07:25.165 03:02:27 -- accel/accel.sh@22 -- # case "$var" in 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # IFS=: 00:07:25.165 03:02:27 -- accel/accel.sh@20 -- # read -r var val 00:07:26.548 03:02:28 -- accel/accel.sh@21 -- # val= 00:07:26.548 03:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:26.548 03:02:28 -- accel/accel.sh@21 -- # val= 00:07:26.548 03:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:26.548 03:02:28 -- accel/accel.sh@21 -- # val= 00:07:26.548 03:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:26.548 03:02:28 -- accel/accel.sh@21 -- # val= 00:07:26.548 03:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:26.548 03:02:28 -- accel/accel.sh@21 -- # val= 00:07:26.548 03:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:26.548 03:02:28 -- accel/accel.sh@21 -- # val= 00:07:26.548 03:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:26.548 03:02:28 -- accel/accel.sh@21 -- # val= 00:07:26.548 03:02:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # IFS=: 00:07:26.548 03:02:28 -- accel/accel.sh@20 -- # read -r var val 00:07:26.548 03:02:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:26.548 03:02:28 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:26.548 03:02:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:26.548 00:07:26.548 real 0m2.896s 00:07:26.548 user 0m2.606s 00:07:26.548 sys 0m0.283s 00:07:26.548 03:02:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:26.548 03:02:28 -- common/autotest_common.sh@10 -- # set +x 00:07:26.548 ************************************ 00:07:26.548 END TEST accel_deomp_full_mthread 00:07:26.548 ************************************ 00:07:26.548 03:02:28 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:26.548 03:02:28 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:26.548 03:02:28 -- accel/accel.sh@129 -- # build_accel_config 00:07:26.548 03:02:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.548 03:02:28 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:26.548 03:02:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:26.548 03:02:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.548 03:02:28 -- common/autotest_common.sh@10 -- # set +x 00:07:26.548 03:02:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.548 03:02:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.548 03:02:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.548 03:02:28 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.548 03:02:28 -- accel/accel.sh@42 -- # jq -r . 00:07:26.548 ************************************ 00:07:26.548 START TEST accel_dif_functional_tests 00:07:26.548 ************************************ 00:07:26.548 03:02:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:26.548 [2024-11-27 03:02:28.990327] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:26.548 [2024-11-27 03:02:28.990400] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2347340 ] 00:07:26.548 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.548 [2024-11-27 03:02:29.053235] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:26.549 [2024-11-27 03:02:29.150343] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:26.549 [2024-11-27 03:02:29.150397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:26.549 [2024-11-27 03:02:29.150400] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.809 00:07:26.809 00:07:26.809 CUnit - A unit testing framework for C - Version 2.1-3 00:07:26.809 http://cunit.sourceforge.net/ 00:07:26.809 00:07:26.809 00:07:26.809 Suite: accel_dif 00:07:26.809 Test: verify: DIF generated, GUARD check ...passed 00:07:26.809 Test: verify: DIF generated, APPTAG check ...passed 00:07:26.809 Test: verify: DIF generated, REFTAG check ...passed 00:07:26.809 Test: verify: DIF not generated, GUARD check ...[2024-11-27 03:02:29.249876] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:26.809 [2024-11-27 03:02:29.249946] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:26.809 passed 00:07:26.809 Test: verify: DIF not generated, APPTAG check ...[2024-11-27 03:02:29.249990] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:26.809 [2024-11-27 03:02:29.250021] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:26.809 passed 00:07:26.809 Test: verify: DIF not generated, REFTAG check ...[2024-11-27 03:02:29.250055] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:26.809 [2024-11-27 03:02:29.250083] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:26.809 passed 00:07:26.809 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:26.809 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-27 03:02:29.250149] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:26.809 passed 00:07:26.809 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:26.809 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:26.809 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:26.809 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-27 03:02:29.250310] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:26.809 passed 00:07:26.809 Test: generate copy: DIF generated, GUARD check ...passed 00:07:26.809 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:26.809 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:26.809 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:26.809 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:26.809 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:26.809 Test: generate copy: iovecs-len validate ...[2024-11-27 03:02:29.250610] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:26.809 passed 00:07:26.809 Test: generate copy: buffer alignment validate ...passed 00:07:26.809 00:07:26.809 Run Summary: Type Total Ran Passed Failed Inactive 00:07:26.809 suites 1 1 n/a 0 0 00:07:26.809 tests 20 20 20 0 0 00:07:26.809 asserts 204 204 204 0 n/a 00:07:26.809 00:07:26.809 Elapsed time = 0.003 seconds 00:07:27.068 00:07:27.068 real 0m0.522s 00:07:27.068 user 0m0.821s 00:07:27.068 sys 0m0.188s 00:07:27.068 03:02:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.068 03:02:29 -- common/autotest_common.sh@10 -- # set +x 00:07:27.068 ************************************ 00:07:27.068 END TEST accel_dif_functional_tests 00:07:27.068 ************************************ 00:07:27.068 00:07:27.068 real 0m59.992s 00:07:27.068 user 1m7.858s 00:07:27.068 sys 0m7.211s 00:07:27.068 03:02:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.068 03:02:29 -- common/autotest_common.sh@10 -- # set +x 00:07:27.068 ************************************ 00:07:27.068 END TEST accel 00:07:27.068 ************************************ 00:07:27.068 03:02:29 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:27.068 03:02:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:27.068 03:02:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.068 03:02:29 -- common/autotest_common.sh@10 -- # set +x 00:07:27.068 ************************************ 00:07:27.068 START TEST accel_rpc 00:07:27.068 ************************************ 00:07:27.068 03:02:29 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:27.068 * Looking for test storage... 00:07:27.068 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:27.068 03:02:29 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:27.068 03:02:29 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:27.068 03:02:29 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:27.068 03:02:29 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:27.068 03:02:29 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:27.068 03:02:29 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:27.068 03:02:29 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:27.068 03:02:29 -- scripts/common.sh@335 -- # IFS=.-: 00:07:27.068 03:02:29 -- scripts/common.sh@335 -- # read -ra ver1 00:07:27.068 03:02:29 -- scripts/common.sh@336 -- # IFS=.-: 00:07:27.068 03:02:29 -- scripts/common.sh@336 -- # read -ra ver2 00:07:27.068 03:02:29 -- scripts/common.sh@337 -- # local 'op=<' 00:07:27.068 03:02:29 -- scripts/common.sh@339 -- # ver1_l=2 00:07:27.068 03:02:29 -- scripts/common.sh@340 -- # ver2_l=1 00:07:27.068 03:02:29 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:27.068 03:02:29 -- scripts/common.sh@343 -- # case "$op" in 00:07:27.068 03:02:29 -- scripts/common.sh@344 -- # : 1 00:07:27.068 03:02:29 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:27.068 03:02:29 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:27.068 03:02:29 -- scripts/common.sh@364 -- # decimal 1 00:07:27.068 03:02:29 -- scripts/common.sh@352 -- # local d=1 00:07:27.068 03:02:29 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:27.068 03:02:29 -- scripts/common.sh@354 -- # echo 1 00:07:27.068 03:02:29 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:27.068 03:02:29 -- scripts/common.sh@365 -- # decimal 2 00:07:27.068 03:02:29 -- scripts/common.sh@352 -- # local d=2 00:07:27.068 03:02:29 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:27.068 03:02:29 -- scripts/common.sh@354 -- # echo 2 00:07:27.068 03:02:29 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:27.068 03:02:29 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:27.068 03:02:29 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:27.068 03:02:29 -- scripts/common.sh@367 -- # return 0 00:07:27.068 03:02:29 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:27.068 03:02:29 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:27.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.068 --rc genhtml_branch_coverage=1 00:07:27.068 --rc genhtml_function_coverage=1 00:07:27.068 --rc genhtml_legend=1 00:07:27.068 --rc geninfo_all_blocks=1 00:07:27.068 --rc geninfo_unexecuted_blocks=1 00:07:27.068 00:07:27.068 ' 00:07:27.068 03:02:29 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:27.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.068 --rc genhtml_branch_coverage=1 00:07:27.068 --rc genhtml_function_coverage=1 00:07:27.068 --rc genhtml_legend=1 00:07:27.068 --rc geninfo_all_blocks=1 00:07:27.068 --rc geninfo_unexecuted_blocks=1 00:07:27.068 00:07:27.068 ' 00:07:27.068 03:02:29 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:27.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.068 --rc genhtml_branch_coverage=1 00:07:27.068 --rc genhtml_function_coverage=1 00:07:27.068 --rc genhtml_legend=1 00:07:27.068 --rc geninfo_all_blocks=1 00:07:27.068 --rc geninfo_unexecuted_blocks=1 00:07:27.068 00:07:27.068 ' 00:07:27.068 03:02:29 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:27.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:27.068 --rc genhtml_branch_coverage=1 00:07:27.068 --rc genhtml_function_coverage=1 00:07:27.068 --rc genhtml_legend=1 00:07:27.068 --rc geninfo_all_blocks=1 00:07:27.068 --rc geninfo_unexecuted_blocks=1 00:07:27.068 00:07:27.068 ' 00:07:27.068 03:02:29 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:27.068 03:02:29 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2347463 00:07:27.068 03:02:29 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:27.068 03:02:29 -- accel/accel_rpc.sh@15 -- # waitforlisten 2347463 00:07:27.068 03:02:29 -- common/autotest_common.sh@829 -- # '[' -z 2347463 ']' 00:07:27.068 03:02:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:27.068 03:02:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:27.068 03:02:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:27.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:27.068 03:02:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:27.068 03:02:29 -- common/autotest_common.sh@10 -- # set +x 00:07:27.328 [2024-11-27 03:02:29.706783] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:27.328 [2024-11-27 03:02:29.706908] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2347463 ] 00:07:27.328 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.328 [2024-11-27 03:02:29.766284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.328 [2024-11-27 03:02:29.847953] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:27.328 [2024-11-27 03:02:29.848110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:27.328 03:02:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:27.328 03:02:29 -- common/autotest_common.sh@862 -- # return 0 00:07:27.328 03:02:29 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:27.328 03:02:29 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:27.328 03:02:29 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:27.328 03:02:29 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:27.328 03:02:29 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:27.328 03:02:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:27.328 03:02:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.328 03:02:29 -- common/autotest_common.sh@10 -- # set +x 00:07:27.328 ************************************ 00:07:27.328 START TEST accel_assign_opcode 00:07:27.328 ************************************ 00:07:27.328 03:02:29 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:27.328 03:02:29 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:27.328 03:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.328 03:02:29 -- common/autotest_common.sh@10 -- # set +x 00:07:27.328 [2024-11-27 03:02:29.912652] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:27.328 03:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.328 03:02:29 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:27.328 03:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.328 03:02:29 -- common/autotest_common.sh@10 -- # set +x 00:07:27.328 [2024-11-27 03:02:29.920672] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:27.328 03:02:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.328 03:02:29 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:27.328 03:02:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.328 03:02:29 -- common/autotest_common.sh@10 -- # set +x 00:07:27.588 03:02:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.588 03:02:30 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:27.588 03:02:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:27.588 03:02:30 -- common/autotest_common.sh@10 -- # set +x 00:07:27.588 03:02:30 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:27.588 03:02:30 -- accel/accel_rpc.sh@42 -- # grep software 00:07:27.588 03:02:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:27.848 software 00:07:27.848 00:07:27.848 real 0m0.314s 00:07:27.848 user 0m0.038s 00:07:27.848 sys 0m0.008s 00:07:27.848 03:02:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.848 03:02:30 -- common/autotest_common.sh@10 -- # set +x 00:07:27.848 ************************************ 00:07:27.848 END TEST accel_assign_opcode 00:07:27.848 ************************************ 00:07:27.848 03:02:30 -- accel/accel_rpc.sh@55 -- # killprocess 2347463 00:07:27.848 03:02:30 -- common/autotest_common.sh@936 -- # '[' -z 2347463 ']' 00:07:27.848 03:02:30 -- common/autotest_common.sh@940 -- # kill -0 2347463 00:07:27.848 03:02:30 -- common/autotest_common.sh@941 -- # uname 00:07:27.848 03:02:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:27.848 03:02:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2347463 00:07:27.849 03:02:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:27.849 03:02:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:27.849 03:02:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2347463' 00:07:27.849 killing process with pid 2347463 00:07:27.849 03:02:30 -- common/autotest_common.sh@955 -- # kill 2347463 00:07:27.849 03:02:30 -- common/autotest_common.sh@960 -- # wait 2347463 00:07:28.109 00:07:28.109 real 0m1.180s 00:07:28.109 user 0m1.082s 00:07:28.109 sys 0m0.432s 00:07:28.109 03:02:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:28.109 03:02:30 -- common/autotest_common.sh@10 -- # set +x 00:07:28.109 ************************************ 00:07:28.109 END TEST accel_rpc 00:07:28.109 ************************************ 00:07:28.368 03:02:30 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:28.368 03:02:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:28.368 03:02:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:28.368 03:02:30 -- common/autotest_common.sh@10 -- # set +x 00:07:28.368 ************************************ 00:07:28.368 START TEST app_cmdline 00:07:28.368 ************************************ 00:07:28.368 03:02:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:28.368 * Looking for test storage... 00:07:28.368 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:28.368 03:02:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:28.368 03:02:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:28.368 03:02:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:28.368 03:02:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:28.368 03:02:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:28.368 03:02:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:28.368 03:02:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:28.368 03:02:30 -- scripts/common.sh@335 -- # IFS=.-: 00:07:28.368 03:02:30 -- scripts/common.sh@335 -- # read -ra ver1 00:07:28.368 03:02:30 -- scripts/common.sh@336 -- # IFS=.-: 00:07:28.368 03:02:30 -- scripts/common.sh@336 -- # read -ra ver2 00:07:28.368 03:02:30 -- scripts/common.sh@337 -- # local 'op=<' 00:07:28.368 03:02:30 -- scripts/common.sh@339 -- # ver1_l=2 00:07:28.368 03:02:30 -- scripts/common.sh@340 -- # ver2_l=1 00:07:28.368 03:02:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:28.368 03:02:30 -- scripts/common.sh@343 -- # case "$op" in 00:07:28.368 03:02:30 -- scripts/common.sh@344 -- # : 1 00:07:28.368 03:02:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:28.368 03:02:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:28.368 03:02:30 -- scripts/common.sh@364 -- # decimal 1 00:07:28.368 03:02:30 -- scripts/common.sh@352 -- # local d=1 00:07:28.368 03:02:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:28.368 03:02:30 -- scripts/common.sh@354 -- # echo 1 00:07:28.368 03:02:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:28.368 03:02:30 -- scripts/common.sh@365 -- # decimal 2 00:07:28.368 03:02:30 -- scripts/common.sh@352 -- # local d=2 00:07:28.368 03:02:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:28.368 03:02:30 -- scripts/common.sh@354 -- # echo 2 00:07:28.368 03:02:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:28.368 03:02:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:28.368 03:02:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:28.368 03:02:30 -- scripts/common.sh@367 -- # return 0 00:07:28.368 03:02:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:28.368 03:02:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:28.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.368 --rc genhtml_branch_coverage=1 00:07:28.368 --rc genhtml_function_coverage=1 00:07:28.368 --rc genhtml_legend=1 00:07:28.368 --rc geninfo_all_blocks=1 00:07:28.368 --rc geninfo_unexecuted_blocks=1 00:07:28.368 00:07:28.368 ' 00:07:28.368 03:02:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:28.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.368 --rc genhtml_branch_coverage=1 00:07:28.368 --rc genhtml_function_coverage=1 00:07:28.368 --rc genhtml_legend=1 00:07:28.368 --rc geninfo_all_blocks=1 00:07:28.368 --rc geninfo_unexecuted_blocks=1 00:07:28.368 00:07:28.368 ' 00:07:28.368 03:02:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:28.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.369 --rc genhtml_branch_coverage=1 00:07:28.369 --rc genhtml_function_coverage=1 00:07:28.369 --rc genhtml_legend=1 00:07:28.369 --rc geninfo_all_blocks=1 00:07:28.369 --rc geninfo_unexecuted_blocks=1 00:07:28.369 00:07:28.369 ' 00:07:28.369 03:02:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:28.369 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:28.369 --rc genhtml_branch_coverage=1 00:07:28.369 --rc genhtml_function_coverage=1 00:07:28.369 --rc genhtml_legend=1 00:07:28.369 --rc geninfo_all_blocks=1 00:07:28.369 --rc geninfo_unexecuted_blocks=1 00:07:28.369 00:07:28.369 ' 00:07:28.369 03:02:30 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:28.369 03:02:30 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2347684 00:07:28.369 03:02:30 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:28.369 03:02:30 -- app/cmdline.sh@18 -- # waitforlisten 2347684 00:07:28.369 03:02:30 -- common/autotest_common.sh@829 -- # '[' -z 2347684 ']' 00:07:28.369 03:02:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:28.369 03:02:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:28.369 03:02:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:28.369 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:28.369 03:02:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:28.369 03:02:30 -- common/autotest_common.sh@10 -- # set +x 00:07:28.369 [2024-11-27 03:02:30.913642] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:28.369 [2024-11-27 03:02:30.913743] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2347684 ] 00:07:28.369 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.369 [2024-11-27 03:02:30.974787] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.627 [2024-11-27 03:02:31.061999] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:28.627 [2024-11-27 03:02:31.062167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.567 03:02:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:29.567 03:02:31 -- common/autotest_common.sh@862 -- # return 0 00:07:29.567 03:02:31 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:29.567 { 00:07:29.567 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:29.567 "fields": { 00:07:29.567 "major": 24, 00:07:29.567 "minor": 1, 00:07:29.567 "patch": 1, 00:07:29.567 "suffix": "-pre", 00:07:29.567 "commit": "c13c99a5e" 00:07:29.567 } 00:07:29.567 } 00:07:29.567 03:02:32 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:29.567 03:02:32 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:29.567 03:02:32 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:29.567 03:02:32 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:29.567 03:02:32 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:29.567 03:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:29.567 03:02:32 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:29.567 03:02:32 -- common/autotest_common.sh@10 -- # set +x 00:07:29.567 03:02:32 -- app/cmdline.sh@26 -- # sort 00:07:29.567 03:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:29.567 03:02:32 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:29.567 03:02:32 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:29.567 03:02:32 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:29.567 03:02:32 -- common/autotest_common.sh@650 -- # local es=0 00:07:29.567 03:02:32 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:29.568 03:02:32 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.568 03:02:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:29.568 03:02:32 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.568 03:02:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:29.568 03:02:32 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.568 03:02:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:29.568 03:02:32 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:29.568 03:02:32 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:29.568 03:02:32 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:29.828 request: 00:07:29.828 { 00:07:29.828 "method": "env_dpdk_get_mem_stats", 00:07:29.828 "req_id": 1 00:07:29.828 } 00:07:29.828 Got JSON-RPC error response 00:07:29.828 response: 00:07:29.828 { 00:07:29.828 "code": -32601, 00:07:29.828 "message": "Method not found" 00:07:29.828 } 00:07:29.828 03:02:32 -- common/autotest_common.sh@653 -- # es=1 00:07:29.828 03:02:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:29.828 03:02:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:29.828 03:02:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:29.828 03:02:32 -- app/cmdline.sh@1 -- # killprocess 2347684 00:07:29.828 03:02:32 -- common/autotest_common.sh@936 -- # '[' -z 2347684 ']' 00:07:29.828 03:02:32 -- common/autotest_common.sh@940 -- # kill -0 2347684 00:07:29.828 03:02:32 -- common/autotest_common.sh@941 -- # uname 00:07:29.828 03:02:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:29.828 03:02:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2347684 00:07:30.088 03:02:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:30.088 03:02:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:30.088 03:02:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2347684' 00:07:30.088 killing process with pid 2347684 00:07:30.088 03:02:32 -- common/autotest_common.sh@955 -- # kill 2347684 00:07:30.088 03:02:32 -- common/autotest_common.sh@960 -- # wait 2347684 00:07:30.348 00:07:30.348 real 0m2.174s 00:07:30.348 user 0m2.703s 00:07:30.348 sys 0m0.535s 00:07:30.348 03:02:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.348 03:02:32 -- common/autotest_common.sh@10 -- # set +x 00:07:30.348 ************************************ 00:07:30.348 END TEST app_cmdline 00:07:30.348 ************************************ 00:07:30.348 03:02:32 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:30.348 03:02:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:30.348 03:02:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.348 03:02:32 -- common/autotest_common.sh@10 -- # set +x 00:07:30.348 ************************************ 00:07:30.348 START TEST version 00:07:30.348 ************************************ 00:07:30.348 03:02:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:30.642 * Looking for test storage... 00:07:30.642 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:30.642 03:02:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.642 03:02:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.642 03:02:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.642 03:02:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.642 03:02:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.642 03:02:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.642 03:02:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.643 03:02:33 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.643 03:02:33 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.643 03:02:33 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.643 03:02:33 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.643 03:02:33 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.643 03:02:33 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.643 03:02:33 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.643 03:02:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.643 03:02:33 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.643 03:02:33 -- scripts/common.sh@344 -- # : 1 00:07:30.643 03:02:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.643 03:02:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.643 03:02:33 -- scripts/common.sh@364 -- # decimal 1 00:07:30.643 03:02:33 -- scripts/common.sh@352 -- # local d=1 00:07:30.643 03:02:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.643 03:02:33 -- scripts/common.sh@354 -- # echo 1 00:07:30.643 03:02:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.643 03:02:33 -- scripts/common.sh@365 -- # decimal 2 00:07:30.643 03:02:33 -- scripts/common.sh@352 -- # local d=2 00:07:30.643 03:02:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.643 03:02:33 -- scripts/common.sh@354 -- # echo 2 00:07:30.643 03:02:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.643 03:02:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.643 03:02:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.643 03:02:33 -- scripts/common.sh@367 -- # return 0 00:07:30.643 03:02:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.643 03:02:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.643 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.643 --rc genhtml_branch_coverage=1 00:07:30.643 --rc genhtml_function_coverage=1 00:07:30.643 --rc genhtml_legend=1 00:07:30.643 --rc geninfo_all_blocks=1 00:07:30.643 --rc geninfo_unexecuted_blocks=1 00:07:30.643 00:07:30.643 ' 00:07:30.643 03:02:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.643 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.643 --rc genhtml_branch_coverage=1 00:07:30.643 --rc genhtml_function_coverage=1 00:07:30.643 --rc genhtml_legend=1 00:07:30.643 --rc geninfo_all_blocks=1 00:07:30.643 --rc geninfo_unexecuted_blocks=1 00:07:30.643 00:07:30.643 ' 00:07:30.643 03:02:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.643 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.643 --rc genhtml_branch_coverage=1 00:07:30.643 --rc genhtml_function_coverage=1 00:07:30.643 --rc genhtml_legend=1 00:07:30.643 --rc geninfo_all_blocks=1 00:07:30.643 --rc geninfo_unexecuted_blocks=1 00:07:30.643 00:07:30.643 ' 00:07:30.643 03:02:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.643 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.643 --rc genhtml_branch_coverage=1 00:07:30.643 --rc genhtml_function_coverage=1 00:07:30.643 --rc genhtml_legend=1 00:07:30.643 --rc geninfo_all_blocks=1 00:07:30.643 --rc geninfo_unexecuted_blocks=1 00:07:30.643 00:07:30.643 ' 00:07:30.643 03:02:33 -- app/version.sh@17 -- # get_header_version major 00:07:30.643 03:02:33 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.643 03:02:33 -- app/version.sh@14 -- # cut -f2 00:07:30.643 03:02:33 -- app/version.sh@14 -- # tr -d '"' 00:07:30.643 03:02:33 -- app/version.sh@17 -- # major=24 00:07:30.643 03:02:33 -- app/version.sh@18 -- # get_header_version minor 00:07:30.643 03:02:33 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.643 03:02:33 -- app/version.sh@14 -- # cut -f2 00:07:30.643 03:02:33 -- app/version.sh@14 -- # tr -d '"' 00:07:30.643 03:02:33 -- app/version.sh@18 -- # minor=1 00:07:30.643 03:02:33 -- app/version.sh@19 -- # get_header_version patch 00:07:30.643 03:02:33 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.643 03:02:33 -- app/version.sh@14 -- # cut -f2 00:07:30.643 03:02:33 -- app/version.sh@14 -- # tr -d '"' 00:07:30.643 03:02:33 -- app/version.sh@19 -- # patch=1 00:07:30.643 03:02:33 -- app/version.sh@20 -- # get_header_version suffix 00:07:30.643 03:02:33 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:30.643 03:02:33 -- app/version.sh@14 -- # cut -f2 00:07:30.643 03:02:33 -- app/version.sh@14 -- # tr -d '"' 00:07:30.643 03:02:33 -- app/version.sh@20 -- # suffix=-pre 00:07:30.643 03:02:33 -- app/version.sh@22 -- # version=24.1 00:07:30.643 03:02:33 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:30.643 03:02:33 -- app/version.sh@25 -- # version=24.1.1 00:07:30.643 03:02:33 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:30.643 03:02:33 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:30.643 03:02:33 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:30.643 03:02:33 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:30.643 03:02:33 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:30.643 00:07:30.643 real 0m0.191s 00:07:30.643 user 0m0.126s 00:07:30.643 sys 0m0.091s 00:07:30.643 03:02:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.643 03:02:33 -- common/autotest_common.sh@10 -- # set +x 00:07:30.643 ************************************ 00:07:30.643 END TEST version 00:07:30.643 ************************************ 00:07:30.643 03:02:33 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:30.643 03:02:33 -- spdk/autotest.sh@191 -- # uname -s 00:07:30.643 03:02:33 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:30.643 03:02:33 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:30.643 03:02:33 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:30.643 03:02:33 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:30.643 03:02:33 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:30.643 03:02:33 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:30.643 03:02:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:30.643 03:02:33 -- common/autotest_common.sh@10 -- # set +x 00:07:30.643 03:02:33 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:30.643 03:02:33 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:30.643 03:02:33 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:30.643 03:02:33 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:30.643 03:02:33 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:30.643 03:02:33 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:30.643 03:02:33 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:30.643 03:02:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:30.643 03:02:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.643 03:02:33 -- common/autotest_common.sh@10 -- # set +x 00:07:30.643 ************************************ 00:07:30.643 START TEST nvmf_tcp 00:07:30.643 ************************************ 00:07:30.643 03:02:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:30.643 * Looking for test storage... 00:07:30.643 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:30.643 03:02:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.643 03:02:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.643 03:02:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.979 03:02:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.979 03:02:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.979 03:02:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.979 03:02:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.979 03:02:33 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.979 03:02:33 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.979 03:02:33 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.979 03:02:33 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.979 03:02:33 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.979 03:02:33 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.979 03:02:33 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.979 03:02:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.979 03:02:33 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.979 03:02:33 -- scripts/common.sh@344 -- # : 1 00:07:30.979 03:02:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.979 03:02:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.979 03:02:33 -- scripts/common.sh@364 -- # decimal 1 00:07:30.979 03:02:33 -- scripts/common.sh@352 -- # local d=1 00:07:30.979 03:02:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.979 03:02:33 -- scripts/common.sh@354 -- # echo 1 00:07:30.979 03:02:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.979 03:02:33 -- scripts/common.sh@365 -- # decimal 2 00:07:30.979 03:02:33 -- scripts/common.sh@352 -- # local d=2 00:07:30.979 03:02:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.979 03:02:33 -- scripts/common.sh@354 -- # echo 2 00:07:30.979 03:02:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.979 03:02:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.979 03:02:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.979 03:02:33 -- scripts/common.sh@367 -- # return 0 00:07:30.979 03:02:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.979 03:02:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.979 --rc genhtml_branch_coverage=1 00:07:30.979 --rc genhtml_function_coverage=1 00:07:30.979 --rc genhtml_legend=1 00:07:30.979 --rc geninfo_all_blocks=1 00:07:30.979 --rc geninfo_unexecuted_blocks=1 00:07:30.979 00:07:30.979 ' 00:07:30.979 03:02:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.979 --rc genhtml_branch_coverage=1 00:07:30.979 --rc genhtml_function_coverage=1 00:07:30.979 --rc genhtml_legend=1 00:07:30.979 --rc geninfo_all_blocks=1 00:07:30.979 --rc geninfo_unexecuted_blocks=1 00:07:30.979 00:07:30.979 ' 00:07:30.979 03:02:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.979 --rc genhtml_branch_coverage=1 00:07:30.979 --rc genhtml_function_coverage=1 00:07:30.979 --rc genhtml_legend=1 00:07:30.979 --rc geninfo_all_blocks=1 00:07:30.979 --rc geninfo_unexecuted_blocks=1 00:07:30.979 00:07:30.979 ' 00:07:30.979 03:02:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.979 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.979 --rc genhtml_branch_coverage=1 00:07:30.979 --rc genhtml_function_coverage=1 00:07:30.979 --rc genhtml_legend=1 00:07:30.979 --rc geninfo_all_blocks=1 00:07:30.979 --rc geninfo_unexecuted_blocks=1 00:07:30.979 00:07:30.979 ' 00:07:30.979 03:02:33 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:30.979 03:02:33 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:30.979 03:02:33 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:30.979 03:02:33 -- nvmf/common.sh@7 -- # uname -s 00:07:30.979 03:02:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:30.979 03:02:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:30.979 03:02:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:30.979 03:02:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:30.979 03:02:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:30.979 03:02:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:30.979 03:02:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:30.979 03:02:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:30.979 03:02:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:30.979 03:02:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:30.979 03:02:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.979 03:02:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.979 03:02:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:30.979 03:02:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:30.979 03:02:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:30.979 03:02:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:30.979 03:02:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:30.979 03:02:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:30.979 03:02:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:30.979 03:02:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.979 03:02:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.980 03:02:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.980 03:02:33 -- paths/export.sh@5 -- # export PATH 00:07:30.980 03:02:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.980 03:02:33 -- nvmf/common.sh@46 -- # : 0 00:07:30.980 03:02:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:30.980 03:02:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:30.980 03:02:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:30.980 03:02:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:30.980 03:02:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:30.980 03:02:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:30.980 03:02:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:30.980 03:02:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:30.980 03:02:33 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:30.980 03:02:33 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:30.980 03:02:33 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:30.980 03:02:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:30.980 03:02:33 -- common/autotest_common.sh@10 -- # set +x 00:07:30.980 03:02:33 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:30.980 03:02:33 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:30.980 03:02:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:30.980 03:02:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.980 03:02:33 -- common/autotest_common.sh@10 -- # set +x 00:07:30.980 ************************************ 00:07:30.980 START TEST nvmf_example 00:07:30.980 ************************************ 00:07:30.980 03:02:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:30.980 * Looking for test storage... 00:07:30.980 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:30.980 03:02:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:30.980 03:02:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:30.980 03:02:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:30.980 03:02:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:30.980 03:02:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:30.980 03:02:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:30.980 03:02:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:30.980 03:02:33 -- scripts/common.sh@335 -- # IFS=.-: 00:07:30.980 03:02:33 -- scripts/common.sh@335 -- # read -ra ver1 00:07:30.980 03:02:33 -- scripts/common.sh@336 -- # IFS=.-: 00:07:30.980 03:02:33 -- scripts/common.sh@336 -- # read -ra ver2 00:07:30.980 03:02:33 -- scripts/common.sh@337 -- # local 'op=<' 00:07:30.980 03:02:33 -- scripts/common.sh@339 -- # ver1_l=2 00:07:30.980 03:02:33 -- scripts/common.sh@340 -- # ver2_l=1 00:07:30.980 03:02:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:30.980 03:02:33 -- scripts/common.sh@343 -- # case "$op" in 00:07:30.980 03:02:33 -- scripts/common.sh@344 -- # : 1 00:07:30.980 03:02:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:30.980 03:02:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:30.980 03:02:33 -- scripts/common.sh@364 -- # decimal 1 00:07:30.980 03:02:33 -- scripts/common.sh@352 -- # local d=1 00:07:30.980 03:02:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:30.980 03:02:33 -- scripts/common.sh@354 -- # echo 1 00:07:30.980 03:02:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:30.980 03:02:33 -- scripts/common.sh@365 -- # decimal 2 00:07:30.980 03:02:33 -- scripts/common.sh@352 -- # local d=2 00:07:30.980 03:02:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:30.980 03:02:33 -- scripts/common.sh@354 -- # echo 2 00:07:30.980 03:02:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:30.980 03:02:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:30.980 03:02:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:30.980 03:02:33 -- scripts/common.sh@367 -- # return 0 00:07:30.980 03:02:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:30.980 03:02:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:30.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.980 --rc genhtml_branch_coverage=1 00:07:30.980 --rc genhtml_function_coverage=1 00:07:30.980 --rc genhtml_legend=1 00:07:30.980 --rc geninfo_all_blocks=1 00:07:30.980 --rc geninfo_unexecuted_blocks=1 00:07:30.980 00:07:30.980 ' 00:07:30.980 03:02:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:30.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.980 --rc genhtml_branch_coverage=1 00:07:30.980 --rc genhtml_function_coverage=1 00:07:30.980 --rc genhtml_legend=1 00:07:30.980 --rc geninfo_all_blocks=1 00:07:30.980 --rc geninfo_unexecuted_blocks=1 00:07:30.980 00:07:30.980 ' 00:07:30.980 03:02:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:30.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.980 --rc genhtml_branch_coverage=1 00:07:30.980 --rc genhtml_function_coverage=1 00:07:30.980 --rc genhtml_legend=1 00:07:30.980 --rc geninfo_all_blocks=1 00:07:30.980 --rc geninfo_unexecuted_blocks=1 00:07:30.980 00:07:30.980 ' 00:07:30.980 03:02:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:30.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:30.980 --rc genhtml_branch_coverage=1 00:07:30.980 --rc genhtml_function_coverage=1 00:07:30.980 --rc genhtml_legend=1 00:07:30.980 --rc geninfo_all_blocks=1 00:07:30.980 --rc geninfo_unexecuted_blocks=1 00:07:30.980 00:07:30.980 ' 00:07:30.980 03:02:33 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:30.980 03:02:33 -- nvmf/common.sh@7 -- # uname -s 00:07:30.980 03:02:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:30.980 03:02:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:30.980 03:02:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:30.980 03:02:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:30.980 03:02:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:30.980 03:02:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:30.980 03:02:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:30.980 03:02:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:30.980 03:02:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:30.980 03:02:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:30.980 03:02:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.980 03:02:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:30.980 03:02:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:30.980 03:02:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:30.980 03:02:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:30.980 03:02:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:30.980 03:02:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:30.980 03:02:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:30.980 03:02:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:30.980 03:02:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.980 03:02:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.980 03:02:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.980 03:02:33 -- paths/export.sh@5 -- # export PATH 00:07:30.980 03:02:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:30.980 03:02:33 -- nvmf/common.sh@46 -- # : 0 00:07:30.980 03:02:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:30.980 03:02:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:30.980 03:02:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:30.980 03:02:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:30.980 03:02:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:30.980 03:02:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:30.980 03:02:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:30.980 03:02:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:30.980 03:02:33 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:30.980 03:02:33 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:30.980 03:02:33 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:30.980 03:02:33 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:30.980 03:02:33 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:30.980 03:02:33 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:30.980 03:02:33 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:30.980 03:02:33 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:30.980 03:02:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:30.980 03:02:33 -- common/autotest_common.sh@10 -- # set +x 00:07:30.980 03:02:33 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:30.980 03:02:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:30.981 03:02:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:30.981 03:02:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:30.981 03:02:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:30.981 03:02:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:30.981 03:02:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:30.981 03:02:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:30.981 03:02:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:30.981 03:02:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:30.981 03:02:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:30.981 03:02:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:30.981 03:02:33 -- common/autotest_common.sh@10 -- # set +x 00:07:32.924 03:02:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:32.924 03:02:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:32.924 03:02:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:32.924 03:02:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:32.924 03:02:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:32.924 03:02:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:32.924 03:02:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:32.924 03:02:35 -- nvmf/common.sh@294 -- # net_devs=() 00:07:32.924 03:02:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:32.924 03:02:35 -- nvmf/common.sh@295 -- # e810=() 00:07:32.924 03:02:35 -- nvmf/common.sh@295 -- # local -ga e810 00:07:32.924 03:02:35 -- nvmf/common.sh@296 -- # x722=() 00:07:32.924 03:02:35 -- nvmf/common.sh@296 -- # local -ga x722 00:07:32.924 03:02:35 -- nvmf/common.sh@297 -- # mlx=() 00:07:32.924 03:02:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:32.924 03:02:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:32.924 03:02:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:32.924 03:02:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:32.924 03:02:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:32.924 03:02:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:32.924 03:02:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:32.924 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:32.924 03:02:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:32.924 03:02:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:32.924 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:32.924 03:02:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:32.924 03:02:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:32.924 03:02:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:32.924 03:02:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:32.924 03:02:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:32.924 03:02:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:32.924 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:32.924 03:02:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:32.924 03:02:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:32.924 03:02:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:32.924 03:02:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:32.924 03:02:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:32.924 03:02:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:32.924 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:32.924 03:02:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:32.924 03:02:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:32.924 03:02:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:32.924 03:02:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:32.924 03:02:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:32.924 03:02:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:32.924 03:02:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:32.924 03:02:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:32.924 03:02:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:32.924 03:02:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:32.924 03:02:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:32.924 03:02:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:32.924 03:02:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:32.924 03:02:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:32.924 03:02:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:32.924 03:02:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:32.924 03:02:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:32.924 03:02:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:33.185 03:02:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:33.185 03:02:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:33.185 03:02:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:33.185 03:02:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:33.185 03:02:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:33.185 03:02:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:33.185 03:02:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:33.185 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:33.185 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:07:33.185 00:07:33.185 --- 10.0.0.2 ping statistics --- 00:07:33.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:33.185 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:07:33.185 03:02:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:33.185 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:33.185 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:07:33.185 00:07:33.185 --- 10.0.0.1 ping statistics --- 00:07:33.185 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:33.185 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:07:33.185 03:02:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:33.185 03:02:35 -- nvmf/common.sh@410 -- # return 0 00:07:33.185 03:02:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:33.185 03:02:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:33.185 03:02:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:33.185 03:02:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:33.185 03:02:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:33.185 03:02:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:33.185 03:02:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:33.185 03:02:35 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:33.185 03:02:35 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:33.185 03:02:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:33.185 03:02:35 -- common/autotest_common.sh@10 -- # set +x 00:07:33.185 03:02:35 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:33.185 03:02:35 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:33.185 03:02:35 -- target/nvmf_example.sh@34 -- # nvmfpid=2349793 00:07:33.185 03:02:35 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:33.185 03:02:35 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:33.185 03:02:35 -- target/nvmf_example.sh@36 -- # waitforlisten 2349793 00:07:33.185 03:02:35 -- common/autotest_common.sh@829 -- # '[' -z 2349793 ']' 00:07:33.185 03:02:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:33.185 03:02:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:33.185 03:02:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:33.185 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:33.185 03:02:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:33.185 03:02:35 -- common/autotest_common.sh@10 -- # set +x 00:07:33.185 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.122 03:02:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:34.122 03:02:36 -- common/autotest_common.sh@862 -- # return 0 00:07:34.122 03:02:36 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:34.122 03:02:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:34.122 03:02:36 -- common/autotest_common.sh@10 -- # set +x 00:07:34.122 03:02:36 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:34.122 03:02:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.122 03:02:36 -- common/autotest_common.sh@10 -- # set +x 00:07:34.122 03:02:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.122 03:02:36 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:34.122 03:02:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.122 03:02:36 -- common/autotest_common.sh@10 -- # set +x 00:07:34.383 03:02:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.383 03:02:36 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:34.383 03:02:36 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:34.383 03:02:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.383 03:02:36 -- common/autotest_common.sh@10 -- # set +x 00:07:34.383 03:02:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.383 03:02:36 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:34.383 03:02:36 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:34.383 03:02:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.383 03:02:36 -- common/autotest_common.sh@10 -- # set +x 00:07:34.383 03:02:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.383 03:02:36 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:34.383 03:02:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:34.383 03:02:36 -- common/autotest_common.sh@10 -- # set +x 00:07:34.383 03:02:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:34.383 03:02:36 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:34.383 03:02:36 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:34.383 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.598 Initializing NVMe Controllers 00:07:46.598 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:07:46.598 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:07:46.598 Initialization complete. Launching workers. 00:07:46.598 ======================================================== 00:07:46.598 Latency(us) 00:07:46.598 Device Information : IOPS MiB/s Average min max 00:07:46.598 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15715.20 61.39 4073.58 863.10 15767.99 00:07:46.598 ======================================================== 00:07:46.598 Total : 15715.20 61.39 4073.58 863.10 15767.99 00:07:46.598 00:07:46.598 03:02:47 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:07:46.598 03:02:47 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:07:46.598 03:02:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:46.598 03:02:47 -- nvmf/common.sh@116 -- # sync 00:07:46.598 03:02:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:46.598 03:02:47 -- nvmf/common.sh@119 -- # set +e 00:07:46.598 03:02:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:46.598 03:02:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:46.598 rmmod nvme_tcp 00:07:46.598 rmmod nvme_fabrics 00:07:46.598 rmmod nvme_keyring 00:07:46.598 03:02:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:46.598 03:02:47 -- nvmf/common.sh@123 -- # set -e 00:07:46.598 03:02:47 -- nvmf/common.sh@124 -- # return 0 00:07:46.598 03:02:47 -- nvmf/common.sh@477 -- # '[' -n 2349793 ']' 00:07:46.598 03:02:47 -- nvmf/common.sh@478 -- # killprocess 2349793 00:07:46.598 03:02:47 -- common/autotest_common.sh@936 -- # '[' -z 2349793 ']' 00:07:46.598 03:02:47 -- common/autotest_common.sh@940 -- # kill -0 2349793 00:07:46.598 03:02:47 -- common/autotest_common.sh@941 -- # uname 00:07:46.598 03:02:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:46.598 03:02:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2349793 00:07:46.598 03:02:47 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:07:46.598 03:02:47 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:07:46.598 03:02:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2349793' 00:07:46.598 killing process with pid 2349793 00:07:46.598 03:02:47 -- common/autotest_common.sh@955 -- # kill 2349793 00:07:46.598 03:02:47 -- common/autotest_common.sh@960 -- # wait 2349793 00:07:46.598 nvmf threads initialize successfully 00:07:46.598 bdev subsystem init successfully 00:07:46.598 created a nvmf target service 00:07:46.598 create targets's poll groups done 00:07:46.598 all subsystems of target started 00:07:46.598 nvmf target is running 00:07:46.598 all subsystems of target stopped 00:07:46.598 destroy targets's poll groups done 00:07:46.598 destroyed the nvmf target service 00:07:46.598 bdev subsystem finish successfully 00:07:46.598 nvmf threads destroy successfully 00:07:46.598 03:02:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:46.598 03:02:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:46.598 03:02:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:46.598 03:02:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:46.598 03:02:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:46.598 03:02:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:46.598 03:02:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:46.598 03:02:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:46.856 03:02:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:46.856 03:02:49 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:07:46.856 03:02:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:46.856 03:02:49 -- common/autotest_common.sh@10 -- # set +x 00:07:46.856 00:07:46.856 real 0m16.085s 00:07:46.856 user 0m45.669s 00:07:46.856 sys 0m3.243s 00:07:46.856 03:02:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:46.856 03:02:49 -- common/autotest_common.sh@10 -- # set +x 00:07:46.856 ************************************ 00:07:46.856 END TEST nvmf_example 00:07:46.856 ************************************ 00:07:46.856 03:02:49 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:46.856 03:02:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:46.856 03:02:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.856 03:02:49 -- common/autotest_common.sh@10 -- # set +x 00:07:46.856 ************************************ 00:07:46.856 START TEST nvmf_filesystem 00:07:46.856 ************************************ 00:07:46.856 03:02:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:07:47.117 * Looking for test storage... 00:07:47.117 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:47.117 03:02:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:47.117 03:02:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:47.117 03:02:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:47.117 03:02:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:47.117 03:02:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:47.117 03:02:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:47.117 03:02:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:47.117 03:02:49 -- scripts/common.sh@335 -- # IFS=.-: 00:07:47.117 03:02:49 -- scripts/common.sh@335 -- # read -ra ver1 00:07:47.117 03:02:49 -- scripts/common.sh@336 -- # IFS=.-: 00:07:47.117 03:02:49 -- scripts/common.sh@336 -- # read -ra ver2 00:07:47.117 03:02:49 -- scripts/common.sh@337 -- # local 'op=<' 00:07:47.117 03:02:49 -- scripts/common.sh@339 -- # ver1_l=2 00:07:47.117 03:02:49 -- scripts/common.sh@340 -- # ver2_l=1 00:07:47.117 03:02:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:47.117 03:02:49 -- scripts/common.sh@343 -- # case "$op" in 00:07:47.117 03:02:49 -- scripts/common.sh@344 -- # : 1 00:07:47.117 03:02:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:47.117 03:02:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:47.117 03:02:49 -- scripts/common.sh@364 -- # decimal 1 00:07:47.117 03:02:49 -- scripts/common.sh@352 -- # local d=1 00:07:47.117 03:02:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:47.117 03:02:49 -- scripts/common.sh@354 -- # echo 1 00:07:47.117 03:02:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:47.117 03:02:49 -- scripts/common.sh@365 -- # decimal 2 00:07:47.117 03:02:49 -- scripts/common.sh@352 -- # local d=2 00:07:47.117 03:02:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:47.117 03:02:49 -- scripts/common.sh@354 -- # echo 2 00:07:47.117 03:02:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:47.117 03:02:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:47.117 03:02:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:47.117 03:02:49 -- scripts/common.sh@367 -- # return 0 00:07:47.117 03:02:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:47.117 03:02:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:47.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.117 --rc genhtml_branch_coverage=1 00:07:47.117 --rc genhtml_function_coverage=1 00:07:47.117 --rc genhtml_legend=1 00:07:47.117 --rc geninfo_all_blocks=1 00:07:47.117 --rc geninfo_unexecuted_blocks=1 00:07:47.117 00:07:47.117 ' 00:07:47.117 03:02:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:47.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.117 --rc genhtml_branch_coverage=1 00:07:47.117 --rc genhtml_function_coverage=1 00:07:47.117 --rc genhtml_legend=1 00:07:47.117 --rc geninfo_all_blocks=1 00:07:47.117 --rc geninfo_unexecuted_blocks=1 00:07:47.117 00:07:47.117 ' 00:07:47.117 03:02:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:47.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.117 --rc genhtml_branch_coverage=1 00:07:47.117 --rc genhtml_function_coverage=1 00:07:47.117 --rc genhtml_legend=1 00:07:47.117 --rc geninfo_all_blocks=1 00:07:47.117 --rc geninfo_unexecuted_blocks=1 00:07:47.117 00:07:47.117 ' 00:07:47.117 03:02:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:47.117 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.117 --rc genhtml_branch_coverage=1 00:07:47.117 --rc genhtml_function_coverage=1 00:07:47.117 --rc genhtml_legend=1 00:07:47.117 --rc geninfo_all_blocks=1 00:07:47.117 --rc geninfo_unexecuted_blocks=1 00:07:47.117 00:07:47.117 ' 00:07:47.117 03:02:49 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:07:47.117 03:02:49 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:07:47.117 03:02:49 -- common/autotest_common.sh@34 -- # set -e 00:07:47.117 03:02:49 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:07:47.117 03:02:49 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:07:47.117 03:02:49 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:07:47.117 03:02:49 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:07:47.117 03:02:49 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:07:47.117 03:02:49 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:07:47.117 03:02:49 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:07:47.117 03:02:49 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:07:47.117 03:02:49 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:07:47.117 03:02:49 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:07:47.117 03:02:49 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:07:47.117 03:02:49 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:07:47.117 03:02:49 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:07:47.117 03:02:49 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:07:47.117 03:02:49 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:07:47.117 03:02:49 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:07:47.117 03:02:49 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:07:47.117 03:02:49 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:07:47.117 03:02:49 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:07:47.117 03:02:49 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:07:47.117 03:02:49 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:07:47.117 03:02:49 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:07:47.117 03:02:49 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:47.117 03:02:49 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:07:47.118 03:02:49 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:07:47.118 03:02:49 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:07:47.118 03:02:49 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:07:47.118 03:02:49 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:07:47.118 03:02:49 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:07:47.118 03:02:49 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:07:47.118 03:02:49 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:07:47.118 03:02:49 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:07:47.118 03:02:49 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:07:47.118 03:02:49 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:07:47.118 03:02:49 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:07:47.118 03:02:49 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:07:47.118 03:02:49 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:07:47.118 03:02:49 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:07:47.118 03:02:49 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:07:47.118 03:02:49 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:47.118 03:02:49 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:07:47.118 03:02:49 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:07:47.118 03:02:49 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:07:47.118 03:02:49 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:07:47.118 03:02:49 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:47.118 03:02:49 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:07:47.118 03:02:49 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:07:47.118 03:02:49 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:07:47.118 03:02:49 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:07:47.118 03:02:49 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:07:47.118 03:02:49 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:07:47.118 03:02:49 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:07:47.118 03:02:49 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:07:47.118 03:02:49 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:07:47.118 03:02:49 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:07:47.118 03:02:49 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:07:47.118 03:02:49 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:07:47.118 03:02:49 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:07:47.118 03:02:49 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:07:47.118 03:02:49 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:07:47.118 03:02:49 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:07:47.118 03:02:49 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:07:47.118 03:02:49 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:07:47.118 03:02:49 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:07:47.118 03:02:49 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:47.118 03:02:49 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:07:47.118 03:02:49 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:07:47.118 03:02:49 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:07:47.118 03:02:49 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:07:47.118 03:02:49 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:07:47.118 03:02:49 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:07:47.118 03:02:49 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:07:47.118 03:02:49 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:07:47.118 03:02:49 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:07:47.118 03:02:49 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:07:47.118 03:02:49 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:07:47.118 03:02:49 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:07:47.118 03:02:49 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:07:47.118 03:02:49 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:07:47.118 03:02:49 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:07:47.118 03:02:49 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:07:47.118 03:02:49 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:07:47.118 03:02:49 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:07:47.118 03:02:49 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:47.118 03:02:49 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:07:47.118 03:02:49 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:47.118 03:02:49 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:07:47.118 03:02:49 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:47.118 03:02:49 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:47.118 03:02:49 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:47.118 03:02:49 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:47.118 03:02:49 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:07:47.118 03:02:49 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:07:47.118 03:02:49 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:07:47.118 03:02:49 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:07:47.118 03:02:49 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:07:47.118 03:02:49 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:07:47.118 03:02:49 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:07:47.118 03:02:49 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:07:47.118 #define SPDK_CONFIG_H 00:07:47.118 #define SPDK_CONFIG_APPS 1 00:07:47.118 #define SPDK_CONFIG_ARCH native 00:07:47.118 #undef SPDK_CONFIG_ASAN 00:07:47.118 #undef SPDK_CONFIG_AVAHI 00:07:47.118 #undef SPDK_CONFIG_CET 00:07:47.118 #define SPDK_CONFIG_COVERAGE 1 00:07:47.118 #define SPDK_CONFIG_CROSS_PREFIX 00:07:47.118 #undef SPDK_CONFIG_CRYPTO 00:07:47.118 #undef SPDK_CONFIG_CRYPTO_MLX5 00:07:47.118 #undef SPDK_CONFIG_CUSTOMOCF 00:07:47.118 #undef SPDK_CONFIG_DAOS 00:07:47.118 #define SPDK_CONFIG_DAOS_DIR 00:07:47.118 #define SPDK_CONFIG_DEBUG 1 00:07:47.118 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:07:47.118 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:47.118 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:07:47.118 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:47.118 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:07:47.118 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:07:47.118 #define SPDK_CONFIG_EXAMPLES 1 00:07:47.118 #undef SPDK_CONFIG_FC 00:07:47.118 #define SPDK_CONFIG_FC_PATH 00:07:47.118 #define SPDK_CONFIG_FIO_PLUGIN 1 00:07:47.118 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:07:47.118 #undef SPDK_CONFIG_FUSE 00:07:47.118 #undef SPDK_CONFIG_FUZZER 00:07:47.118 #define SPDK_CONFIG_FUZZER_LIB 00:07:47.118 #undef SPDK_CONFIG_GOLANG 00:07:47.118 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:07:47.118 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:07:47.118 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:07:47.118 #undef SPDK_CONFIG_HAVE_LIBBSD 00:07:47.118 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:07:47.118 #define SPDK_CONFIG_IDXD 1 00:07:47.118 #define SPDK_CONFIG_IDXD_KERNEL 1 00:07:47.118 #undef SPDK_CONFIG_IPSEC_MB 00:07:47.118 #define SPDK_CONFIG_IPSEC_MB_DIR 00:07:47.118 #define SPDK_CONFIG_ISAL 1 00:07:47.118 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:07:47.118 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:07:47.118 #define SPDK_CONFIG_LIBDIR 00:07:47.118 #undef SPDK_CONFIG_LTO 00:07:47.118 #define SPDK_CONFIG_MAX_LCORES 00:07:47.118 #define SPDK_CONFIG_NVME_CUSE 1 00:07:47.118 #undef SPDK_CONFIG_OCF 00:07:47.118 #define SPDK_CONFIG_OCF_PATH 00:07:47.118 #define SPDK_CONFIG_OPENSSL_PATH 00:07:47.118 #undef SPDK_CONFIG_PGO_CAPTURE 00:07:47.118 #undef SPDK_CONFIG_PGO_USE 00:07:47.118 #define SPDK_CONFIG_PREFIX /usr/local 00:07:47.118 #undef SPDK_CONFIG_RAID5F 00:07:47.118 #undef SPDK_CONFIG_RBD 00:07:47.118 #define SPDK_CONFIG_RDMA 1 00:07:47.118 #define SPDK_CONFIG_RDMA_PROV verbs 00:07:47.118 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:07:47.118 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:07:47.118 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:07:47.118 #define SPDK_CONFIG_SHARED 1 00:07:47.118 #undef SPDK_CONFIG_SMA 00:07:47.118 #define SPDK_CONFIG_TESTS 1 00:07:47.118 #undef SPDK_CONFIG_TSAN 00:07:47.118 #define SPDK_CONFIG_UBLK 1 00:07:47.118 #define SPDK_CONFIG_UBSAN 1 00:07:47.118 #undef SPDK_CONFIG_UNIT_TESTS 00:07:47.118 #undef SPDK_CONFIG_URING 00:07:47.118 #define SPDK_CONFIG_URING_PATH 00:07:47.118 #undef SPDK_CONFIG_URING_ZNS 00:07:47.118 #undef SPDK_CONFIG_USDT 00:07:47.118 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:07:47.118 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:07:47.118 #define SPDK_CONFIG_VFIO_USER 1 00:07:47.118 #define SPDK_CONFIG_VFIO_USER_DIR 00:07:47.118 #define SPDK_CONFIG_VHOST 1 00:07:47.118 #define SPDK_CONFIG_VIRTIO 1 00:07:47.118 #undef SPDK_CONFIG_VTUNE 00:07:47.118 #define SPDK_CONFIG_VTUNE_DIR 00:07:47.118 #define SPDK_CONFIG_WERROR 1 00:07:47.118 #define SPDK_CONFIG_WPDK_DIR 00:07:47.118 #undef SPDK_CONFIG_XNVME 00:07:47.118 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:07:47.118 03:02:49 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:07:47.118 03:02:49 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:47.118 03:02:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:47.118 03:02:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:47.118 03:02:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:47.118 03:02:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.119 03:02:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.119 03:02:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.119 03:02:49 -- paths/export.sh@5 -- # export PATH 00:07:47.119 03:02:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.119 03:02:49 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:47.119 03:02:49 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:07:47.119 03:02:49 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:47.119 03:02:49 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:07:47.119 03:02:49 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:07:47.119 03:02:49 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:07:47.119 03:02:49 -- pm/common@16 -- # TEST_TAG=N/A 00:07:47.119 03:02:49 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:07:47.119 03:02:49 -- common/autotest_common.sh@52 -- # : 1 00:07:47.119 03:02:49 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:07:47.119 03:02:49 -- common/autotest_common.sh@56 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:07:47.119 03:02:49 -- common/autotest_common.sh@58 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:07:47.119 03:02:49 -- common/autotest_common.sh@60 -- # : 1 00:07:47.119 03:02:49 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:07:47.119 03:02:49 -- common/autotest_common.sh@62 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:07:47.119 03:02:49 -- common/autotest_common.sh@64 -- # : 00:07:47.119 03:02:49 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:07:47.119 03:02:49 -- common/autotest_common.sh@66 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:07:47.119 03:02:49 -- common/autotest_common.sh@68 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:07:47.119 03:02:49 -- common/autotest_common.sh@70 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:07:47.119 03:02:49 -- common/autotest_common.sh@72 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:07:47.119 03:02:49 -- common/autotest_common.sh@74 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:07:47.119 03:02:49 -- common/autotest_common.sh@76 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:07:47.119 03:02:49 -- common/autotest_common.sh@78 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:07:47.119 03:02:49 -- common/autotest_common.sh@80 -- # : 1 00:07:47.119 03:02:49 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:07:47.119 03:02:49 -- common/autotest_common.sh@82 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:07:47.119 03:02:49 -- common/autotest_common.sh@84 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:07:47.119 03:02:49 -- common/autotest_common.sh@86 -- # : 1 00:07:47.119 03:02:49 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:07:47.119 03:02:49 -- common/autotest_common.sh@88 -- # : 1 00:07:47.119 03:02:49 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:07:47.119 03:02:49 -- common/autotest_common.sh@90 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:07:47.119 03:02:49 -- common/autotest_common.sh@92 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:07:47.119 03:02:49 -- common/autotest_common.sh@94 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:07:47.119 03:02:49 -- common/autotest_common.sh@96 -- # : tcp 00:07:47.119 03:02:49 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:07:47.119 03:02:49 -- common/autotest_common.sh@98 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:07:47.119 03:02:49 -- common/autotest_common.sh@100 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:07:47.119 03:02:49 -- common/autotest_common.sh@102 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:07:47.119 03:02:49 -- common/autotest_common.sh@104 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:07:47.119 03:02:49 -- common/autotest_common.sh@106 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:07:47.119 03:02:49 -- common/autotest_common.sh@108 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:07:47.119 03:02:49 -- common/autotest_common.sh@110 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:07:47.119 03:02:49 -- common/autotest_common.sh@112 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:07:47.119 03:02:49 -- common/autotest_common.sh@114 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:07:47.119 03:02:49 -- common/autotest_common.sh@116 -- # : 1 00:07:47.119 03:02:49 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:07:47.119 03:02:49 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:07:47.119 03:02:49 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:07:47.119 03:02:49 -- common/autotest_common.sh@120 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:07:47.119 03:02:49 -- common/autotest_common.sh@122 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:07:47.119 03:02:49 -- common/autotest_common.sh@124 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:07:47.119 03:02:49 -- common/autotest_common.sh@126 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:07:47.119 03:02:49 -- common/autotest_common.sh@128 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:07:47.119 03:02:49 -- common/autotest_common.sh@130 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:07:47.119 03:02:49 -- common/autotest_common.sh@132 -- # : v23.11 00:07:47.119 03:02:49 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:07:47.119 03:02:49 -- common/autotest_common.sh@134 -- # : true 00:07:47.119 03:02:49 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:07:47.119 03:02:49 -- common/autotest_common.sh@136 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:07:47.119 03:02:49 -- common/autotest_common.sh@138 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:07:47.119 03:02:49 -- common/autotest_common.sh@140 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:07:47.119 03:02:49 -- common/autotest_common.sh@142 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:07:47.119 03:02:49 -- common/autotest_common.sh@144 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:07:47.119 03:02:49 -- common/autotest_common.sh@146 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:07:47.119 03:02:49 -- common/autotest_common.sh@148 -- # : e810 00:07:47.119 03:02:49 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:07:47.119 03:02:49 -- common/autotest_common.sh@150 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:07:47.119 03:02:49 -- common/autotest_common.sh@152 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:07:47.119 03:02:49 -- common/autotest_common.sh@154 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:07:47.119 03:02:49 -- common/autotest_common.sh@156 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:07:47.119 03:02:49 -- common/autotest_common.sh@158 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:07:47.119 03:02:49 -- common/autotest_common.sh@160 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:07:47.119 03:02:49 -- common/autotest_common.sh@163 -- # : 00:07:47.119 03:02:49 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:07:47.119 03:02:49 -- common/autotest_common.sh@165 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:07:47.119 03:02:49 -- common/autotest_common.sh@167 -- # : 0 00:07:47.119 03:02:49 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:07:47.119 03:02:49 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:47.119 03:02:49 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:07:47.119 03:02:49 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:47.119 03:02:49 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:07:47.119 03:02:49 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:47.119 03:02:49 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:47.120 03:02:49 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:47.120 03:02:49 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:07:47.120 03:02:49 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:07:47.120 03:02:49 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:07:47.120 03:02:49 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:47.120 03:02:49 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:47.120 03:02:49 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:07:47.120 03:02:49 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:07:47.120 03:02:49 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:47.120 03:02:49 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:07:47.120 03:02:49 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:47.120 03:02:49 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:07:47.120 03:02:49 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:07:47.120 03:02:49 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:07:47.120 03:02:49 -- common/autotest_common.sh@196 -- # cat 00:07:47.120 03:02:49 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:07:47.120 03:02:49 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:47.120 03:02:49 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:07:47.120 03:02:49 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:47.120 03:02:49 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:07:47.120 03:02:49 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:07:47.120 03:02:49 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:07:47.120 03:02:49 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:47.120 03:02:49 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:07:47.120 03:02:49 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:47.120 03:02:49 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:07:47.120 03:02:49 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:47.120 03:02:49 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:07:47.120 03:02:49 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:47.120 03:02:49 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:07:47.120 03:02:49 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:47.120 03:02:49 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:07:47.120 03:02:49 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:47.120 03:02:49 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:07:47.120 03:02:49 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:07:47.120 03:02:49 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:07:47.120 03:02:49 -- common/autotest_common.sh@249 -- # _LCOV= 00:07:47.120 03:02:49 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:07:47.120 03:02:49 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:07:47.120 03:02:49 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:07:47.120 03:02:49 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:07:47.120 03:02:49 -- common/autotest_common.sh@255 -- # lcov_opt= 00:07:47.120 03:02:49 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:07:47.120 03:02:49 -- common/autotest_common.sh@259 -- # export valgrind= 00:07:47.120 03:02:49 -- common/autotest_common.sh@259 -- # valgrind= 00:07:47.120 03:02:49 -- common/autotest_common.sh@265 -- # uname -s 00:07:47.120 03:02:49 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:07:47.120 03:02:49 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:07:47.120 03:02:49 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:07:47.120 03:02:49 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:07:47.120 03:02:49 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:47.120 03:02:49 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:07:47.120 03:02:49 -- common/autotest_common.sh@275 -- # MAKE=make 00:07:47.120 03:02:49 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:07:47.120 03:02:49 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:07:47.120 03:02:49 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:07:47.120 03:02:49 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:07:47.120 03:02:49 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:07:47.120 03:02:49 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:07:47.120 03:02:49 -- common/autotest_common.sh@301 -- # for i in "$@" 00:07:47.120 03:02:49 -- common/autotest_common.sh@302 -- # case "$i" in 00:07:47.120 03:02:49 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:07:47.120 03:02:49 -- common/autotest_common.sh@319 -- # [[ -z 2351613 ]] 00:07:47.120 03:02:49 -- common/autotest_common.sh@319 -- # kill -0 2351613 00:07:47.120 03:02:49 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:07:47.120 03:02:49 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:07:47.120 03:02:49 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:07:47.120 03:02:49 -- common/autotest_common.sh@332 -- # local mount target_dir 00:07:47.120 03:02:49 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:07:47.120 03:02:49 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:07:47.120 03:02:49 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:07:47.120 03:02:49 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:07:47.120 03:02:49 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.4B1nG0 00:07:47.120 03:02:49 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:07:47.120 03:02:49 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:07:47.120 03:02:49 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:07:47.120 03:02:49 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.4B1nG0/tests/target /tmp/spdk.4B1nG0 00:07:47.120 03:02:49 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:07:47.120 03:02:49 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:47.120 03:02:49 -- common/autotest_common.sh@328 -- # df -T 00:07:47.120 03:02:49 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:07:47.120 03:02:49 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:07:47.120 03:02:49 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:07:47.120 03:02:49 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:07:47.120 03:02:49 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # avails["$mount"]=52983291904 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988503552 00:07:47.120 03:02:49 -- common/autotest_common.sh@364 -- # uses["$mount"]=9005211648 00:07:47.120 03:02:49 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # avails["$mount"]=30992994304 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:07:47.120 03:02:49 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:07:47.120 03:02:49 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:47.120 03:02:49 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388913152 00:07:47.120 03:02:49 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397703168 00:07:47.121 03:02:49 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:07:47.121 03:02:49 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:47.121 03:02:49 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:47.121 03:02:49 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:47.121 03:02:49 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993743872 00:07:47.121 03:02:49 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994251776 00:07:47.121 03:02:49 -- common/autotest_common.sh@364 -- # uses["$mount"]=507904 00:07:47.121 03:02:49 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:47.121 03:02:49 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:07:47.121 03:02:49 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:07:47.121 03:02:49 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:07:47.121 03:02:49 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:07:47.121 03:02:49 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:07:47.121 03:02:49 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:07:47.121 03:02:49 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:07:47.121 * Looking for test storage... 00:07:47.121 03:02:49 -- common/autotest_common.sh@369 -- # local target_space new_size 00:07:47.121 03:02:49 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:07:47.121 03:02:49 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:47.121 03:02:49 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:07:47.121 03:02:49 -- common/autotest_common.sh@373 -- # mount=/ 00:07:47.121 03:02:49 -- common/autotest_common.sh@375 -- # target_space=52983291904 00:07:47.121 03:02:49 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:07:47.121 03:02:49 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:07:47.121 03:02:49 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:07:47.121 03:02:49 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:07:47.121 03:02:49 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:07:47.121 03:02:49 -- common/autotest_common.sh@382 -- # new_size=11219804160 00:07:47.121 03:02:49 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:07:47.121 03:02:49 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:47.121 03:02:49 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:47.121 03:02:49 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:47.121 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:47.121 03:02:49 -- common/autotest_common.sh@390 -- # return 0 00:07:47.121 03:02:49 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:07:47.121 03:02:49 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:07:47.121 03:02:49 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:07:47.121 03:02:49 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:07:47.121 03:02:49 -- common/autotest_common.sh@1682 -- # true 00:07:47.121 03:02:49 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:07:47.121 03:02:49 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:07:47.121 03:02:49 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:07:47.121 03:02:49 -- common/autotest_common.sh@27 -- # exec 00:07:47.121 03:02:49 -- common/autotest_common.sh@29 -- # exec 00:07:47.121 03:02:49 -- common/autotest_common.sh@31 -- # xtrace_restore 00:07:47.121 03:02:49 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:07:47.121 03:02:49 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:07:47.121 03:02:49 -- common/autotest_common.sh@18 -- # set -x 00:07:47.121 03:02:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:47.121 03:02:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:47.121 03:02:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:47.381 03:02:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:47.381 03:02:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:47.381 03:02:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:47.381 03:02:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:47.381 03:02:49 -- scripts/common.sh@335 -- # IFS=.-: 00:07:47.381 03:02:49 -- scripts/common.sh@335 -- # read -ra ver1 00:07:47.381 03:02:49 -- scripts/common.sh@336 -- # IFS=.-: 00:07:47.381 03:02:49 -- scripts/common.sh@336 -- # read -ra ver2 00:07:47.381 03:02:49 -- scripts/common.sh@337 -- # local 'op=<' 00:07:47.381 03:02:49 -- scripts/common.sh@339 -- # ver1_l=2 00:07:47.381 03:02:49 -- scripts/common.sh@340 -- # ver2_l=1 00:07:47.381 03:02:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:47.381 03:02:49 -- scripts/common.sh@343 -- # case "$op" in 00:07:47.381 03:02:49 -- scripts/common.sh@344 -- # : 1 00:07:47.381 03:02:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:47.381 03:02:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:47.381 03:02:49 -- scripts/common.sh@364 -- # decimal 1 00:07:47.381 03:02:49 -- scripts/common.sh@352 -- # local d=1 00:07:47.381 03:02:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:47.381 03:02:49 -- scripts/common.sh@354 -- # echo 1 00:07:47.381 03:02:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:47.381 03:02:49 -- scripts/common.sh@365 -- # decimal 2 00:07:47.381 03:02:49 -- scripts/common.sh@352 -- # local d=2 00:07:47.381 03:02:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:47.381 03:02:49 -- scripts/common.sh@354 -- # echo 2 00:07:47.381 03:02:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:47.381 03:02:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:47.381 03:02:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:47.381 03:02:49 -- scripts/common.sh@367 -- # return 0 00:07:47.381 03:02:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:47.381 03:02:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:47.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.381 --rc genhtml_branch_coverage=1 00:07:47.381 --rc genhtml_function_coverage=1 00:07:47.381 --rc genhtml_legend=1 00:07:47.381 --rc geninfo_all_blocks=1 00:07:47.381 --rc geninfo_unexecuted_blocks=1 00:07:47.381 00:07:47.381 ' 00:07:47.381 03:02:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:47.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.381 --rc genhtml_branch_coverage=1 00:07:47.381 --rc genhtml_function_coverage=1 00:07:47.381 --rc genhtml_legend=1 00:07:47.381 --rc geninfo_all_blocks=1 00:07:47.381 --rc geninfo_unexecuted_blocks=1 00:07:47.381 00:07:47.381 ' 00:07:47.381 03:02:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:47.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.381 --rc genhtml_branch_coverage=1 00:07:47.381 --rc genhtml_function_coverage=1 00:07:47.381 --rc genhtml_legend=1 00:07:47.381 --rc geninfo_all_blocks=1 00:07:47.381 --rc geninfo_unexecuted_blocks=1 00:07:47.381 00:07:47.382 ' 00:07:47.382 03:02:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:47.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:47.382 --rc genhtml_branch_coverage=1 00:07:47.382 --rc genhtml_function_coverage=1 00:07:47.382 --rc genhtml_legend=1 00:07:47.382 --rc geninfo_all_blocks=1 00:07:47.382 --rc geninfo_unexecuted_blocks=1 00:07:47.382 00:07:47.382 ' 00:07:47.382 03:02:49 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:47.382 03:02:49 -- nvmf/common.sh@7 -- # uname -s 00:07:47.382 03:02:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:47.382 03:02:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:47.382 03:02:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:47.382 03:02:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:47.382 03:02:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:47.382 03:02:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:47.382 03:02:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:47.382 03:02:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:47.382 03:02:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:47.382 03:02:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:47.382 03:02:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:47.382 03:02:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:47.382 03:02:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:47.382 03:02:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:47.382 03:02:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:47.382 03:02:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:47.382 03:02:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:47.382 03:02:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:47.382 03:02:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:47.382 03:02:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.382 03:02:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.382 03:02:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.382 03:02:49 -- paths/export.sh@5 -- # export PATH 00:07:47.382 03:02:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:47.382 03:02:49 -- nvmf/common.sh@46 -- # : 0 00:07:47.382 03:02:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:47.382 03:02:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:47.382 03:02:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:47.382 03:02:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:47.382 03:02:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:47.382 03:02:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:47.382 03:02:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:47.382 03:02:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:47.382 03:02:49 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:07:47.382 03:02:49 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:07:47.382 03:02:49 -- target/filesystem.sh@15 -- # nvmftestinit 00:07:47.382 03:02:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:47.382 03:02:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:47.382 03:02:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:47.382 03:02:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:47.382 03:02:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:47.382 03:02:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:47.382 03:02:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:47.382 03:02:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:47.382 03:02:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:47.382 03:02:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:47.382 03:02:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:47.382 03:02:49 -- common/autotest_common.sh@10 -- # set +x 00:07:49.292 03:02:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:49.292 03:02:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:49.292 03:02:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:49.292 03:02:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:49.292 03:02:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:49.292 03:02:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:49.292 03:02:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:49.292 03:02:51 -- nvmf/common.sh@294 -- # net_devs=() 00:07:49.292 03:02:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:49.292 03:02:51 -- nvmf/common.sh@295 -- # e810=() 00:07:49.292 03:02:51 -- nvmf/common.sh@295 -- # local -ga e810 00:07:49.292 03:02:51 -- nvmf/common.sh@296 -- # x722=() 00:07:49.292 03:02:51 -- nvmf/common.sh@296 -- # local -ga x722 00:07:49.292 03:02:51 -- nvmf/common.sh@297 -- # mlx=() 00:07:49.292 03:02:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:49.292 03:02:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:49.292 03:02:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:49.292 03:02:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:49.292 03:02:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:49.292 03:02:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:49.292 03:02:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:49.292 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:49.292 03:02:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:49.292 03:02:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:49.292 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:49.292 03:02:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:49.292 03:02:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:49.292 03:02:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:49.292 03:02:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:49.292 03:02:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:49.292 03:02:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:49.292 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:49.292 03:02:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:49.292 03:02:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:49.292 03:02:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:49.292 03:02:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:49.292 03:02:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:49.292 03:02:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:49.292 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:49.292 03:02:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:49.292 03:02:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:49.292 03:02:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:49.292 03:02:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:49.292 03:02:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:49.292 03:02:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:49.292 03:02:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:49.292 03:02:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:49.292 03:02:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:49.292 03:02:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:49.292 03:02:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:49.292 03:02:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:49.292 03:02:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:49.292 03:02:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:49.292 03:02:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:49.292 03:02:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:49.292 03:02:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:49.292 03:02:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:49.550 03:02:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:49.550 03:02:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:49.550 03:02:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:49.550 03:02:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:49.550 03:02:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:49.550 03:02:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:49.550 03:02:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:49.550 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:49.550 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:07:49.550 00:07:49.550 --- 10.0.0.2 ping statistics --- 00:07:49.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:49.550 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:07:49.550 03:02:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:49.550 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:49.550 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.059 ms 00:07:49.550 00:07:49.550 --- 10.0.0.1 ping statistics --- 00:07:49.550 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:49.550 rtt min/avg/max/mdev = 0.059/0.059/0.059/0.000 ms 00:07:49.550 03:02:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:49.550 03:02:52 -- nvmf/common.sh@410 -- # return 0 00:07:49.550 03:02:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:49.550 03:02:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:49.550 03:02:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:49.550 03:02:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:49.550 03:02:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:49.550 03:02:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:49.550 03:02:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:49.550 03:02:52 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:49.550 03:02:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:49.550 03:02:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.550 03:02:52 -- common/autotest_common.sh@10 -- # set +x 00:07:49.550 ************************************ 00:07:49.550 START TEST nvmf_filesystem_no_in_capsule 00:07:49.550 ************************************ 00:07:49.550 03:02:52 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:49.550 03:02:52 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:49.550 03:02:52 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:49.550 03:02:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:49.550 03:02:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:49.550 03:02:52 -- common/autotest_common.sh@10 -- # set +x 00:07:49.550 03:02:52 -- nvmf/common.sh@469 -- # nvmfpid=2353264 00:07:49.550 03:02:52 -- nvmf/common.sh@470 -- # waitforlisten 2353264 00:07:49.550 03:02:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:49.550 03:02:52 -- common/autotest_common.sh@829 -- # '[' -z 2353264 ']' 00:07:49.550 03:02:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:49.550 03:02:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:49.550 03:02:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:49.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:49.550 03:02:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:49.550 03:02:52 -- common/autotest_common.sh@10 -- # set +x 00:07:49.550 [2024-11-27 03:02:52.103177] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:49.550 [2024-11-27 03:02:52.103264] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:49.550 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.809 [2024-11-27 03:02:52.172589] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:49.809 [2024-11-27 03:02:52.268438] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:49.809 [2024-11-27 03:02:52.268608] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:49.809 [2024-11-27 03:02:52.268629] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:49.809 [2024-11-27 03:02:52.268642] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:49.809 [2024-11-27 03:02:52.268702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:49.809 [2024-11-27 03:02:52.268738] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:49.809 [2024-11-27 03:02:52.268789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:49.809 [2024-11-27 03:02:52.268792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:50.744 03:02:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:50.744 03:02:53 -- common/autotest_common.sh@862 -- # return 0 00:07:50.744 03:02:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:50.744 03:02:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:50.744 03:02:53 -- common/autotest_common.sh@10 -- # set +x 00:07:50.744 03:02:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:50.744 03:02:53 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:50.744 03:02:53 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:50.744 03:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.744 03:02:53 -- common/autotest_common.sh@10 -- # set +x 00:07:50.744 [2024-11-27 03:02:53.136282] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:50.744 03:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.744 03:02:53 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:50.744 03:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.744 03:02:53 -- common/autotest_common.sh@10 -- # set +x 00:07:50.744 Malloc1 00:07:50.744 03:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.744 03:02:53 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:50.744 03:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.744 03:02:53 -- common/autotest_common.sh@10 -- # set +x 00:07:50.744 03:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.744 03:02:53 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:50.744 03:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.744 03:02:53 -- common/autotest_common.sh@10 -- # set +x 00:07:50.744 03:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.744 03:02:53 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:50.744 03:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.744 03:02:53 -- common/autotest_common.sh@10 -- # set +x 00:07:50.744 [2024-11-27 03:02:53.322919] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:50.744 03:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.744 03:02:53 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:50.744 03:02:53 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:50.744 03:02:53 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:50.744 03:02:53 -- common/autotest_common.sh@1369 -- # local bs 00:07:50.744 03:02:53 -- common/autotest_common.sh@1370 -- # local nb 00:07:50.744 03:02:53 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:50.744 03:02:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.744 03:02:53 -- common/autotest_common.sh@10 -- # set +x 00:07:50.744 03:02:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.744 03:02:53 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:50.744 { 00:07:50.744 "name": "Malloc1", 00:07:50.744 "aliases": [ 00:07:50.744 "86bf4355-9f75-46a7-b688-f57492c4335a" 00:07:50.744 ], 00:07:50.744 "product_name": "Malloc disk", 00:07:50.744 "block_size": 512, 00:07:50.744 "num_blocks": 1048576, 00:07:50.744 "uuid": "86bf4355-9f75-46a7-b688-f57492c4335a", 00:07:50.744 "assigned_rate_limits": { 00:07:50.744 "rw_ios_per_sec": 0, 00:07:50.744 "rw_mbytes_per_sec": 0, 00:07:50.744 "r_mbytes_per_sec": 0, 00:07:50.744 "w_mbytes_per_sec": 0 00:07:50.744 }, 00:07:50.744 "claimed": true, 00:07:50.744 "claim_type": "exclusive_write", 00:07:50.744 "zoned": false, 00:07:50.744 "supported_io_types": { 00:07:50.744 "read": true, 00:07:50.744 "write": true, 00:07:50.744 "unmap": true, 00:07:50.744 "write_zeroes": true, 00:07:50.744 "flush": true, 00:07:50.744 "reset": true, 00:07:50.744 "compare": false, 00:07:50.744 "compare_and_write": false, 00:07:50.744 "abort": true, 00:07:50.744 "nvme_admin": false, 00:07:50.744 "nvme_io": false 00:07:50.744 }, 00:07:50.744 "memory_domains": [ 00:07:50.744 { 00:07:50.744 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:50.744 "dma_device_type": 2 00:07:50.744 } 00:07:50.744 ], 00:07:50.744 "driver_specific": {} 00:07:50.744 } 00:07:50.744 ]' 00:07:50.744 03:02:53 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:51.002 03:02:53 -- common/autotest_common.sh@1372 -- # bs=512 00:07:51.002 03:02:53 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:51.002 03:02:53 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:51.002 03:02:53 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:51.002 03:02:53 -- common/autotest_common.sh@1377 -- # echo 512 00:07:51.002 03:02:53 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:51.002 03:02:53 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:51.570 03:02:54 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:51.570 03:02:54 -- common/autotest_common.sh@1187 -- # local i=0 00:07:51.570 03:02:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:51.570 03:02:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:51.570 03:02:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:54.107 03:02:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:54.107 03:02:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:54.107 03:02:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:54.107 03:02:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:54.107 03:02:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:54.107 03:02:56 -- common/autotest_common.sh@1197 -- # return 0 00:07:54.107 03:02:56 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:54.107 03:02:56 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:54.107 03:02:56 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:54.107 03:02:56 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:54.107 03:02:56 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:54.107 03:02:56 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:54.107 03:02:56 -- setup/common.sh@80 -- # echo 536870912 00:07:54.107 03:02:56 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:54.107 03:02:56 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:54.107 03:02:56 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:54.107 03:02:56 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:54.107 03:02:56 -- target/filesystem.sh@69 -- # partprobe 00:07:54.674 03:02:57 -- target/filesystem.sh@70 -- # sleep 1 00:07:56.054 03:02:58 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:56.054 03:02:58 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:56.054 03:02:58 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:56.054 03:02:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:56.054 03:02:58 -- common/autotest_common.sh@10 -- # set +x 00:07:56.054 ************************************ 00:07:56.054 START TEST filesystem_ext4 00:07:56.054 ************************************ 00:07:56.054 03:02:58 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:56.054 03:02:58 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:56.054 03:02:58 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:56.054 03:02:58 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:56.054 03:02:58 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:56.054 03:02:58 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:56.054 03:02:58 -- common/autotest_common.sh@914 -- # local i=0 00:07:56.054 03:02:58 -- common/autotest_common.sh@915 -- # local force 00:07:56.054 03:02:58 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:56.054 03:02:58 -- common/autotest_common.sh@918 -- # force=-F 00:07:56.054 03:02:58 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:56.054 mke2fs 1.47.0 (5-Feb-2023) 00:07:56.054 Discarding device blocks: 0/522240 done 00:07:56.054 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:56.054 Filesystem UUID: 11f4fb34-42f0-432f-9b52-c43f69215501 00:07:56.054 Superblock backups stored on blocks: 00:07:56.054 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:56.054 00:07:56.054 Allocating group tables: 0/64 done 00:07:56.054 Writing inode tables: 0/64 done 00:07:56.054 Creating journal (8192 blocks): done 00:07:57.434 Writing superblocks and filesystem accounting information: 0/64 done 00:07:57.434 00:07:57.434 03:02:59 -- common/autotest_common.sh@931 -- # return 0 00:07:57.434 03:02:59 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:02.708 03:03:05 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:02.708 03:03:05 -- target/filesystem.sh@25 -- # sync 00:08:02.708 03:03:05 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:02.708 03:03:05 -- target/filesystem.sh@27 -- # sync 00:08:02.708 03:03:05 -- target/filesystem.sh@29 -- # i=0 00:08:02.708 03:03:05 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:02.970 03:03:05 -- target/filesystem.sh@37 -- # kill -0 2353264 00:08:02.970 03:03:05 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:02.970 03:03:05 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:02.970 03:03:05 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:02.970 03:03:05 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:02.970 00:08:02.970 real 0m7.083s 00:08:02.970 user 0m0.017s 00:08:02.970 sys 0m0.057s 00:08:02.970 03:03:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:02.970 03:03:05 -- common/autotest_common.sh@10 -- # set +x 00:08:02.970 ************************************ 00:08:02.970 END TEST filesystem_ext4 00:08:02.970 ************************************ 00:08:02.970 03:03:05 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:02.970 03:03:05 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:02.970 03:03:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:02.970 03:03:05 -- common/autotest_common.sh@10 -- # set +x 00:08:02.970 ************************************ 00:08:02.970 START TEST filesystem_btrfs 00:08:02.970 ************************************ 00:08:02.970 03:03:05 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:02.970 03:03:05 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:02.970 03:03:05 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:02.970 03:03:05 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:02.970 03:03:05 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:02.970 03:03:05 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:02.970 03:03:05 -- common/autotest_common.sh@914 -- # local i=0 00:08:02.970 03:03:05 -- common/autotest_common.sh@915 -- # local force 00:08:02.970 03:03:05 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:02.970 03:03:05 -- common/autotest_common.sh@920 -- # force=-f 00:08:02.970 03:03:05 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:02.970 btrfs-progs v6.8.1 00:08:02.970 See https://btrfs.readthedocs.io for more information. 00:08:02.970 00:08:02.970 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:02.970 NOTE: several default settings have changed in version 5.15, please make sure 00:08:02.970 this does not affect your deployments: 00:08:02.970 - DUP for metadata (-m dup) 00:08:02.970 - enabled no-holes (-O no-holes) 00:08:02.970 - enabled free-space-tree (-R free-space-tree) 00:08:02.970 00:08:02.970 Label: (null) 00:08:02.970 UUID: 2f88946c-f120-4ba3-8dc7-6cc53368f317 00:08:02.970 Node size: 16384 00:08:02.970 Sector size: 4096 (CPU page size: 4096) 00:08:02.970 Filesystem size: 510.00MiB 00:08:02.970 Block group profiles: 00:08:02.970 Data: single 8.00MiB 00:08:02.970 Metadata: DUP 32.00MiB 00:08:02.970 System: DUP 8.00MiB 00:08:02.970 SSD detected: yes 00:08:02.970 Zoned device: no 00:08:02.970 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:02.970 Checksum: crc32c 00:08:02.970 Number of devices: 1 00:08:02.970 Devices: 00:08:02.970 ID SIZE PATH 00:08:02.970 1 510.00MiB /dev/nvme0n1p1 00:08:02.970 00:08:02.970 03:03:05 -- common/autotest_common.sh@931 -- # return 0 00:08:02.970 03:03:05 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:03.540 03:03:06 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:03.540 03:03:06 -- target/filesystem.sh@25 -- # sync 00:08:03.540 03:03:06 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:03.540 03:03:06 -- target/filesystem.sh@27 -- # sync 00:08:03.540 03:03:06 -- target/filesystem.sh@29 -- # i=0 00:08:03.540 03:03:06 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:03.540 03:03:06 -- target/filesystem.sh@37 -- # kill -0 2353264 00:08:03.540 03:03:06 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:03.540 03:03:06 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:03.540 03:03:06 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:03.540 03:03:06 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:03.798 00:08:03.798 real 0m0.792s 00:08:03.798 user 0m0.016s 00:08:03.798 sys 0m0.108s 00:08:03.798 03:03:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:03.798 03:03:06 -- common/autotest_common.sh@10 -- # set +x 00:08:03.798 ************************************ 00:08:03.798 END TEST filesystem_btrfs 00:08:03.798 ************************************ 00:08:03.798 03:03:06 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:03.798 03:03:06 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:03.798 03:03:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.798 03:03:06 -- common/autotest_common.sh@10 -- # set +x 00:08:03.798 ************************************ 00:08:03.798 START TEST filesystem_xfs 00:08:03.798 ************************************ 00:08:03.798 03:03:06 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:03.798 03:03:06 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:03.798 03:03:06 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:03.798 03:03:06 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:03.798 03:03:06 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:03.798 03:03:06 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:03.798 03:03:06 -- common/autotest_common.sh@914 -- # local i=0 00:08:03.798 03:03:06 -- common/autotest_common.sh@915 -- # local force 00:08:03.798 03:03:06 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:03.798 03:03:06 -- common/autotest_common.sh@920 -- # force=-f 00:08:03.798 03:03:06 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:04.058 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:04.058 = sectsz=512 attr=2, projid32bit=1 00:08:04.058 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:04.058 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:04.058 data = bsize=4096 blocks=130560, imaxpct=25 00:08:04.058 = sunit=0 swidth=0 blks 00:08:04.058 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:04.058 log =internal log bsize=4096 blocks=16384, version=2 00:08:04.058 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:04.058 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:04.998 Discarding blocks...Done. 00:08:04.998 03:03:07 -- common/autotest_common.sh@931 -- # return 0 00:08:04.998 03:03:07 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:06.898 03:03:09 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:06.898 03:03:09 -- target/filesystem.sh@25 -- # sync 00:08:06.898 03:03:09 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:06.898 03:03:09 -- target/filesystem.sh@27 -- # sync 00:08:06.898 03:03:09 -- target/filesystem.sh@29 -- # i=0 00:08:06.898 03:03:09 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:07.156 03:03:09 -- target/filesystem.sh@37 -- # kill -0 2353264 00:08:07.156 03:03:09 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:07.156 03:03:09 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:07.156 03:03:09 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:07.156 03:03:09 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:07.156 00:08:07.156 real 0m3.349s 00:08:07.156 user 0m0.024s 00:08:07.156 sys 0m0.050s 00:08:07.156 03:03:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:07.156 03:03:09 -- common/autotest_common.sh@10 -- # set +x 00:08:07.156 ************************************ 00:08:07.156 END TEST filesystem_xfs 00:08:07.156 ************************************ 00:08:07.156 03:03:09 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:07.156 03:03:09 -- target/filesystem.sh@93 -- # sync 00:08:07.156 03:03:09 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:07.156 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:07.156 03:03:09 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:07.156 03:03:09 -- common/autotest_common.sh@1208 -- # local i=0 00:08:07.156 03:03:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:07.156 03:03:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:07.157 03:03:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:07.157 03:03:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:07.157 03:03:09 -- common/autotest_common.sh@1220 -- # return 0 00:08:07.157 03:03:09 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:07.157 03:03:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:07.157 03:03:09 -- common/autotest_common.sh@10 -- # set +x 00:08:07.157 03:03:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:07.157 03:03:09 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:07.157 03:03:09 -- target/filesystem.sh@101 -- # killprocess 2353264 00:08:07.157 03:03:09 -- common/autotest_common.sh@936 -- # '[' -z 2353264 ']' 00:08:07.157 03:03:09 -- common/autotest_common.sh@940 -- # kill -0 2353264 00:08:07.157 03:03:09 -- common/autotest_common.sh@941 -- # uname 00:08:07.157 03:03:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:07.157 03:03:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2353264 00:08:07.157 03:03:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:07.157 03:03:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:07.157 03:03:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2353264' 00:08:07.157 killing process with pid 2353264 00:08:07.157 03:03:09 -- common/autotest_common.sh@955 -- # kill 2353264 00:08:07.157 03:03:09 -- common/autotest_common.sh@960 -- # wait 2353264 00:08:07.724 03:03:10 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:07.724 00:08:07.724 real 0m18.099s 00:08:07.724 user 1m10.220s 00:08:07.724 sys 0m2.145s 00:08:07.724 03:03:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:07.724 03:03:10 -- common/autotest_common.sh@10 -- # set +x 00:08:07.724 ************************************ 00:08:07.724 END TEST nvmf_filesystem_no_in_capsule 00:08:07.724 ************************************ 00:08:07.724 03:03:10 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:07.724 03:03:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:07.724 03:03:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:07.724 03:03:10 -- common/autotest_common.sh@10 -- # set +x 00:08:07.724 ************************************ 00:08:07.724 START TEST nvmf_filesystem_in_capsule 00:08:07.724 ************************************ 00:08:07.724 03:03:10 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:07.724 03:03:10 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:07.724 03:03:10 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:07.724 03:03:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:07.724 03:03:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:07.724 03:03:10 -- common/autotest_common.sh@10 -- # set +x 00:08:07.724 03:03:10 -- nvmf/common.sh@469 -- # nvmfpid=2356302 00:08:07.724 03:03:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:07.724 03:03:10 -- nvmf/common.sh@470 -- # waitforlisten 2356302 00:08:07.724 03:03:10 -- common/autotest_common.sh@829 -- # '[' -z 2356302 ']' 00:08:07.724 03:03:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:07.724 03:03:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:07.724 03:03:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:07.724 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:07.724 03:03:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:07.724 03:03:10 -- common/autotest_common.sh@10 -- # set +x 00:08:07.724 [2024-11-27 03:03:10.228901] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:07.724 [2024-11-27 03:03:10.229010] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:07.724 EAL: No free 2048 kB hugepages reported on node 1 00:08:07.724 [2024-11-27 03:03:10.301259] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:07.983 [2024-11-27 03:03:10.393641] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:07.984 [2024-11-27 03:03:10.393797] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:07.984 [2024-11-27 03:03:10.393813] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:07.984 [2024-11-27 03:03:10.393825] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:07.984 [2024-11-27 03:03:10.394168] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:07.984 [2024-11-27 03:03:10.394245] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:07.984 [2024-11-27 03:03:10.394328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:07.984 [2024-11-27 03:03:10.394330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:08.920 03:03:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:08.920 03:03:11 -- common/autotest_common.sh@862 -- # return 0 00:08:08.920 03:03:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:08.920 03:03:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:08.920 03:03:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.920 03:03:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:08.920 03:03:11 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:08.920 03:03:11 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:08.920 03:03:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:08.920 03:03:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.920 [2024-11-27 03:03:11.226142] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:08.920 03:03:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:08.920 03:03:11 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:08.920 03:03:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:08.920 03:03:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.920 Malloc1 00:08:08.920 03:03:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:08.920 03:03:11 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:08.920 03:03:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:08.920 03:03:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.920 03:03:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:08.920 03:03:11 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:08.920 03:03:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:08.920 03:03:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.920 03:03:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:08.920 03:03:11 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:08.920 03:03:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:08.920 03:03:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.920 [2024-11-27 03:03:11.415963] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:08.920 03:03:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:08.920 03:03:11 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:08.920 03:03:11 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:08.921 03:03:11 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:08.921 03:03:11 -- common/autotest_common.sh@1369 -- # local bs 00:08:08.921 03:03:11 -- common/autotest_common.sh@1370 -- # local nb 00:08:08.921 03:03:11 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:08.921 03:03:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:08.921 03:03:11 -- common/autotest_common.sh@10 -- # set +x 00:08:08.921 03:03:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:08.921 03:03:11 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:08.921 { 00:08:08.921 "name": "Malloc1", 00:08:08.921 "aliases": [ 00:08:08.921 "eb126496-29c0-4336-b924-7f640a357523" 00:08:08.921 ], 00:08:08.921 "product_name": "Malloc disk", 00:08:08.921 "block_size": 512, 00:08:08.921 "num_blocks": 1048576, 00:08:08.921 "uuid": "eb126496-29c0-4336-b924-7f640a357523", 00:08:08.921 "assigned_rate_limits": { 00:08:08.921 "rw_ios_per_sec": 0, 00:08:08.921 "rw_mbytes_per_sec": 0, 00:08:08.921 "r_mbytes_per_sec": 0, 00:08:08.921 "w_mbytes_per_sec": 0 00:08:08.921 }, 00:08:08.921 "claimed": true, 00:08:08.921 "claim_type": "exclusive_write", 00:08:08.921 "zoned": false, 00:08:08.921 "supported_io_types": { 00:08:08.921 "read": true, 00:08:08.921 "write": true, 00:08:08.921 "unmap": true, 00:08:08.921 "write_zeroes": true, 00:08:08.921 "flush": true, 00:08:08.921 "reset": true, 00:08:08.921 "compare": false, 00:08:08.921 "compare_and_write": false, 00:08:08.921 "abort": true, 00:08:08.921 "nvme_admin": false, 00:08:08.921 "nvme_io": false 00:08:08.921 }, 00:08:08.921 "memory_domains": [ 00:08:08.921 { 00:08:08.921 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:08.921 "dma_device_type": 2 00:08:08.921 } 00:08:08.921 ], 00:08:08.921 "driver_specific": {} 00:08:08.921 } 00:08:08.921 ]' 00:08:08.921 03:03:11 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:08.921 03:03:11 -- common/autotest_common.sh@1372 -- # bs=512 00:08:08.921 03:03:11 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:08.921 03:03:11 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:08.921 03:03:11 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:08.921 03:03:11 -- common/autotest_common.sh@1377 -- # echo 512 00:08:08.921 03:03:11 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:08.921 03:03:11 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:09.533 03:03:12 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:09.533 03:03:12 -- common/autotest_common.sh@1187 -- # local i=0 00:08:09.533 03:03:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:09.533 03:03:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:09.533 03:03:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:12.070 03:03:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:12.070 03:03:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:12.070 03:03:14 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:12.070 03:03:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:12.070 03:03:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:12.070 03:03:14 -- common/autotest_common.sh@1197 -- # return 0 00:08:12.070 03:03:14 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:12.070 03:03:14 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:12.070 03:03:14 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:12.070 03:03:14 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:12.070 03:03:14 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:12.070 03:03:14 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:12.070 03:03:14 -- setup/common.sh@80 -- # echo 536870912 00:08:12.070 03:03:14 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:12.070 03:03:14 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:12.070 03:03:14 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:12.070 03:03:14 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:12.070 03:03:14 -- target/filesystem.sh@69 -- # partprobe 00:08:12.330 03:03:14 -- target/filesystem.sh@70 -- # sleep 1 00:08:13.265 03:03:15 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:13.265 03:03:15 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:13.265 03:03:15 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:13.265 03:03:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:13.265 03:03:15 -- common/autotest_common.sh@10 -- # set +x 00:08:13.265 ************************************ 00:08:13.265 START TEST filesystem_in_capsule_ext4 00:08:13.265 ************************************ 00:08:13.265 03:03:15 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:13.265 03:03:15 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:13.265 03:03:15 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:13.265 03:03:15 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:13.265 03:03:15 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:13.265 03:03:15 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:13.265 03:03:15 -- common/autotest_common.sh@914 -- # local i=0 00:08:13.265 03:03:15 -- common/autotest_common.sh@915 -- # local force 00:08:13.265 03:03:15 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:13.265 03:03:15 -- common/autotest_common.sh@918 -- # force=-F 00:08:13.265 03:03:15 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:13.265 mke2fs 1.47.0 (5-Feb-2023) 00:08:13.265 Discarding device blocks: 0/522240 done 00:08:13.265 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:13.265 Filesystem UUID: 81faf4e6-e978-472f-b89f-af5f65559760 00:08:13.265 Superblock backups stored on blocks: 00:08:13.265 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:13.265 00:08:13.265 Allocating group tables: 0/64 done 00:08:13.524 Writing inode tables: 0/64 done 00:08:13.524 Creating journal (8192 blocks): done 00:08:15.730 Writing superblocks and filesystem accounting information: 0/6426/64 done 00:08:15.730 00:08:15.730 03:03:18 -- common/autotest_common.sh@931 -- # return 0 00:08:15.730 03:03:18 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:22.303 03:03:24 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:22.303 03:03:24 -- target/filesystem.sh@25 -- # sync 00:08:22.303 03:03:24 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:22.303 03:03:24 -- target/filesystem.sh@27 -- # sync 00:08:22.303 03:03:24 -- target/filesystem.sh@29 -- # i=0 00:08:22.303 03:03:24 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:22.303 03:03:24 -- target/filesystem.sh@37 -- # kill -0 2356302 00:08:22.303 03:03:24 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:22.303 03:03:24 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:22.303 03:03:24 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:22.303 03:03:24 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:22.303 00:08:22.303 real 0m8.452s 00:08:22.303 user 0m0.017s 00:08:22.303 sys 0m0.067s 00:08:22.303 03:03:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:22.303 03:03:24 -- common/autotest_common.sh@10 -- # set +x 00:08:22.303 ************************************ 00:08:22.303 END TEST filesystem_in_capsule_ext4 00:08:22.303 ************************************ 00:08:22.304 03:03:24 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:22.304 03:03:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:22.304 03:03:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:22.304 03:03:24 -- common/autotest_common.sh@10 -- # set +x 00:08:22.304 ************************************ 00:08:22.304 START TEST filesystem_in_capsule_btrfs 00:08:22.304 ************************************ 00:08:22.304 03:03:24 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:22.304 03:03:24 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:22.304 03:03:24 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:22.304 03:03:24 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:22.304 03:03:24 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:22.304 03:03:24 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:22.304 03:03:24 -- common/autotest_common.sh@914 -- # local i=0 00:08:22.304 03:03:24 -- common/autotest_common.sh@915 -- # local force 00:08:22.304 03:03:24 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:22.304 03:03:24 -- common/autotest_common.sh@920 -- # force=-f 00:08:22.304 03:03:24 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:22.304 btrfs-progs v6.8.1 00:08:22.304 See https://btrfs.readthedocs.io for more information. 00:08:22.304 00:08:22.304 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:22.304 NOTE: several default settings have changed in version 5.15, please make sure 00:08:22.304 this does not affect your deployments: 00:08:22.304 - DUP for metadata (-m dup) 00:08:22.304 - enabled no-holes (-O no-holes) 00:08:22.304 - enabled free-space-tree (-R free-space-tree) 00:08:22.304 00:08:22.304 Label: (null) 00:08:22.304 UUID: 0151a45f-9875-423e-9cc6-e2c1e2559fe4 00:08:22.304 Node size: 16384 00:08:22.304 Sector size: 4096 (CPU page size: 4096) 00:08:22.304 Filesystem size: 510.00MiB 00:08:22.304 Block group profiles: 00:08:22.304 Data: single 8.00MiB 00:08:22.304 Metadata: DUP 32.00MiB 00:08:22.304 System: DUP 8.00MiB 00:08:22.304 SSD detected: yes 00:08:22.304 Zoned device: no 00:08:22.304 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:22.304 Checksum: crc32c 00:08:22.304 Number of devices: 1 00:08:22.304 Devices: 00:08:22.304 ID SIZE PATH 00:08:22.304 1 510.00MiB /dev/nvme0n1p1 00:08:22.304 00:08:22.304 03:03:24 -- common/autotest_common.sh@931 -- # return 0 00:08:22.304 03:03:24 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:22.304 03:03:24 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:22.304 03:03:24 -- target/filesystem.sh@25 -- # sync 00:08:22.304 03:03:24 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:22.304 03:03:24 -- target/filesystem.sh@27 -- # sync 00:08:22.304 03:03:24 -- target/filesystem.sh@29 -- # i=0 00:08:22.304 03:03:24 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:22.564 03:03:24 -- target/filesystem.sh@37 -- # kill -0 2356302 00:08:22.564 03:03:24 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:22.564 03:03:24 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:22.564 03:03:24 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:22.564 03:03:24 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:22.564 00:08:22.564 real 0m0.683s 00:08:22.564 user 0m0.012s 00:08:22.564 sys 0m0.100s 00:08:22.564 03:03:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:22.564 03:03:24 -- common/autotest_common.sh@10 -- # set +x 00:08:22.564 ************************************ 00:08:22.564 END TEST filesystem_in_capsule_btrfs 00:08:22.564 ************************************ 00:08:22.564 03:03:24 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:22.564 03:03:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:22.564 03:03:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:22.564 03:03:24 -- common/autotest_common.sh@10 -- # set +x 00:08:22.564 ************************************ 00:08:22.564 START TEST filesystem_in_capsule_xfs 00:08:22.564 ************************************ 00:08:22.564 03:03:24 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:22.564 03:03:24 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:22.564 03:03:24 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:22.564 03:03:24 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:22.564 03:03:24 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:22.564 03:03:24 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:22.564 03:03:24 -- common/autotest_common.sh@914 -- # local i=0 00:08:22.564 03:03:24 -- common/autotest_common.sh@915 -- # local force 00:08:22.564 03:03:24 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:22.564 03:03:24 -- common/autotest_common.sh@920 -- # force=-f 00:08:22.564 03:03:24 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:22.564 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:22.564 = sectsz=512 attr=2, projid32bit=1 00:08:22.564 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:22.564 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:22.564 data = bsize=4096 blocks=130560, imaxpct=25 00:08:22.564 = sunit=0 swidth=0 blks 00:08:22.564 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:22.564 log =internal log bsize=4096 blocks=16384, version=2 00:08:22.564 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:22.564 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:23.505 Discarding blocks...Done. 00:08:23.506 03:03:25 -- common/autotest_common.sh@931 -- # return 0 00:08:23.506 03:03:25 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:26.045 03:03:28 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:26.045 03:03:28 -- target/filesystem.sh@25 -- # sync 00:08:26.045 03:03:28 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:26.045 03:03:28 -- target/filesystem.sh@27 -- # sync 00:08:26.045 03:03:28 -- target/filesystem.sh@29 -- # i=0 00:08:26.045 03:03:28 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:26.045 03:03:28 -- target/filesystem.sh@37 -- # kill -0 2356302 00:08:26.045 03:03:28 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:26.045 03:03:28 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:26.045 03:03:28 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:26.045 03:03:28 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:26.045 00:08:26.045 real 0m3.388s 00:08:26.045 user 0m0.015s 00:08:26.045 sys 0m0.063s 00:08:26.045 03:03:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:26.045 03:03:28 -- common/autotest_common.sh@10 -- # set +x 00:08:26.045 ************************************ 00:08:26.045 END TEST filesystem_in_capsule_xfs 00:08:26.045 ************************************ 00:08:26.045 03:03:28 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:26.045 03:03:28 -- target/filesystem.sh@93 -- # sync 00:08:26.045 03:03:28 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:26.302 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.302 03:03:28 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:26.302 03:03:28 -- common/autotest_common.sh@1208 -- # local i=0 00:08:26.302 03:03:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:26.302 03:03:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:26.302 03:03:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:26.302 03:03:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:26.302 03:03:28 -- common/autotest_common.sh@1220 -- # return 0 00:08:26.302 03:03:28 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:26.302 03:03:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:26.302 03:03:28 -- common/autotest_common.sh@10 -- # set +x 00:08:26.302 03:03:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:26.302 03:03:28 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:26.302 03:03:28 -- target/filesystem.sh@101 -- # killprocess 2356302 00:08:26.302 03:03:28 -- common/autotest_common.sh@936 -- # '[' -z 2356302 ']' 00:08:26.302 03:03:28 -- common/autotest_common.sh@940 -- # kill -0 2356302 00:08:26.302 03:03:28 -- common/autotest_common.sh@941 -- # uname 00:08:26.302 03:03:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:26.302 03:03:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2356302 00:08:26.302 03:03:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:26.302 03:03:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:26.302 03:03:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2356302' 00:08:26.302 killing process with pid 2356302 00:08:26.302 03:03:28 -- common/autotest_common.sh@955 -- # kill 2356302 00:08:26.302 03:03:28 -- common/autotest_common.sh@960 -- # wait 2356302 00:08:26.868 03:03:29 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:26.868 00:08:26.868 real 0m19.031s 00:08:26.868 user 1m13.690s 00:08:26.868 sys 0m2.438s 00:08:26.868 03:03:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:26.868 03:03:29 -- common/autotest_common.sh@10 -- # set +x 00:08:26.868 ************************************ 00:08:26.868 END TEST nvmf_filesystem_in_capsule 00:08:26.868 ************************************ 00:08:26.868 03:03:29 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:26.868 03:03:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:26.868 03:03:29 -- nvmf/common.sh@116 -- # sync 00:08:26.868 03:03:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:26.868 03:03:29 -- nvmf/common.sh@119 -- # set +e 00:08:26.868 03:03:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:26.868 03:03:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:26.868 rmmod nvme_tcp 00:08:26.868 rmmod nvme_fabrics 00:08:26.868 rmmod nvme_keyring 00:08:26.868 03:03:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:26.868 03:03:29 -- nvmf/common.sh@123 -- # set -e 00:08:26.868 03:03:29 -- nvmf/common.sh@124 -- # return 0 00:08:26.868 03:03:29 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:26.868 03:03:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:26.868 03:03:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:26.868 03:03:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:26.868 03:03:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:26.868 03:03:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:26.868 03:03:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:26.868 03:03:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:26.868 03:03:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:28.772 03:03:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:28.772 00:08:28.772 real 0m41.878s 00:08:28.772 user 2m24.987s 00:08:28.772 sys 0m6.263s 00:08:28.772 03:03:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:28.772 03:03:31 -- common/autotest_common.sh@10 -- # set +x 00:08:28.772 ************************************ 00:08:28.772 END TEST nvmf_filesystem 00:08:28.772 ************************************ 00:08:28.772 03:03:31 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:28.772 03:03:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:28.772 03:03:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:28.772 03:03:31 -- common/autotest_common.sh@10 -- # set +x 00:08:28.772 ************************************ 00:08:28.772 START TEST nvmf_discovery 00:08:28.772 ************************************ 00:08:28.772 03:03:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:29.031 * Looking for test storage... 00:08:29.031 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:29.031 03:03:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:29.031 03:03:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:29.031 03:03:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:29.031 03:03:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:29.031 03:03:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:29.031 03:03:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:29.031 03:03:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:29.031 03:03:31 -- scripts/common.sh@335 -- # IFS=.-: 00:08:29.031 03:03:31 -- scripts/common.sh@335 -- # read -ra ver1 00:08:29.031 03:03:31 -- scripts/common.sh@336 -- # IFS=.-: 00:08:29.031 03:03:31 -- scripts/common.sh@336 -- # read -ra ver2 00:08:29.031 03:03:31 -- scripts/common.sh@337 -- # local 'op=<' 00:08:29.031 03:03:31 -- scripts/common.sh@339 -- # ver1_l=2 00:08:29.031 03:03:31 -- scripts/common.sh@340 -- # ver2_l=1 00:08:29.031 03:03:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:29.031 03:03:31 -- scripts/common.sh@343 -- # case "$op" in 00:08:29.031 03:03:31 -- scripts/common.sh@344 -- # : 1 00:08:29.031 03:03:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:29.031 03:03:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:29.031 03:03:31 -- scripts/common.sh@364 -- # decimal 1 00:08:29.031 03:03:31 -- scripts/common.sh@352 -- # local d=1 00:08:29.031 03:03:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:29.031 03:03:31 -- scripts/common.sh@354 -- # echo 1 00:08:29.031 03:03:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:29.031 03:03:31 -- scripts/common.sh@365 -- # decimal 2 00:08:29.031 03:03:31 -- scripts/common.sh@352 -- # local d=2 00:08:29.031 03:03:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:29.031 03:03:31 -- scripts/common.sh@354 -- # echo 2 00:08:29.031 03:03:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:29.031 03:03:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:29.031 03:03:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:29.031 03:03:31 -- scripts/common.sh@367 -- # return 0 00:08:29.031 03:03:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:29.031 03:03:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:29.031 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:29.031 --rc genhtml_branch_coverage=1 00:08:29.032 --rc genhtml_function_coverage=1 00:08:29.032 --rc genhtml_legend=1 00:08:29.032 --rc geninfo_all_blocks=1 00:08:29.032 --rc geninfo_unexecuted_blocks=1 00:08:29.032 00:08:29.032 ' 00:08:29.032 03:03:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:29.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:29.032 --rc genhtml_branch_coverage=1 00:08:29.032 --rc genhtml_function_coverage=1 00:08:29.032 --rc genhtml_legend=1 00:08:29.032 --rc geninfo_all_blocks=1 00:08:29.032 --rc geninfo_unexecuted_blocks=1 00:08:29.032 00:08:29.032 ' 00:08:29.032 03:03:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:29.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:29.032 --rc genhtml_branch_coverage=1 00:08:29.032 --rc genhtml_function_coverage=1 00:08:29.032 --rc genhtml_legend=1 00:08:29.032 --rc geninfo_all_blocks=1 00:08:29.032 --rc geninfo_unexecuted_blocks=1 00:08:29.032 00:08:29.032 ' 00:08:29.032 03:03:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:29.032 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:29.032 --rc genhtml_branch_coverage=1 00:08:29.032 --rc genhtml_function_coverage=1 00:08:29.032 --rc genhtml_legend=1 00:08:29.032 --rc geninfo_all_blocks=1 00:08:29.032 --rc geninfo_unexecuted_blocks=1 00:08:29.032 00:08:29.032 ' 00:08:29.032 03:03:31 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:29.032 03:03:31 -- nvmf/common.sh@7 -- # uname -s 00:08:29.032 03:03:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:29.032 03:03:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:29.032 03:03:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:29.032 03:03:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:29.032 03:03:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:29.032 03:03:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:29.032 03:03:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:29.032 03:03:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:29.032 03:03:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:29.032 03:03:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:29.032 03:03:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:29.032 03:03:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:29.032 03:03:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:29.032 03:03:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:29.032 03:03:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:29.032 03:03:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:29.032 03:03:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:29.032 03:03:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:29.032 03:03:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:29.032 03:03:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:29.032 03:03:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:29.032 03:03:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:29.032 03:03:31 -- paths/export.sh@5 -- # export PATH 00:08:29.032 03:03:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:29.032 03:03:31 -- nvmf/common.sh@46 -- # : 0 00:08:29.032 03:03:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:29.032 03:03:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:29.032 03:03:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:29.032 03:03:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:29.032 03:03:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:29.032 03:03:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:29.032 03:03:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:29.032 03:03:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:29.032 03:03:31 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:29.032 03:03:31 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:29.032 03:03:31 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:29.032 03:03:31 -- target/discovery.sh@15 -- # hash nvme 00:08:29.032 03:03:31 -- target/discovery.sh@20 -- # nvmftestinit 00:08:29.032 03:03:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:29.032 03:03:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:29.032 03:03:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:29.032 03:03:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:29.032 03:03:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:29.032 03:03:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:29.032 03:03:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:29.032 03:03:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:29.032 03:03:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:29.032 03:03:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:29.032 03:03:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:29.032 03:03:31 -- common/autotest_common.sh@10 -- # set +x 00:08:31.570 03:03:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:31.570 03:03:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:31.570 03:03:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:31.570 03:03:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:31.570 03:03:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:31.570 03:03:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:31.570 03:03:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:31.570 03:03:33 -- nvmf/common.sh@294 -- # net_devs=() 00:08:31.570 03:03:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:31.570 03:03:33 -- nvmf/common.sh@295 -- # e810=() 00:08:31.570 03:03:33 -- nvmf/common.sh@295 -- # local -ga e810 00:08:31.570 03:03:33 -- nvmf/common.sh@296 -- # x722=() 00:08:31.570 03:03:33 -- nvmf/common.sh@296 -- # local -ga x722 00:08:31.571 03:03:33 -- nvmf/common.sh@297 -- # mlx=() 00:08:31.571 03:03:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:31.571 03:03:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:31.571 03:03:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:31.571 03:03:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:31.571 03:03:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:31.571 03:03:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:31.571 03:03:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:31.571 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:31.571 03:03:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:31.571 03:03:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:31.571 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:31.571 03:03:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:31.571 03:03:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:31.571 03:03:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:31.571 03:03:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:31.571 03:03:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:31.571 03:03:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:31.571 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:31.571 03:03:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:31.571 03:03:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:31.571 03:03:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:31.571 03:03:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:31.571 03:03:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:31.571 03:03:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:31.571 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:31.571 03:03:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:31.571 03:03:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:31.571 03:03:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:31.571 03:03:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:31.571 03:03:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:31.571 03:03:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:31.571 03:03:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:31.571 03:03:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:31.571 03:03:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:31.571 03:03:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:31.571 03:03:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:31.571 03:03:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:31.571 03:03:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:31.571 03:03:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:31.571 03:03:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:31.571 03:03:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:31.571 03:03:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:31.571 03:03:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:31.571 03:03:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:31.571 03:03:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:31.571 03:03:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:31.571 03:03:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:31.571 03:03:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:31.571 03:03:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:31.571 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:31.571 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:08:31.571 00:08:31.571 --- 10.0.0.2 ping statistics --- 00:08:31.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:31.571 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:08:31.571 03:03:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:31.571 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:31.571 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:08:31.571 00:08:31.571 --- 10.0.0.1 ping statistics --- 00:08:31.571 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:31.571 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:08:31.571 03:03:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:31.571 03:03:33 -- nvmf/common.sh@410 -- # return 0 00:08:31.571 03:03:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:31.571 03:03:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:31.571 03:03:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:31.571 03:03:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:31.571 03:03:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:31.571 03:03:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:31.571 03:03:33 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:31.571 03:03:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:31.571 03:03:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:31.571 03:03:33 -- common/autotest_common.sh@10 -- # set +x 00:08:31.571 03:03:33 -- nvmf/common.sh@469 -- # nvmfpid=2360743 00:08:31.571 03:03:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:31.571 03:03:33 -- nvmf/common.sh@470 -- # waitforlisten 2360743 00:08:31.571 03:03:33 -- common/autotest_common.sh@829 -- # '[' -z 2360743 ']' 00:08:31.571 03:03:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:31.571 03:03:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:31.571 03:03:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:31.571 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:31.571 03:03:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:31.571 03:03:33 -- common/autotest_common.sh@10 -- # set +x 00:08:31.571 [2024-11-27 03:03:33.823589] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:31.571 [2024-11-27 03:03:33.823677] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:31.571 EAL: No free 2048 kB hugepages reported on node 1 00:08:31.571 [2024-11-27 03:03:33.897010] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:31.571 [2024-11-27 03:03:33.981782] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:31.571 [2024-11-27 03:03:33.981922] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:31.571 [2024-11-27 03:03:33.981938] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:31.571 [2024-11-27 03:03:33.981950] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:31.571 [2024-11-27 03:03:33.982091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:31.571 [2024-11-27 03:03:33.982215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:31.571 [2024-11-27 03:03:33.982385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:31.571 [2024-11-27 03:03:33.982388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:32.510 03:03:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:32.510 03:03:34 -- common/autotest_common.sh@862 -- # return 0 00:08:32.510 03:03:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:32.510 03:03:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:32.510 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.510 03:03:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:32.510 03:03:34 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:32.510 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.510 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.510 [2024-11-27 03:03:34.838293] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:32.510 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.510 03:03:34 -- target/discovery.sh@26 -- # seq 1 4 00:08:32.510 03:03:34 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:32.510 03:03:34 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:32.510 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.510 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.510 Null1 00:08:32.510 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.510 03:03:34 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:32.510 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.510 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.510 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.510 03:03:34 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:32.510 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.510 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.510 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.510 03:03:34 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 [2024-11-27 03:03:34.878640] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:32.511 03:03:34 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 Null2 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:32.511 03:03:34 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 Null3 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:32.511 03:03:34 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 Null4 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:32.511 03:03:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.511 03:03:34 -- common/autotest_common.sh@10 -- # set +x 00:08:32.511 03:03:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.511 03:03:34 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:32.771 00:08:32.771 Discovery Log Number of Records 6, Generation counter 6 00:08:32.771 =====Discovery Log Entry 0====== 00:08:32.771 trtype: tcp 00:08:32.771 adrfam: ipv4 00:08:32.771 subtype: current discovery subsystem 00:08:32.771 treq: not required 00:08:32.771 portid: 0 00:08:32.771 trsvcid: 4420 00:08:32.771 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:32.771 traddr: 10.0.0.2 00:08:32.771 eflags: explicit discovery connections, duplicate discovery information 00:08:32.771 sectype: none 00:08:32.771 =====Discovery Log Entry 1====== 00:08:32.771 trtype: tcp 00:08:32.771 adrfam: ipv4 00:08:32.771 subtype: nvme subsystem 00:08:32.771 treq: not required 00:08:32.771 portid: 0 00:08:32.771 trsvcid: 4420 00:08:32.771 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:32.771 traddr: 10.0.0.2 00:08:32.771 eflags: none 00:08:32.771 sectype: none 00:08:32.771 =====Discovery Log Entry 2====== 00:08:32.771 trtype: tcp 00:08:32.771 adrfam: ipv4 00:08:32.771 subtype: nvme subsystem 00:08:32.771 treq: not required 00:08:32.771 portid: 0 00:08:32.771 trsvcid: 4420 00:08:32.771 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:32.771 traddr: 10.0.0.2 00:08:32.771 eflags: none 00:08:32.771 sectype: none 00:08:32.771 =====Discovery Log Entry 3====== 00:08:32.771 trtype: tcp 00:08:32.771 adrfam: ipv4 00:08:32.771 subtype: nvme subsystem 00:08:32.771 treq: not required 00:08:32.771 portid: 0 00:08:32.771 trsvcid: 4420 00:08:32.771 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:32.771 traddr: 10.0.0.2 00:08:32.771 eflags: none 00:08:32.771 sectype: none 00:08:32.771 =====Discovery Log Entry 4====== 00:08:32.771 trtype: tcp 00:08:32.771 adrfam: ipv4 00:08:32.771 subtype: nvme subsystem 00:08:32.771 treq: not required 00:08:32.771 portid: 0 00:08:32.771 trsvcid: 4420 00:08:32.771 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:32.771 traddr: 10.0.0.2 00:08:32.771 eflags: none 00:08:32.771 sectype: none 00:08:32.771 =====Discovery Log Entry 5====== 00:08:32.771 trtype: tcp 00:08:32.771 adrfam: ipv4 00:08:32.771 subtype: discovery subsystem referral 00:08:32.771 treq: not required 00:08:32.771 portid: 0 00:08:32.771 trsvcid: 4430 00:08:32.771 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:32.771 traddr: 10.0.0.2 00:08:32.771 eflags: none 00:08:32.771 sectype: none 00:08:32.771 03:03:35 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:32.771 Perform nvmf subsystem discovery via RPC 00:08:32.771 03:03:35 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:32.771 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.771 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.771 [2024-11-27 03:03:35.231621] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:32.771 [ 00:08:32.771 { 00:08:32.771 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:32.771 "subtype": "Discovery", 00:08:32.771 "listen_addresses": [ 00:08:32.771 { 00:08:32.771 "transport": "TCP", 00:08:32.771 "trtype": "TCP", 00:08:32.771 "adrfam": "IPv4", 00:08:32.771 "traddr": "10.0.0.2", 00:08:32.771 "trsvcid": "4420" 00:08:32.771 } 00:08:32.771 ], 00:08:32.771 "allow_any_host": true, 00:08:32.771 "hosts": [] 00:08:32.771 }, 00:08:32.771 { 00:08:32.771 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:32.771 "subtype": "NVMe", 00:08:32.771 "listen_addresses": [ 00:08:32.771 { 00:08:32.771 "transport": "TCP", 00:08:32.771 "trtype": "TCP", 00:08:32.771 "adrfam": "IPv4", 00:08:32.771 "traddr": "10.0.0.2", 00:08:32.771 "trsvcid": "4420" 00:08:32.771 } 00:08:32.771 ], 00:08:32.771 "allow_any_host": true, 00:08:32.771 "hosts": [], 00:08:32.771 "serial_number": "SPDK00000000000001", 00:08:32.771 "model_number": "SPDK bdev Controller", 00:08:32.771 "max_namespaces": 32, 00:08:32.771 "min_cntlid": 1, 00:08:32.771 "max_cntlid": 65519, 00:08:32.771 "namespaces": [ 00:08:32.771 { 00:08:32.771 "nsid": 1, 00:08:32.771 "bdev_name": "Null1", 00:08:32.771 "name": "Null1", 00:08:32.771 "nguid": "61D97790F3D946848F15E94C0138C027", 00:08:32.771 "uuid": "61d97790-f3d9-4684-8f15-e94c0138c027" 00:08:32.771 } 00:08:32.771 ] 00:08:32.771 }, 00:08:32.771 { 00:08:32.771 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:32.771 "subtype": "NVMe", 00:08:32.771 "listen_addresses": [ 00:08:32.771 { 00:08:32.771 "transport": "TCP", 00:08:32.771 "trtype": "TCP", 00:08:32.771 "adrfam": "IPv4", 00:08:32.771 "traddr": "10.0.0.2", 00:08:32.771 "trsvcid": "4420" 00:08:32.771 } 00:08:32.771 ], 00:08:32.771 "allow_any_host": true, 00:08:32.771 "hosts": [], 00:08:32.771 "serial_number": "SPDK00000000000002", 00:08:32.771 "model_number": "SPDK bdev Controller", 00:08:32.771 "max_namespaces": 32, 00:08:32.771 "min_cntlid": 1, 00:08:32.771 "max_cntlid": 65519, 00:08:32.771 "namespaces": [ 00:08:32.771 { 00:08:32.771 "nsid": 1, 00:08:32.771 "bdev_name": "Null2", 00:08:32.771 "name": "Null2", 00:08:32.772 "nguid": "758DD6ECB3DE4D29BBE4A796BE923B29", 00:08:32.772 "uuid": "758dd6ec-b3de-4d29-bbe4-a796be923b29" 00:08:32.772 } 00:08:32.772 ] 00:08:32.772 }, 00:08:32.772 { 00:08:32.772 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:32.772 "subtype": "NVMe", 00:08:32.772 "listen_addresses": [ 00:08:32.772 { 00:08:32.772 "transport": "TCP", 00:08:32.772 "trtype": "TCP", 00:08:32.772 "adrfam": "IPv4", 00:08:32.772 "traddr": "10.0.0.2", 00:08:32.772 "trsvcid": "4420" 00:08:32.772 } 00:08:32.772 ], 00:08:32.772 "allow_any_host": true, 00:08:32.772 "hosts": [], 00:08:32.772 "serial_number": "SPDK00000000000003", 00:08:32.772 "model_number": "SPDK bdev Controller", 00:08:32.772 "max_namespaces": 32, 00:08:32.772 "min_cntlid": 1, 00:08:32.772 "max_cntlid": 65519, 00:08:32.772 "namespaces": [ 00:08:32.772 { 00:08:32.772 "nsid": 1, 00:08:32.772 "bdev_name": "Null3", 00:08:32.772 "name": "Null3", 00:08:32.772 "nguid": "6517F928828E4A6ABE372FF2820A59DB", 00:08:32.772 "uuid": "6517f928-828e-4a6a-be37-2ff2820a59db" 00:08:32.772 } 00:08:32.772 ] 00:08:32.772 }, 00:08:32.772 { 00:08:32.772 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:32.772 "subtype": "NVMe", 00:08:32.772 "listen_addresses": [ 00:08:32.772 { 00:08:32.772 "transport": "TCP", 00:08:32.772 "trtype": "TCP", 00:08:32.772 "adrfam": "IPv4", 00:08:32.772 "traddr": "10.0.0.2", 00:08:32.772 "trsvcid": "4420" 00:08:32.772 } 00:08:32.772 ], 00:08:32.772 "allow_any_host": true, 00:08:32.772 "hosts": [], 00:08:32.772 "serial_number": "SPDK00000000000004", 00:08:32.772 "model_number": "SPDK bdev Controller", 00:08:32.772 "max_namespaces": 32, 00:08:32.772 "min_cntlid": 1, 00:08:32.772 "max_cntlid": 65519, 00:08:32.772 "namespaces": [ 00:08:32.772 { 00:08:32.772 "nsid": 1, 00:08:32.772 "bdev_name": "Null4", 00:08:32.772 "name": "Null4", 00:08:32.772 "nguid": "012DEE4A45964358982906AC0AC2CD3D", 00:08:32.772 "uuid": "012dee4a-4596-4358-9829-06ac0ac2cd3d" 00:08:32.772 } 00:08:32.772 ] 00:08:32.772 } 00:08:32.772 ] 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@42 -- # seq 1 4 00:08:32.772 03:03:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:32.772 03:03:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:32.772 03:03:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:32.772 03:03:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:32.772 03:03:35 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:32.772 03:03:35 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:32.772 03:03:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:32.772 03:03:35 -- common/autotest_common.sh@10 -- # set +x 00:08:32.772 03:03:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:32.772 03:03:35 -- target/discovery.sh@49 -- # check_bdevs= 00:08:32.772 03:03:35 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:32.772 03:03:35 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:32.772 03:03:35 -- target/discovery.sh@57 -- # nvmftestfini 00:08:32.772 03:03:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:32.772 03:03:35 -- nvmf/common.sh@116 -- # sync 00:08:32.772 03:03:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:32.772 03:03:35 -- nvmf/common.sh@119 -- # set +e 00:08:32.772 03:03:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:32.772 03:03:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:32.772 rmmod nvme_tcp 00:08:32.772 rmmod nvme_fabrics 00:08:33.032 rmmod nvme_keyring 00:08:33.032 03:03:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:33.032 03:03:35 -- nvmf/common.sh@123 -- # set -e 00:08:33.032 03:03:35 -- nvmf/common.sh@124 -- # return 0 00:08:33.032 03:03:35 -- nvmf/common.sh@477 -- # '[' -n 2360743 ']' 00:08:33.032 03:03:35 -- nvmf/common.sh@478 -- # killprocess 2360743 00:08:33.032 03:03:35 -- common/autotest_common.sh@936 -- # '[' -z 2360743 ']' 00:08:33.033 03:03:35 -- common/autotest_common.sh@940 -- # kill -0 2360743 00:08:33.033 03:03:35 -- common/autotest_common.sh@941 -- # uname 00:08:33.033 03:03:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:33.033 03:03:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2360743 00:08:33.033 03:03:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:33.033 03:03:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:33.033 03:03:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2360743' 00:08:33.033 killing process with pid 2360743 00:08:33.033 03:03:35 -- common/autotest_common.sh@955 -- # kill 2360743 00:08:33.033 [2024-11-27 03:03:35.460063] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:33.033 03:03:35 -- common/autotest_common.sh@960 -- # wait 2360743 00:08:33.294 03:03:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:33.294 03:03:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:33.294 03:03:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:33.294 03:03:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:33.294 03:03:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:33.294 03:03:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:33.294 03:03:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:33.294 03:03:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:35.201 03:03:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:35.201 00:08:35.201 real 0m6.371s 00:08:35.202 user 0m7.895s 00:08:35.202 sys 0m1.987s 00:08:35.202 03:03:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:35.202 03:03:37 -- common/autotest_common.sh@10 -- # set +x 00:08:35.202 ************************************ 00:08:35.202 END TEST nvmf_discovery 00:08:35.202 ************************************ 00:08:35.202 03:03:37 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:35.202 03:03:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:35.202 03:03:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:35.202 03:03:37 -- common/autotest_common.sh@10 -- # set +x 00:08:35.202 ************************************ 00:08:35.202 START TEST nvmf_referrals 00:08:35.202 ************************************ 00:08:35.202 03:03:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:35.202 * Looking for test storage... 00:08:35.202 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:35.461 03:03:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:35.461 03:03:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:35.461 03:03:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:35.461 03:03:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:35.461 03:03:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:35.461 03:03:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:35.461 03:03:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:35.461 03:03:37 -- scripts/common.sh@335 -- # IFS=.-: 00:08:35.461 03:03:37 -- scripts/common.sh@335 -- # read -ra ver1 00:08:35.461 03:03:37 -- scripts/common.sh@336 -- # IFS=.-: 00:08:35.461 03:03:37 -- scripts/common.sh@336 -- # read -ra ver2 00:08:35.461 03:03:37 -- scripts/common.sh@337 -- # local 'op=<' 00:08:35.461 03:03:37 -- scripts/common.sh@339 -- # ver1_l=2 00:08:35.461 03:03:37 -- scripts/common.sh@340 -- # ver2_l=1 00:08:35.461 03:03:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:35.461 03:03:37 -- scripts/common.sh@343 -- # case "$op" in 00:08:35.461 03:03:37 -- scripts/common.sh@344 -- # : 1 00:08:35.461 03:03:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:35.461 03:03:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:35.461 03:03:37 -- scripts/common.sh@364 -- # decimal 1 00:08:35.461 03:03:37 -- scripts/common.sh@352 -- # local d=1 00:08:35.461 03:03:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:35.461 03:03:37 -- scripts/common.sh@354 -- # echo 1 00:08:35.461 03:03:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:35.461 03:03:37 -- scripts/common.sh@365 -- # decimal 2 00:08:35.461 03:03:37 -- scripts/common.sh@352 -- # local d=2 00:08:35.461 03:03:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:35.461 03:03:37 -- scripts/common.sh@354 -- # echo 2 00:08:35.461 03:03:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:35.461 03:03:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:35.461 03:03:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:35.461 03:03:37 -- scripts/common.sh@367 -- # return 0 00:08:35.461 03:03:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:35.461 03:03:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:35.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:35.461 --rc genhtml_branch_coverage=1 00:08:35.461 --rc genhtml_function_coverage=1 00:08:35.461 --rc genhtml_legend=1 00:08:35.461 --rc geninfo_all_blocks=1 00:08:35.461 --rc geninfo_unexecuted_blocks=1 00:08:35.461 00:08:35.461 ' 00:08:35.461 03:03:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:35.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:35.461 --rc genhtml_branch_coverage=1 00:08:35.461 --rc genhtml_function_coverage=1 00:08:35.461 --rc genhtml_legend=1 00:08:35.461 --rc geninfo_all_blocks=1 00:08:35.461 --rc geninfo_unexecuted_blocks=1 00:08:35.461 00:08:35.461 ' 00:08:35.461 03:03:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:35.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:35.461 --rc genhtml_branch_coverage=1 00:08:35.461 --rc genhtml_function_coverage=1 00:08:35.461 --rc genhtml_legend=1 00:08:35.461 --rc geninfo_all_blocks=1 00:08:35.461 --rc geninfo_unexecuted_blocks=1 00:08:35.461 00:08:35.461 ' 00:08:35.461 03:03:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:35.461 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:35.461 --rc genhtml_branch_coverage=1 00:08:35.461 --rc genhtml_function_coverage=1 00:08:35.461 --rc genhtml_legend=1 00:08:35.461 --rc geninfo_all_blocks=1 00:08:35.461 --rc geninfo_unexecuted_blocks=1 00:08:35.461 00:08:35.461 ' 00:08:35.461 03:03:37 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:35.461 03:03:37 -- nvmf/common.sh@7 -- # uname -s 00:08:35.461 03:03:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:35.461 03:03:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:35.461 03:03:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:35.461 03:03:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:35.461 03:03:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:35.461 03:03:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:35.461 03:03:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:35.461 03:03:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:35.461 03:03:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:35.461 03:03:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:35.461 03:03:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:35.461 03:03:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:35.461 03:03:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:35.461 03:03:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:35.461 03:03:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:35.461 03:03:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:35.461 03:03:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:35.462 03:03:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:35.462 03:03:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:35.462 03:03:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:35.462 03:03:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:35.462 03:03:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:35.462 03:03:37 -- paths/export.sh@5 -- # export PATH 00:08:35.462 03:03:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:35.462 03:03:37 -- nvmf/common.sh@46 -- # : 0 00:08:35.462 03:03:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:35.462 03:03:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:35.462 03:03:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:35.462 03:03:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:35.462 03:03:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:35.462 03:03:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:35.462 03:03:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:35.462 03:03:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:35.462 03:03:37 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:35.462 03:03:37 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:35.462 03:03:37 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:35.462 03:03:37 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:35.462 03:03:37 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:35.462 03:03:37 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:35.462 03:03:37 -- target/referrals.sh@37 -- # nvmftestinit 00:08:35.462 03:03:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:35.462 03:03:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:35.462 03:03:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:35.462 03:03:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:35.462 03:03:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:35.462 03:03:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:35.462 03:03:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:35.462 03:03:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:35.462 03:03:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:35.462 03:03:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:35.462 03:03:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:35.462 03:03:37 -- common/autotest_common.sh@10 -- # set +x 00:08:37.365 03:03:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:37.365 03:03:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:37.365 03:03:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:37.365 03:03:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:37.365 03:03:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:37.365 03:03:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:37.365 03:03:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:37.365 03:03:39 -- nvmf/common.sh@294 -- # net_devs=() 00:08:37.365 03:03:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:37.365 03:03:39 -- nvmf/common.sh@295 -- # e810=() 00:08:37.365 03:03:39 -- nvmf/common.sh@295 -- # local -ga e810 00:08:37.365 03:03:39 -- nvmf/common.sh@296 -- # x722=() 00:08:37.365 03:03:39 -- nvmf/common.sh@296 -- # local -ga x722 00:08:37.365 03:03:39 -- nvmf/common.sh@297 -- # mlx=() 00:08:37.365 03:03:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:37.365 03:03:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:37.365 03:03:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:37.365 03:03:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:37.365 03:03:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:37.365 03:03:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:37.365 03:03:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:37.365 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:37.365 03:03:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:37.365 03:03:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:37.365 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:37.365 03:03:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:37.365 03:03:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:37.365 03:03:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:37.365 03:03:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:37.365 03:03:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:37.365 03:03:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:37.365 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:37.365 03:03:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:37.365 03:03:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:37.365 03:03:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:37.365 03:03:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:37.365 03:03:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:37.365 03:03:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:37.365 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:37.365 03:03:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:37.365 03:03:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:37.365 03:03:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:37.365 03:03:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:37.365 03:03:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:37.365 03:03:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:37.365 03:03:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:37.365 03:03:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:37.365 03:03:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:37.365 03:03:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:37.365 03:03:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:37.365 03:03:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:37.365 03:03:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:37.365 03:03:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:37.365 03:03:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:37.365 03:03:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:37.365 03:03:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:37.365 03:03:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:37.624 03:03:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:37.624 03:03:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:37.624 03:03:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:37.624 03:03:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:37.624 03:03:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:37.624 03:03:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:37.624 03:03:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:37.624 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:37.624 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.177 ms 00:08:37.624 00:08:37.624 --- 10.0.0.2 ping statistics --- 00:08:37.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:37.624 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:08:37.624 03:03:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:37.624 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:37.624 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:08:37.624 00:08:37.624 --- 10.0.0.1 ping statistics --- 00:08:37.624 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:37.624 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:08:37.624 03:03:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:37.624 03:03:40 -- nvmf/common.sh@410 -- # return 0 00:08:37.624 03:03:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:37.624 03:03:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:37.624 03:03:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:37.624 03:03:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:37.624 03:03:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:37.624 03:03:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:37.624 03:03:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:37.624 03:03:40 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:37.624 03:03:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:37.624 03:03:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:37.624 03:03:40 -- common/autotest_common.sh@10 -- # set +x 00:08:37.624 03:03:40 -- nvmf/common.sh@469 -- # nvmfpid=2362947 00:08:37.624 03:03:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:37.624 03:03:40 -- nvmf/common.sh@470 -- # waitforlisten 2362947 00:08:37.624 03:03:40 -- common/autotest_common.sh@829 -- # '[' -z 2362947 ']' 00:08:37.624 03:03:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:37.624 03:03:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:37.624 03:03:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:37.624 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:37.624 03:03:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:37.624 03:03:40 -- common/autotest_common.sh@10 -- # set +x 00:08:37.624 [2024-11-27 03:03:40.136199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:37.624 [2024-11-27 03:03:40.136277] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:37.624 EAL: No free 2048 kB hugepages reported on node 1 00:08:37.624 [2024-11-27 03:03:40.212989] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:37.884 [2024-11-27 03:03:40.307504] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:37.884 [2024-11-27 03:03:40.307678] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:37.884 [2024-11-27 03:03:40.307707] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:37.884 [2024-11-27 03:03:40.307723] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:37.884 [2024-11-27 03:03:40.307781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:37.884 [2024-11-27 03:03:40.307843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:37.884 [2024-11-27 03:03:40.307896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:37.884 [2024-11-27 03:03:40.307898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:38.823 03:03:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:38.823 03:03:41 -- common/autotest_common.sh@862 -- # return 0 00:08:38.823 03:03:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:38.823 03:03:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:38.823 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.823 03:03:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:38.823 03:03:41 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:38.823 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:38.823 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.823 [2024-11-27 03:03:41.180310] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:38.823 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:38.823 03:03:41 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:38.823 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:38.823 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.823 [2024-11-27 03:03:41.192542] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:38.823 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:38.823 03:03:41 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:38.823 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:38.823 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.823 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:38.823 03:03:41 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:38.823 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:38.823 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.823 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:38.823 03:03:41 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:38.823 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:38.823 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.823 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:38.823 03:03:41 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:38.823 03:03:41 -- target/referrals.sh@48 -- # jq length 00:08:38.823 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:38.823 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.823 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:38.823 03:03:41 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:38.823 03:03:41 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:38.823 03:03:41 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:38.823 03:03:41 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:38.823 03:03:41 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:38.823 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:38.823 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:38.823 03:03:41 -- target/referrals.sh@21 -- # sort 00:08:38.823 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:38.823 03:03:41 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:38.823 03:03:41 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:38.823 03:03:41 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:38.823 03:03:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:38.823 03:03:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:38.823 03:03:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:38.823 03:03:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:38.823 03:03:41 -- target/referrals.sh@26 -- # sort 00:08:39.085 03:03:41 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:39.085 03:03:41 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:39.085 03:03:41 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:39.085 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.085 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:39.085 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.085 03:03:41 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:39.085 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.085 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:39.085 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.085 03:03:41 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:39.085 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.085 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:39.085 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.085 03:03:41 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:39.085 03:03:41 -- target/referrals.sh@56 -- # jq length 00:08:39.085 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.085 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:39.085 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.085 03:03:41 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:39.085 03:03:41 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:39.085 03:03:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:39.085 03:03:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:39.085 03:03:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:39.085 03:03:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:39.085 03:03:41 -- target/referrals.sh@26 -- # sort 00:08:39.346 03:03:41 -- target/referrals.sh@26 -- # echo 00:08:39.346 03:03:41 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:39.346 03:03:41 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:39.346 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.346 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:39.346 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.346 03:03:41 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:39.346 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.346 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:39.346 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.346 03:03:41 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:39.346 03:03:41 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:39.346 03:03:41 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:39.346 03:03:41 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:39.346 03:03:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.346 03:03:41 -- target/referrals.sh@21 -- # sort 00:08:39.346 03:03:41 -- common/autotest_common.sh@10 -- # set +x 00:08:39.346 03:03:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.346 03:03:41 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:39.346 03:03:41 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:39.346 03:03:41 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:39.346 03:03:41 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:39.346 03:03:41 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:39.346 03:03:41 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:39.346 03:03:41 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:39.346 03:03:41 -- target/referrals.sh@26 -- # sort 00:08:39.604 03:03:42 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:39.604 03:03:42 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:39.604 03:03:42 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:39.604 03:03:42 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:39.604 03:03:42 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:39.604 03:03:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:39.605 03:03:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:39.605 03:03:42 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:39.605 03:03:42 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:39.605 03:03:42 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:39.605 03:03:42 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:39.605 03:03:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:39.605 03:03:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:39.863 03:03:42 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:39.863 03:03:42 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:39.863 03:03:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.863 03:03:42 -- common/autotest_common.sh@10 -- # set +x 00:08:39.863 03:03:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.863 03:03:42 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:39.863 03:03:42 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:39.863 03:03:42 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:39.863 03:03:42 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:39.863 03:03:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:39.863 03:03:42 -- common/autotest_common.sh@10 -- # set +x 00:08:39.863 03:03:42 -- target/referrals.sh@21 -- # sort 00:08:39.863 03:03:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:39.863 03:03:42 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:39.863 03:03:42 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:39.863 03:03:42 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:39.863 03:03:42 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:39.863 03:03:42 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:39.863 03:03:42 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:39.863 03:03:42 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:39.863 03:03:42 -- target/referrals.sh@26 -- # sort 00:08:40.123 03:03:42 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:40.123 03:03:42 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:40.123 03:03:42 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:40.123 03:03:42 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:40.123 03:03:42 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:40.123 03:03:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:40.123 03:03:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:40.381 03:03:42 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:40.381 03:03:42 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:40.382 03:03:42 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:40.382 03:03:42 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:40.382 03:03:42 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:40.382 03:03:42 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:40.382 03:03:42 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:40.382 03:03:42 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:40.382 03:03:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:40.382 03:03:42 -- common/autotest_common.sh@10 -- # set +x 00:08:40.382 03:03:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:40.382 03:03:42 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:40.382 03:03:42 -- target/referrals.sh@82 -- # jq length 00:08:40.382 03:03:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:40.382 03:03:42 -- common/autotest_common.sh@10 -- # set +x 00:08:40.382 03:03:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:40.382 03:03:42 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:40.382 03:03:42 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:40.382 03:03:42 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:40.382 03:03:42 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:40.382 03:03:42 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:40.382 03:03:42 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:40.382 03:03:42 -- target/referrals.sh@26 -- # sort 00:08:40.640 03:03:43 -- target/referrals.sh@26 -- # echo 00:08:40.640 03:03:43 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:40.640 03:03:43 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:40.640 03:03:43 -- target/referrals.sh@86 -- # nvmftestfini 00:08:40.640 03:03:43 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:40.640 03:03:43 -- nvmf/common.sh@116 -- # sync 00:08:40.640 03:03:43 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:40.640 03:03:43 -- nvmf/common.sh@119 -- # set +e 00:08:40.640 03:03:43 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:40.640 03:03:43 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:40.640 rmmod nvme_tcp 00:08:40.640 rmmod nvme_fabrics 00:08:40.640 rmmod nvme_keyring 00:08:40.640 03:03:43 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:40.640 03:03:43 -- nvmf/common.sh@123 -- # set -e 00:08:40.640 03:03:43 -- nvmf/common.sh@124 -- # return 0 00:08:40.640 03:03:43 -- nvmf/common.sh@477 -- # '[' -n 2362947 ']' 00:08:40.640 03:03:43 -- nvmf/common.sh@478 -- # killprocess 2362947 00:08:40.640 03:03:43 -- common/autotest_common.sh@936 -- # '[' -z 2362947 ']' 00:08:40.640 03:03:43 -- common/autotest_common.sh@940 -- # kill -0 2362947 00:08:40.640 03:03:43 -- common/autotest_common.sh@941 -- # uname 00:08:40.640 03:03:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:40.640 03:03:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2362947 00:08:40.898 03:03:43 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:40.898 03:03:43 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:40.898 03:03:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2362947' 00:08:40.898 killing process with pid 2362947 00:08:40.898 03:03:43 -- common/autotest_common.sh@955 -- # kill 2362947 00:08:40.898 03:03:43 -- common/autotest_common.sh@960 -- # wait 2362947 00:08:40.898 03:03:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:40.898 03:03:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:40.898 03:03:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:40.898 03:03:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:40.898 03:03:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:40.898 03:03:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:40.898 03:03:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:40.898 03:03:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:43.433 03:03:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:43.433 00:08:43.433 real 0m7.796s 00:08:43.433 user 0m14.393s 00:08:43.433 sys 0m2.308s 00:08:43.433 03:03:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:43.433 03:03:45 -- common/autotest_common.sh@10 -- # set +x 00:08:43.433 ************************************ 00:08:43.433 END TEST nvmf_referrals 00:08:43.433 ************************************ 00:08:43.433 03:03:45 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:43.433 03:03:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:43.433 03:03:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:43.433 03:03:45 -- common/autotest_common.sh@10 -- # set +x 00:08:43.433 ************************************ 00:08:43.433 START TEST nvmf_connect_disconnect 00:08:43.433 ************************************ 00:08:43.433 03:03:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:43.433 * Looking for test storage... 00:08:43.433 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:43.433 03:03:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:43.433 03:03:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:43.433 03:03:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:43.433 03:03:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:43.433 03:03:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:43.433 03:03:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:43.433 03:03:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:43.433 03:03:45 -- scripts/common.sh@335 -- # IFS=.-: 00:08:43.433 03:03:45 -- scripts/common.sh@335 -- # read -ra ver1 00:08:43.433 03:03:45 -- scripts/common.sh@336 -- # IFS=.-: 00:08:43.433 03:03:45 -- scripts/common.sh@336 -- # read -ra ver2 00:08:43.433 03:03:45 -- scripts/common.sh@337 -- # local 'op=<' 00:08:43.433 03:03:45 -- scripts/common.sh@339 -- # ver1_l=2 00:08:43.433 03:03:45 -- scripts/common.sh@340 -- # ver2_l=1 00:08:43.433 03:03:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:43.433 03:03:45 -- scripts/common.sh@343 -- # case "$op" in 00:08:43.433 03:03:45 -- scripts/common.sh@344 -- # : 1 00:08:43.433 03:03:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:43.433 03:03:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:43.433 03:03:45 -- scripts/common.sh@364 -- # decimal 1 00:08:43.433 03:03:45 -- scripts/common.sh@352 -- # local d=1 00:08:43.433 03:03:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:43.433 03:03:45 -- scripts/common.sh@354 -- # echo 1 00:08:43.433 03:03:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:43.433 03:03:45 -- scripts/common.sh@365 -- # decimal 2 00:08:43.433 03:03:45 -- scripts/common.sh@352 -- # local d=2 00:08:43.433 03:03:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:43.433 03:03:45 -- scripts/common.sh@354 -- # echo 2 00:08:43.433 03:03:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:43.433 03:03:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:43.433 03:03:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:43.433 03:03:45 -- scripts/common.sh@367 -- # return 0 00:08:43.433 03:03:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:43.433 03:03:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:43.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:43.433 --rc genhtml_branch_coverage=1 00:08:43.433 --rc genhtml_function_coverage=1 00:08:43.433 --rc genhtml_legend=1 00:08:43.433 --rc geninfo_all_blocks=1 00:08:43.433 --rc geninfo_unexecuted_blocks=1 00:08:43.433 00:08:43.433 ' 00:08:43.433 03:03:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:43.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:43.433 --rc genhtml_branch_coverage=1 00:08:43.433 --rc genhtml_function_coverage=1 00:08:43.433 --rc genhtml_legend=1 00:08:43.433 --rc geninfo_all_blocks=1 00:08:43.433 --rc geninfo_unexecuted_blocks=1 00:08:43.433 00:08:43.433 ' 00:08:43.433 03:03:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:43.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:43.433 --rc genhtml_branch_coverage=1 00:08:43.433 --rc genhtml_function_coverage=1 00:08:43.433 --rc genhtml_legend=1 00:08:43.433 --rc geninfo_all_blocks=1 00:08:43.433 --rc geninfo_unexecuted_blocks=1 00:08:43.433 00:08:43.433 ' 00:08:43.433 03:03:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:43.433 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:43.433 --rc genhtml_branch_coverage=1 00:08:43.433 --rc genhtml_function_coverage=1 00:08:43.433 --rc genhtml_legend=1 00:08:43.433 --rc geninfo_all_blocks=1 00:08:43.433 --rc geninfo_unexecuted_blocks=1 00:08:43.433 00:08:43.433 ' 00:08:43.434 03:03:45 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:43.434 03:03:45 -- nvmf/common.sh@7 -- # uname -s 00:08:43.434 03:03:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:43.434 03:03:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:43.434 03:03:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:43.434 03:03:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:43.434 03:03:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:43.434 03:03:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:43.434 03:03:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:43.434 03:03:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:43.434 03:03:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:43.434 03:03:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:43.434 03:03:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:43.434 03:03:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:43.434 03:03:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:43.434 03:03:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:43.434 03:03:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:43.434 03:03:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:43.434 03:03:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:43.434 03:03:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:43.434 03:03:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:43.434 03:03:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.434 03:03:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.434 03:03:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.434 03:03:45 -- paths/export.sh@5 -- # export PATH 00:08:43.434 03:03:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:43.434 03:03:45 -- nvmf/common.sh@46 -- # : 0 00:08:43.434 03:03:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:43.434 03:03:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:43.434 03:03:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:43.434 03:03:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:43.434 03:03:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:43.434 03:03:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:43.434 03:03:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:43.434 03:03:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:43.434 03:03:45 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:43.434 03:03:45 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:43.434 03:03:45 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:43.434 03:03:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:43.434 03:03:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:43.434 03:03:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:43.434 03:03:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:43.434 03:03:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:43.434 03:03:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:43.434 03:03:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:43.434 03:03:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:43.434 03:03:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:43.434 03:03:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:43.434 03:03:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:43.434 03:03:45 -- common/autotest_common.sh@10 -- # set +x 00:08:45.342 03:03:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:45.342 03:03:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:45.342 03:03:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:45.342 03:03:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:45.342 03:03:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:45.342 03:03:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:45.342 03:03:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:45.342 03:03:47 -- nvmf/common.sh@294 -- # net_devs=() 00:08:45.342 03:03:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:45.342 03:03:47 -- nvmf/common.sh@295 -- # e810=() 00:08:45.342 03:03:47 -- nvmf/common.sh@295 -- # local -ga e810 00:08:45.342 03:03:47 -- nvmf/common.sh@296 -- # x722=() 00:08:45.342 03:03:47 -- nvmf/common.sh@296 -- # local -ga x722 00:08:45.342 03:03:47 -- nvmf/common.sh@297 -- # mlx=() 00:08:45.342 03:03:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:45.342 03:03:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:45.342 03:03:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:45.342 03:03:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:45.342 03:03:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:45.342 03:03:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:45.342 03:03:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:45.342 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:45.342 03:03:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:45.342 03:03:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:45.342 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:45.342 03:03:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:45.342 03:03:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:45.342 03:03:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:45.342 03:03:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:45.342 03:03:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:45.342 03:03:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:45.342 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:45.342 03:03:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:45.342 03:03:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:45.342 03:03:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:45.342 03:03:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:45.342 03:03:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:45.342 03:03:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:45.342 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:45.342 03:03:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:45.342 03:03:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:45.342 03:03:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:45.342 03:03:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:45.342 03:03:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:45.342 03:03:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:45.342 03:03:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:45.342 03:03:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:45.342 03:03:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:45.342 03:03:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:45.342 03:03:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:45.342 03:03:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:45.342 03:03:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:45.342 03:03:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:45.342 03:03:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:45.342 03:03:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:45.342 03:03:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:45.342 03:03:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:45.342 03:03:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:45.342 03:03:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:45.342 03:03:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:45.342 03:03:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:45.342 03:03:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:45.342 03:03:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:45.342 03:03:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:45.342 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:45.342 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:08:45.342 00:08:45.342 --- 10.0.0.2 ping statistics --- 00:08:45.343 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:45.343 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:08:45.343 03:03:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:45.602 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:45.603 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:08:45.603 00:08:45.603 --- 10.0.0.1 ping statistics --- 00:08:45.603 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:45.603 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:08:45.603 03:03:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:45.603 03:03:47 -- nvmf/common.sh@410 -- # return 0 00:08:45.603 03:03:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:45.603 03:03:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:45.603 03:03:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:45.603 03:03:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:45.603 03:03:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:45.603 03:03:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:45.603 03:03:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:45.603 03:03:47 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:45.603 03:03:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:45.603 03:03:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:45.603 03:03:47 -- common/autotest_common.sh@10 -- # set +x 00:08:45.603 03:03:47 -- nvmf/common.sh@469 -- # nvmfpid=2365404 00:08:45.603 03:03:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:45.603 03:03:47 -- nvmf/common.sh@470 -- # waitforlisten 2365404 00:08:45.603 03:03:47 -- common/autotest_common.sh@829 -- # '[' -z 2365404 ']' 00:08:45.603 03:03:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:45.603 03:03:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:45.603 03:03:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:45.603 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:45.603 03:03:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:45.603 03:03:47 -- common/autotest_common.sh@10 -- # set +x 00:08:45.603 [2024-11-27 03:03:48.039966] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:45.603 [2024-11-27 03:03:48.040057] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:45.603 EAL: No free 2048 kB hugepages reported on node 1 00:08:45.603 [2024-11-27 03:03:48.106796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:45.603 [2024-11-27 03:03:48.196933] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:45.603 [2024-11-27 03:03:48.197112] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:45.603 [2024-11-27 03:03:48.197130] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:45.603 [2024-11-27 03:03:48.197143] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:45.603 [2024-11-27 03:03:48.197203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:45.603 [2024-11-27 03:03:48.197267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:45.603 [2024-11-27 03:03:48.197316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:45.603 [2024-11-27 03:03:48.197319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:46.538 03:03:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:46.538 03:03:49 -- common/autotest_common.sh@862 -- # return 0 00:08:46.538 03:03:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:46.538 03:03:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:46.538 03:03:49 -- common/autotest_common.sh@10 -- # set +x 00:08:46.538 03:03:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:46.538 03:03:49 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:46.538 03:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.538 03:03:49 -- common/autotest_common.sh@10 -- # set +x 00:08:46.538 [2024-11-27 03:03:49.093402] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:46.538 03:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.538 03:03:49 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:46.538 03:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.539 03:03:49 -- common/autotest_common.sh@10 -- # set +x 00:08:46.539 03:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.539 03:03:49 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:46.539 03:03:49 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:46.539 03:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.539 03:03:49 -- common/autotest_common.sh@10 -- # set +x 00:08:46.539 03:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.539 03:03:49 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:46.539 03:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.539 03:03:49 -- common/autotest_common.sh@10 -- # set +x 00:08:46.539 03:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.539 03:03:49 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:46.539 03:03:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:46.539 03:03:49 -- common/autotest_common.sh@10 -- # set +x 00:08:46.539 [2024-11-27 03:03:49.147107] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:46.539 03:03:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:46.539 03:03:49 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:46.539 03:03:49 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:46.539 03:03:49 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:46.539 03:03:49 -- target/connect_disconnect.sh@34 -- # set +x 00:08:49.077 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.612 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.649 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.187 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:58.105 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:00.644 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.180 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:05.090 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:07.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.167 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:12.078 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:14.616 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:16.522 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:19.059 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:21.602 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.143 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.045 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.586 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:30.494 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.029 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.564 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:37.514 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.052 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.590 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:44.498 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.033 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.573 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:51.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.011 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.556 [2024-11-27 03:04:58.609273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173fd50 is same with the state(5) to be set 00:09:56.556 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.009 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.545 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:05.453 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.988 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.523 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:12.428 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:14.966 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.508 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:19.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:21.991 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.527 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:26.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.988 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.524 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.435 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.978 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:40.426 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.955 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.399 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.938 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.477 [2024-11-27 03:05:54.574316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173fd50 is same with the state(5) to be set 00:10:52.477 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.385 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.922 [2024-11-27 03:05:59.238308] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173fd50 is same with the state(5) to be set 00:10:56.922 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.455 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:01.365 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.891 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.485 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.397 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.474 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.381 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.920 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:19.828 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.365 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.903 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.455 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.362 [2024-11-27 03:06:31.843410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173fd50 is same with the state(5) to be set 00:11:29.362 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.898 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.432 [2024-11-27 03:06:36.581355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173fd50 is same with the state(5) to be set 00:11:34.432 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.875 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.414 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.320 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.859 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.401 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:50.389 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.926 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.462 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:57.368 [2024-11-27 03:06:59.791336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173fd50 is same with the state(5) to be set 00:11:57.368 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.908 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.448 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.355 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:06.885 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:08.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:11.326 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.865 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:15.775 [2024-11-27 03:07:18.223315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x173fd50 is same with the state(5) to be set 00:12:15.775 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.327 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:20.860 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:22.762 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.317 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:27.861 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:29.766 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.303 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:34.287 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:36.822 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.358 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.358 03:07:41 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:39.358 03:07:41 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:39.358 03:07:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:39.358 03:07:41 -- nvmf/common.sh@116 -- # sync 00:12:39.358 03:07:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:39.358 03:07:41 -- nvmf/common.sh@119 -- # set +e 00:12:39.358 03:07:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:39.358 03:07:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:39.358 rmmod nvme_tcp 00:12:39.358 rmmod nvme_fabrics 00:12:39.358 rmmod nvme_keyring 00:12:39.358 03:07:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:39.358 03:07:41 -- nvmf/common.sh@123 -- # set -e 00:12:39.358 03:07:41 -- nvmf/common.sh@124 -- # return 0 00:12:39.358 03:07:41 -- nvmf/common.sh@477 -- # '[' -n 2365404 ']' 00:12:39.358 03:07:41 -- nvmf/common.sh@478 -- # killprocess 2365404 00:12:39.358 03:07:41 -- common/autotest_common.sh@936 -- # '[' -z 2365404 ']' 00:12:39.358 03:07:41 -- common/autotest_common.sh@940 -- # kill -0 2365404 00:12:39.358 03:07:41 -- common/autotest_common.sh@941 -- # uname 00:12:39.358 03:07:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:39.358 03:07:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2365404 00:12:39.358 03:07:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:39.358 03:07:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:39.358 03:07:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2365404' 00:12:39.358 killing process with pid 2365404 00:12:39.358 03:07:41 -- common/autotest_common.sh@955 -- # kill 2365404 00:12:39.358 03:07:41 -- common/autotest_common.sh@960 -- # wait 2365404 00:12:39.358 03:07:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:39.358 03:07:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:39.358 03:07:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:39.358 03:07:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:39.358 03:07:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:39.358 03:07:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:39.358 03:07:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:39.359 03:07:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:41.264 03:07:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:41.264 00:12:41.264 real 3m58.284s 00:12:41.264 user 15m9.967s 00:12:41.264 sys 0m33.619s 00:12:41.264 03:07:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:41.264 03:07:43 -- common/autotest_common.sh@10 -- # set +x 00:12:41.264 ************************************ 00:12:41.264 END TEST nvmf_connect_disconnect 00:12:41.264 ************************************ 00:12:41.523 03:07:43 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:41.523 03:07:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:41.523 03:07:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:41.523 03:07:43 -- common/autotest_common.sh@10 -- # set +x 00:12:41.523 ************************************ 00:12:41.523 START TEST nvmf_multitarget 00:12:41.523 ************************************ 00:12:41.523 03:07:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:41.523 * Looking for test storage... 00:12:41.523 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:41.523 03:07:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:41.523 03:07:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:41.523 03:07:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:41.523 03:07:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:41.523 03:07:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:41.523 03:07:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:41.523 03:07:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:41.523 03:07:44 -- scripts/common.sh@335 -- # IFS=.-: 00:12:41.523 03:07:44 -- scripts/common.sh@335 -- # read -ra ver1 00:12:41.523 03:07:44 -- scripts/common.sh@336 -- # IFS=.-: 00:12:41.523 03:07:44 -- scripts/common.sh@336 -- # read -ra ver2 00:12:41.523 03:07:44 -- scripts/common.sh@337 -- # local 'op=<' 00:12:41.523 03:07:44 -- scripts/common.sh@339 -- # ver1_l=2 00:12:41.523 03:07:44 -- scripts/common.sh@340 -- # ver2_l=1 00:12:41.523 03:07:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:41.523 03:07:44 -- scripts/common.sh@343 -- # case "$op" in 00:12:41.523 03:07:44 -- scripts/common.sh@344 -- # : 1 00:12:41.523 03:07:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:41.523 03:07:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:41.523 03:07:44 -- scripts/common.sh@364 -- # decimal 1 00:12:41.523 03:07:44 -- scripts/common.sh@352 -- # local d=1 00:12:41.523 03:07:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:41.523 03:07:44 -- scripts/common.sh@354 -- # echo 1 00:12:41.523 03:07:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:41.523 03:07:44 -- scripts/common.sh@365 -- # decimal 2 00:12:41.523 03:07:44 -- scripts/common.sh@352 -- # local d=2 00:12:41.523 03:07:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:41.523 03:07:44 -- scripts/common.sh@354 -- # echo 2 00:12:41.523 03:07:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:41.523 03:07:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:41.523 03:07:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:41.523 03:07:44 -- scripts/common.sh@367 -- # return 0 00:12:41.523 03:07:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:41.523 03:07:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:41.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:41.523 --rc genhtml_branch_coverage=1 00:12:41.523 --rc genhtml_function_coverage=1 00:12:41.523 --rc genhtml_legend=1 00:12:41.523 --rc geninfo_all_blocks=1 00:12:41.523 --rc geninfo_unexecuted_blocks=1 00:12:41.523 00:12:41.523 ' 00:12:41.523 03:07:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:41.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:41.523 --rc genhtml_branch_coverage=1 00:12:41.523 --rc genhtml_function_coverage=1 00:12:41.523 --rc genhtml_legend=1 00:12:41.523 --rc geninfo_all_blocks=1 00:12:41.523 --rc geninfo_unexecuted_blocks=1 00:12:41.523 00:12:41.523 ' 00:12:41.523 03:07:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:41.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:41.523 --rc genhtml_branch_coverage=1 00:12:41.523 --rc genhtml_function_coverage=1 00:12:41.523 --rc genhtml_legend=1 00:12:41.523 --rc geninfo_all_blocks=1 00:12:41.523 --rc geninfo_unexecuted_blocks=1 00:12:41.523 00:12:41.523 ' 00:12:41.523 03:07:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:41.523 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:41.523 --rc genhtml_branch_coverage=1 00:12:41.523 --rc genhtml_function_coverage=1 00:12:41.523 --rc genhtml_legend=1 00:12:41.523 --rc geninfo_all_blocks=1 00:12:41.523 --rc geninfo_unexecuted_blocks=1 00:12:41.523 00:12:41.523 ' 00:12:41.523 03:07:44 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:41.523 03:07:44 -- nvmf/common.sh@7 -- # uname -s 00:12:41.523 03:07:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:41.523 03:07:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:41.523 03:07:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:41.523 03:07:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:41.523 03:07:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:41.523 03:07:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:41.523 03:07:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:41.523 03:07:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:41.523 03:07:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:41.523 03:07:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:41.523 03:07:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:41.523 03:07:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:41.523 03:07:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:41.523 03:07:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:41.523 03:07:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:41.523 03:07:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:41.523 03:07:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:41.523 03:07:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:41.523 03:07:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:41.523 03:07:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:41.523 03:07:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:41.523 03:07:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:41.524 03:07:44 -- paths/export.sh@5 -- # export PATH 00:12:41.524 03:07:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:41.524 03:07:44 -- nvmf/common.sh@46 -- # : 0 00:12:41.524 03:07:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:41.524 03:07:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:41.524 03:07:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:41.524 03:07:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:41.524 03:07:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:41.524 03:07:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:41.524 03:07:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:41.524 03:07:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:41.524 03:07:44 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:41.524 03:07:44 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:41.524 03:07:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:41.524 03:07:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:41.524 03:07:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:41.524 03:07:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:41.524 03:07:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:41.524 03:07:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:41.524 03:07:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:41.524 03:07:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:41.524 03:07:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:41.524 03:07:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:41.524 03:07:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:41.524 03:07:44 -- common/autotest_common.sh@10 -- # set +x 00:12:44.060 03:07:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:44.060 03:07:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:44.060 03:07:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:44.060 03:07:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:44.060 03:07:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:44.060 03:07:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:44.060 03:07:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:44.060 03:07:46 -- nvmf/common.sh@294 -- # net_devs=() 00:12:44.060 03:07:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:44.060 03:07:46 -- nvmf/common.sh@295 -- # e810=() 00:12:44.060 03:07:46 -- nvmf/common.sh@295 -- # local -ga e810 00:12:44.060 03:07:46 -- nvmf/common.sh@296 -- # x722=() 00:12:44.060 03:07:46 -- nvmf/common.sh@296 -- # local -ga x722 00:12:44.060 03:07:46 -- nvmf/common.sh@297 -- # mlx=() 00:12:44.060 03:07:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:44.060 03:07:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:44.060 03:07:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:44.060 03:07:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:44.060 03:07:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:44.060 03:07:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:44.060 03:07:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:44.060 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:44.060 03:07:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:44.060 03:07:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:44.060 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:44.060 03:07:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:44.060 03:07:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:44.060 03:07:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:44.060 03:07:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:44.060 03:07:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:44.060 03:07:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:44.060 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:44.060 03:07:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:44.060 03:07:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:44.060 03:07:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:44.060 03:07:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:44.060 03:07:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:44.060 03:07:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:44.060 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:44.060 03:07:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:44.060 03:07:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:44.060 03:07:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:44.060 03:07:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:44.060 03:07:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:44.060 03:07:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:44.060 03:07:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:44.060 03:07:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:44.060 03:07:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:44.060 03:07:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:44.060 03:07:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:44.060 03:07:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:44.060 03:07:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:44.060 03:07:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:44.060 03:07:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:44.060 03:07:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:44.060 03:07:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:44.060 03:07:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:44.060 03:07:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:44.060 03:07:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:44.060 03:07:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:44.060 03:07:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:44.060 03:07:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:44.060 03:07:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:44.060 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:44.060 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.406 ms 00:12:44.060 00:12:44.060 --- 10.0.0.2 ping statistics --- 00:12:44.060 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:44.060 rtt min/avg/max/mdev = 0.406/0.406/0.406/0.000 ms 00:12:44.060 03:07:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:44.060 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:44.060 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:12:44.060 00:12:44.060 --- 10.0.0.1 ping statistics --- 00:12:44.060 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:44.060 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:12:44.060 03:07:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:44.060 03:07:46 -- nvmf/common.sh@410 -- # return 0 00:12:44.060 03:07:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:44.060 03:07:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:44.060 03:07:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:44.060 03:07:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:44.060 03:07:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:44.060 03:07:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:44.060 03:07:46 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:44.060 03:07:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:44.060 03:07:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:44.060 03:07:46 -- common/autotest_common.sh@10 -- # set +x 00:12:44.060 03:07:46 -- nvmf/common.sh@469 -- # nvmfpid=2397666 00:12:44.060 03:07:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:44.060 03:07:46 -- nvmf/common.sh@470 -- # waitforlisten 2397666 00:12:44.061 03:07:46 -- common/autotest_common.sh@829 -- # '[' -z 2397666 ']' 00:12:44.061 03:07:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:44.061 03:07:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:44.061 03:07:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:44.061 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:44.061 03:07:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:44.061 03:07:46 -- common/autotest_common.sh@10 -- # set +x 00:12:44.061 [2024-11-27 03:07:46.268467] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:44.061 [2024-11-27 03:07:46.268585] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:44.061 EAL: No free 2048 kB hugepages reported on node 1 00:12:44.061 [2024-11-27 03:07:46.335198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:44.061 [2024-11-27 03:07:46.423200] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:44.061 [2024-11-27 03:07:46.423364] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:44.061 [2024-11-27 03:07:46.423381] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:44.061 [2024-11-27 03:07:46.423395] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:44.061 [2024-11-27 03:07:46.423454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:44.061 [2024-11-27 03:07:46.423516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:44.061 [2024-11-27 03:07:46.423596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:44.061 [2024-11-27 03:07:46.423599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:44.996 03:07:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:44.996 03:07:47 -- common/autotest_common.sh@862 -- # return 0 00:12:44.996 03:07:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:44.996 03:07:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:44.996 03:07:47 -- common/autotest_common.sh@10 -- # set +x 00:12:44.996 03:07:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:44.996 03:07:47 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:44.996 03:07:47 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:44.996 03:07:47 -- target/multitarget.sh@21 -- # jq length 00:12:44.996 03:07:47 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:44.996 03:07:47 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:44.996 "nvmf_tgt_1" 00:12:44.996 03:07:47 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:45.255 "nvmf_tgt_2" 00:12:45.255 03:07:47 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:45.255 03:07:47 -- target/multitarget.sh@28 -- # jq length 00:12:45.255 03:07:47 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:45.255 03:07:47 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:45.255 true 00:12:45.255 03:07:47 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:45.514 true 00:12:45.514 03:07:47 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:45.514 03:07:47 -- target/multitarget.sh@35 -- # jq length 00:12:45.514 03:07:48 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:45.514 03:07:48 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:45.514 03:07:48 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:45.514 03:07:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:45.514 03:07:48 -- nvmf/common.sh@116 -- # sync 00:12:45.514 03:07:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:45.514 03:07:48 -- nvmf/common.sh@119 -- # set +e 00:12:45.514 03:07:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:45.514 03:07:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:45.514 rmmod nvme_tcp 00:12:45.514 rmmod nvme_fabrics 00:12:45.514 rmmod nvme_keyring 00:12:45.774 03:07:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:45.774 03:07:48 -- nvmf/common.sh@123 -- # set -e 00:12:45.774 03:07:48 -- nvmf/common.sh@124 -- # return 0 00:12:45.774 03:07:48 -- nvmf/common.sh@477 -- # '[' -n 2397666 ']' 00:12:45.774 03:07:48 -- nvmf/common.sh@478 -- # killprocess 2397666 00:12:45.774 03:07:48 -- common/autotest_common.sh@936 -- # '[' -z 2397666 ']' 00:12:45.774 03:07:48 -- common/autotest_common.sh@940 -- # kill -0 2397666 00:12:45.774 03:07:48 -- common/autotest_common.sh@941 -- # uname 00:12:45.774 03:07:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:45.774 03:07:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2397666 00:12:45.774 03:07:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:45.774 03:07:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:45.774 03:07:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2397666' 00:12:45.774 killing process with pid 2397666 00:12:45.774 03:07:48 -- common/autotest_common.sh@955 -- # kill 2397666 00:12:45.774 03:07:48 -- common/autotest_common.sh@960 -- # wait 2397666 00:12:46.032 03:07:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:46.032 03:07:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:46.032 03:07:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:46.032 03:07:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:46.032 03:07:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:46.032 03:07:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:46.032 03:07:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:46.032 03:07:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:47.940 03:07:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:47.940 00:12:47.940 real 0m6.538s 00:12:47.940 user 0m9.635s 00:12:47.940 sys 0m1.992s 00:12:47.940 03:07:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:47.940 03:07:50 -- common/autotest_common.sh@10 -- # set +x 00:12:47.940 ************************************ 00:12:47.940 END TEST nvmf_multitarget 00:12:47.940 ************************************ 00:12:47.940 03:07:50 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:47.940 03:07:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:47.940 03:07:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:47.940 03:07:50 -- common/autotest_common.sh@10 -- # set +x 00:12:47.940 ************************************ 00:12:47.940 START TEST nvmf_rpc 00:12:47.940 ************************************ 00:12:47.940 03:07:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:47.940 * Looking for test storage... 00:12:47.940 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:47.940 03:07:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:47.940 03:07:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:47.940 03:07:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:48.201 03:07:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:48.201 03:07:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:48.201 03:07:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:48.201 03:07:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:48.201 03:07:50 -- scripts/common.sh@335 -- # IFS=.-: 00:12:48.201 03:07:50 -- scripts/common.sh@335 -- # read -ra ver1 00:12:48.201 03:07:50 -- scripts/common.sh@336 -- # IFS=.-: 00:12:48.201 03:07:50 -- scripts/common.sh@336 -- # read -ra ver2 00:12:48.201 03:07:50 -- scripts/common.sh@337 -- # local 'op=<' 00:12:48.201 03:07:50 -- scripts/common.sh@339 -- # ver1_l=2 00:12:48.201 03:07:50 -- scripts/common.sh@340 -- # ver2_l=1 00:12:48.201 03:07:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:48.201 03:07:50 -- scripts/common.sh@343 -- # case "$op" in 00:12:48.201 03:07:50 -- scripts/common.sh@344 -- # : 1 00:12:48.201 03:07:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:48.201 03:07:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:48.201 03:07:50 -- scripts/common.sh@364 -- # decimal 1 00:12:48.201 03:07:50 -- scripts/common.sh@352 -- # local d=1 00:12:48.201 03:07:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:48.202 03:07:50 -- scripts/common.sh@354 -- # echo 1 00:12:48.202 03:07:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:48.202 03:07:50 -- scripts/common.sh@365 -- # decimal 2 00:12:48.202 03:07:50 -- scripts/common.sh@352 -- # local d=2 00:12:48.202 03:07:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:48.202 03:07:50 -- scripts/common.sh@354 -- # echo 2 00:12:48.202 03:07:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:48.202 03:07:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:48.202 03:07:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:48.202 03:07:50 -- scripts/common.sh@367 -- # return 0 00:12:48.202 03:07:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:48.202 03:07:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:48.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:48.202 --rc genhtml_branch_coverage=1 00:12:48.202 --rc genhtml_function_coverage=1 00:12:48.202 --rc genhtml_legend=1 00:12:48.202 --rc geninfo_all_blocks=1 00:12:48.202 --rc geninfo_unexecuted_blocks=1 00:12:48.202 00:12:48.202 ' 00:12:48.202 03:07:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:48.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:48.202 --rc genhtml_branch_coverage=1 00:12:48.202 --rc genhtml_function_coverage=1 00:12:48.202 --rc genhtml_legend=1 00:12:48.202 --rc geninfo_all_blocks=1 00:12:48.202 --rc geninfo_unexecuted_blocks=1 00:12:48.202 00:12:48.202 ' 00:12:48.202 03:07:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:48.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:48.202 --rc genhtml_branch_coverage=1 00:12:48.202 --rc genhtml_function_coverage=1 00:12:48.202 --rc genhtml_legend=1 00:12:48.202 --rc geninfo_all_blocks=1 00:12:48.202 --rc geninfo_unexecuted_blocks=1 00:12:48.202 00:12:48.202 ' 00:12:48.202 03:07:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:48.202 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:48.202 --rc genhtml_branch_coverage=1 00:12:48.202 --rc genhtml_function_coverage=1 00:12:48.202 --rc genhtml_legend=1 00:12:48.202 --rc geninfo_all_blocks=1 00:12:48.202 --rc geninfo_unexecuted_blocks=1 00:12:48.202 00:12:48.202 ' 00:12:48.202 03:07:50 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:48.202 03:07:50 -- nvmf/common.sh@7 -- # uname -s 00:12:48.202 03:07:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:48.202 03:07:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:48.202 03:07:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:48.202 03:07:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:48.202 03:07:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:48.202 03:07:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:48.202 03:07:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:48.202 03:07:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:48.202 03:07:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:48.202 03:07:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:48.202 03:07:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:48.202 03:07:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:48.202 03:07:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:48.202 03:07:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:48.202 03:07:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:48.202 03:07:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:48.202 03:07:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:48.202 03:07:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:48.202 03:07:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:48.202 03:07:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.202 03:07:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.202 03:07:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.202 03:07:50 -- paths/export.sh@5 -- # export PATH 00:12:48.202 03:07:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:48.202 03:07:50 -- nvmf/common.sh@46 -- # : 0 00:12:48.202 03:07:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:48.202 03:07:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:48.202 03:07:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:48.202 03:07:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:48.202 03:07:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:48.202 03:07:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:48.202 03:07:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:48.202 03:07:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:48.202 03:07:50 -- target/rpc.sh@11 -- # loops=5 00:12:48.202 03:07:50 -- target/rpc.sh@23 -- # nvmftestinit 00:12:48.202 03:07:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:48.202 03:07:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:48.202 03:07:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:48.202 03:07:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:48.202 03:07:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:48.202 03:07:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:48.202 03:07:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:48.202 03:07:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:48.202 03:07:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:48.202 03:07:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:48.202 03:07:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:48.202 03:07:50 -- common/autotest_common.sh@10 -- # set +x 00:12:50.107 03:07:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:50.107 03:07:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:50.107 03:07:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:50.107 03:07:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:50.107 03:07:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:50.107 03:07:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:50.107 03:07:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:50.107 03:07:52 -- nvmf/common.sh@294 -- # net_devs=() 00:12:50.107 03:07:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:50.107 03:07:52 -- nvmf/common.sh@295 -- # e810=() 00:12:50.107 03:07:52 -- nvmf/common.sh@295 -- # local -ga e810 00:12:50.107 03:07:52 -- nvmf/common.sh@296 -- # x722=() 00:12:50.107 03:07:52 -- nvmf/common.sh@296 -- # local -ga x722 00:12:50.107 03:07:52 -- nvmf/common.sh@297 -- # mlx=() 00:12:50.107 03:07:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:50.107 03:07:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:50.107 03:07:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:50.107 03:07:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:50.107 03:07:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:50.107 03:07:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:50.107 03:07:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:50.107 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:50.107 03:07:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:50.107 03:07:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:50.107 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:50.107 03:07:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:50.107 03:07:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:50.107 03:07:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:50.107 03:07:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:50.107 03:07:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:50.107 03:07:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:50.107 03:07:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:50.107 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:50.107 03:07:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:50.107 03:07:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:50.108 03:07:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:50.108 03:07:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:50.108 03:07:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:50.108 03:07:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:50.108 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:50.108 03:07:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:50.108 03:07:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:50.108 03:07:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:50.108 03:07:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:50.108 03:07:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:50.108 03:07:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:50.108 03:07:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:50.108 03:07:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:50.108 03:07:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:50.108 03:07:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:50.108 03:07:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:50.108 03:07:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:50.108 03:07:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:50.108 03:07:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:50.108 03:07:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:50.108 03:07:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:50.108 03:07:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:50.108 03:07:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:50.108 03:07:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:50.108 03:07:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:50.108 03:07:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:50.108 03:07:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:50.108 03:07:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:50.108 03:07:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:50.108 03:07:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:50.108 03:07:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:50.108 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:50.108 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:12:50.108 00:12:50.108 --- 10.0.0.2 ping statistics --- 00:12:50.108 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:50.108 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:12:50.108 03:07:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:50.108 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:50.108 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:12:50.108 00:12:50.108 --- 10.0.0.1 ping statistics --- 00:12:50.108 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:50.108 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:12:50.108 03:07:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:50.108 03:07:52 -- nvmf/common.sh@410 -- # return 0 00:12:50.108 03:07:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:50.108 03:07:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:50.108 03:07:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:50.108 03:07:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:50.108 03:07:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:50.108 03:07:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:50.108 03:07:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:50.108 03:07:52 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:50.108 03:07:52 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:50.108 03:07:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:50.108 03:07:52 -- common/autotest_common.sh@10 -- # set +x 00:12:50.108 03:07:52 -- nvmf/common.sh@469 -- # nvmfpid=2399797 00:12:50.108 03:07:52 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:50.108 03:07:52 -- nvmf/common.sh@470 -- # waitforlisten 2399797 00:12:50.108 03:07:52 -- common/autotest_common.sh@829 -- # '[' -z 2399797 ']' 00:12:50.108 03:07:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:50.108 03:07:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:50.108 03:07:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:50.108 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:50.108 03:07:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:50.108 03:07:52 -- common/autotest_common.sh@10 -- # set +x 00:12:50.368 [2024-11-27 03:07:52.745920] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:50.368 [2024-11-27 03:07:52.745990] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:50.368 EAL: No free 2048 kB hugepages reported on node 1 00:12:50.368 [2024-11-27 03:07:52.813063] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:50.368 [2024-11-27 03:07:52.900038] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:50.368 [2024-11-27 03:07:52.900207] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:50.368 [2024-11-27 03:07:52.900225] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:50.368 [2024-11-27 03:07:52.900238] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:50.368 [2024-11-27 03:07:52.900291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:50.368 [2024-11-27 03:07:52.900366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:50.368 [2024-11-27 03:07:52.900417] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:50.368 [2024-11-27 03:07:52.900420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:51.303 03:07:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:51.303 03:07:53 -- common/autotest_common.sh@862 -- # return 0 00:12:51.303 03:07:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:51.303 03:07:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:51.303 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:12:51.303 03:07:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:51.303 03:07:53 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:51.303 03:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.303 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:12:51.303 03:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.303 03:07:53 -- target/rpc.sh@26 -- # stats='{ 00:12:51.303 "tick_rate": 2700000000, 00:12:51.303 "poll_groups": [ 00:12:51.303 { 00:12:51.303 "name": "nvmf_tgt_poll_group_0", 00:12:51.303 "admin_qpairs": 0, 00:12:51.303 "io_qpairs": 0, 00:12:51.303 "current_admin_qpairs": 0, 00:12:51.303 "current_io_qpairs": 0, 00:12:51.303 "pending_bdev_io": 0, 00:12:51.303 "completed_nvme_io": 0, 00:12:51.303 "transports": [] 00:12:51.303 }, 00:12:51.303 { 00:12:51.303 "name": "nvmf_tgt_poll_group_1", 00:12:51.303 "admin_qpairs": 0, 00:12:51.303 "io_qpairs": 0, 00:12:51.303 "current_admin_qpairs": 0, 00:12:51.303 "current_io_qpairs": 0, 00:12:51.303 "pending_bdev_io": 0, 00:12:51.303 "completed_nvme_io": 0, 00:12:51.303 "transports": [] 00:12:51.303 }, 00:12:51.303 { 00:12:51.303 "name": "nvmf_tgt_poll_group_2", 00:12:51.303 "admin_qpairs": 0, 00:12:51.303 "io_qpairs": 0, 00:12:51.303 "current_admin_qpairs": 0, 00:12:51.303 "current_io_qpairs": 0, 00:12:51.303 "pending_bdev_io": 0, 00:12:51.303 "completed_nvme_io": 0, 00:12:51.303 "transports": [] 00:12:51.303 }, 00:12:51.303 { 00:12:51.303 "name": "nvmf_tgt_poll_group_3", 00:12:51.303 "admin_qpairs": 0, 00:12:51.303 "io_qpairs": 0, 00:12:51.303 "current_admin_qpairs": 0, 00:12:51.303 "current_io_qpairs": 0, 00:12:51.303 "pending_bdev_io": 0, 00:12:51.303 "completed_nvme_io": 0, 00:12:51.303 "transports": [] 00:12:51.303 } 00:12:51.303 ] 00:12:51.303 }' 00:12:51.303 03:07:53 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:51.303 03:07:53 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:51.303 03:07:53 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:51.303 03:07:53 -- target/rpc.sh@15 -- # wc -l 00:12:51.303 03:07:53 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:51.303 03:07:53 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:51.303 03:07:53 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:51.303 03:07:53 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:51.304 03:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.304 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:12:51.304 [2024-11-27 03:07:53.891758] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:51.304 03:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.304 03:07:53 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:51.304 03:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.304 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:12:51.304 03:07:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.304 03:07:53 -- target/rpc.sh@33 -- # stats='{ 00:12:51.304 "tick_rate": 2700000000, 00:12:51.304 "poll_groups": [ 00:12:51.304 { 00:12:51.304 "name": "nvmf_tgt_poll_group_0", 00:12:51.304 "admin_qpairs": 0, 00:12:51.304 "io_qpairs": 0, 00:12:51.304 "current_admin_qpairs": 0, 00:12:51.304 "current_io_qpairs": 0, 00:12:51.304 "pending_bdev_io": 0, 00:12:51.304 "completed_nvme_io": 0, 00:12:51.304 "transports": [ 00:12:51.304 { 00:12:51.304 "trtype": "TCP" 00:12:51.304 } 00:12:51.304 ] 00:12:51.304 }, 00:12:51.304 { 00:12:51.304 "name": "nvmf_tgt_poll_group_1", 00:12:51.304 "admin_qpairs": 0, 00:12:51.304 "io_qpairs": 0, 00:12:51.304 "current_admin_qpairs": 0, 00:12:51.304 "current_io_qpairs": 0, 00:12:51.304 "pending_bdev_io": 0, 00:12:51.304 "completed_nvme_io": 0, 00:12:51.304 "transports": [ 00:12:51.304 { 00:12:51.304 "trtype": "TCP" 00:12:51.304 } 00:12:51.304 ] 00:12:51.304 }, 00:12:51.304 { 00:12:51.304 "name": "nvmf_tgt_poll_group_2", 00:12:51.304 "admin_qpairs": 0, 00:12:51.304 "io_qpairs": 0, 00:12:51.304 "current_admin_qpairs": 0, 00:12:51.304 "current_io_qpairs": 0, 00:12:51.304 "pending_bdev_io": 0, 00:12:51.304 "completed_nvme_io": 0, 00:12:51.304 "transports": [ 00:12:51.304 { 00:12:51.304 "trtype": "TCP" 00:12:51.304 } 00:12:51.304 ] 00:12:51.304 }, 00:12:51.304 { 00:12:51.304 "name": "nvmf_tgt_poll_group_3", 00:12:51.304 "admin_qpairs": 0, 00:12:51.304 "io_qpairs": 0, 00:12:51.304 "current_admin_qpairs": 0, 00:12:51.304 "current_io_qpairs": 0, 00:12:51.304 "pending_bdev_io": 0, 00:12:51.304 "completed_nvme_io": 0, 00:12:51.304 "transports": [ 00:12:51.304 { 00:12:51.304 "trtype": "TCP" 00:12:51.304 } 00:12:51.304 ] 00:12:51.304 } 00:12:51.304 ] 00:12:51.304 }' 00:12:51.304 03:07:53 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:51.304 03:07:53 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:51.304 03:07:53 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:51.304 03:07:53 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:51.562 03:07:53 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:51.562 03:07:53 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:51.562 03:07:53 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:51.562 03:07:53 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:51.562 03:07:53 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:51.562 03:07:53 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:51.562 03:07:53 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:51.562 03:07:53 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:51.562 03:07:53 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:51.562 03:07:53 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:51.562 03:07:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.562 03:07:53 -- common/autotest_common.sh@10 -- # set +x 00:12:51.562 Malloc1 00:12:51.562 03:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.562 03:07:54 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:51.562 03:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.562 03:07:54 -- common/autotest_common.sh@10 -- # set +x 00:12:51.562 03:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.562 03:07:54 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:51.562 03:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.562 03:07:54 -- common/autotest_common.sh@10 -- # set +x 00:12:51.562 03:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.562 03:07:54 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:51.562 03:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.562 03:07:54 -- common/autotest_common.sh@10 -- # set +x 00:12:51.562 03:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.562 03:07:54 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:51.562 03:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.562 03:07:54 -- common/autotest_common.sh@10 -- # set +x 00:12:51.562 [2024-11-27 03:07:54.044476] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:51.562 03:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.562 03:07:54 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:51.562 03:07:54 -- common/autotest_common.sh@650 -- # local es=0 00:12:51.563 03:07:54 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:51.563 03:07:54 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:51.563 03:07:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:51.563 03:07:54 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:51.563 03:07:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:51.563 03:07:54 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:51.563 03:07:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:51.563 03:07:54 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:51.563 03:07:54 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:51.563 03:07:54 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:51.563 [2024-11-27 03:07:54.066942] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:51.563 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:51.563 could not add new controller: failed to write to nvme-fabrics device 00:12:51.563 03:07:54 -- common/autotest_common.sh@653 -- # es=1 00:12:51.563 03:07:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:51.563 03:07:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:51.563 03:07:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:51.563 03:07:54 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:51.563 03:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:51.563 03:07:54 -- common/autotest_common.sh@10 -- # set +x 00:12:51.563 03:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:51.563 03:07:54 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:52.500 03:07:54 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:52.500 03:07:54 -- common/autotest_common.sh@1187 -- # local i=0 00:12:52.500 03:07:54 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:52.500 03:07:54 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:52.500 03:07:54 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:54.404 03:07:56 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:54.404 03:07:56 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:54.404 03:07:56 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:54.404 03:07:56 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:54.404 03:07:56 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:54.404 03:07:56 -- common/autotest_common.sh@1197 -- # return 0 00:12:54.404 03:07:56 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:54.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:54.404 03:07:56 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:54.404 03:07:56 -- common/autotest_common.sh@1208 -- # local i=0 00:12:54.404 03:07:56 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:54.404 03:07:56 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:54.404 03:07:56 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:54.404 03:07:56 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:54.404 03:07:56 -- common/autotest_common.sh@1220 -- # return 0 00:12:54.404 03:07:56 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:54.404 03:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:54.404 03:07:56 -- common/autotest_common.sh@10 -- # set +x 00:12:54.404 03:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:54.404 03:07:56 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:54.404 03:07:56 -- common/autotest_common.sh@650 -- # local es=0 00:12:54.404 03:07:56 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:54.404 03:07:56 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:54.404 03:07:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:54.404 03:07:56 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:54.404 03:07:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:54.404 03:07:56 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:54.404 03:07:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:54.404 03:07:56 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:54.404 03:07:56 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:54.404 03:07:56 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:54.404 [2024-11-27 03:07:56.902270] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:54.404 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:54.404 could not add new controller: failed to write to nvme-fabrics device 00:12:54.404 03:07:56 -- common/autotest_common.sh@653 -- # es=1 00:12:54.404 03:07:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:54.404 03:07:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:54.404 03:07:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:54.404 03:07:56 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:54.404 03:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:54.404 03:07:56 -- common/autotest_common.sh@10 -- # set +x 00:12:54.404 03:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:54.404 03:07:56 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:55.345 03:07:57 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:55.345 03:07:57 -- common/autotest_common.sh@1187 -- # local i=0 00:12:55.345 03:07:57 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:55.345 03:07:57 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:55.345 03:07:57 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:57.249 03:07:59 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:57.249 03:07:59 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:57.249 03:07:59 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:57.249 03:07:59 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:57.249 03:07:59 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:57.249 03:07:59 -- common/autotest_common.sh@1197 -- # return 0 00:12:57.249 03:07:59 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:57.249 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:57.249 03:07:59 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:57.249 03:07:59 -- common/autotest_common.sh@1208 -- # local i=0 00:12:57.249 03:07:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:57.249 03:07:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:57.249 03:07:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:57.249 03:07:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:57.249 03:07:59 -- common/autotest_common.sh@1220 -- # return 0 00:12:57.249 03:07:59 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:57.249 03:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.249 03:07:59 -- common/autotest_common.sh@10 -- # set +x 00:12:57.249 03:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.249 03:07:59 -- target/rpc.sh@81 -- # seq 1 5 00:12:57.249 03:07:59 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:57.250 03:07:59 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:57.250 03:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.250 03:07:59 -- common/autotest_common.sh@10 -- # set +x 00:12:57.250 03:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.250 03:07:59 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:57.250 03:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.250 03:07:59 -- common/autotest_common.sh@10 -- # set +x 00:12:57.250 [2024-11-27 03:07:59.741087] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:57.250 03:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.250 03:07:59 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:57.250 03:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.250 03:07:59 -- common/autotest_common.sh@10 -- # set +x 00:12:57.250 03:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.250 03:07:59 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:57.250 03:07:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:57.250 03:07:59 -- common/autotest_common.sh@10 -- # set +x 00:12:57.250 03:07:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:57.250 03:07:59 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:58.182 03:08:00 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:58.182 03:08:00 -- common/autotest_common.sh@1187 -- # local i=0 00:12:58.182 03:08:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:58.182 03:08:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:58.182 03:08:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:00.085 03:08:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:00.085 03:08:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:00.085 03:08:02 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:00.085 03:08:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:00.085 03:08:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:00.085 03:08:02 -- common/autotest_common.sh@1197 -- # return 0 00:13:00.085 03:08:02 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:00.085 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:00.085 03:08:02 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:00.085 03:08:02 -- common/autotest_common.sh@1208 -- # local i=0 00:13:00.085 03:08:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:00.085 03:08:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:00.085 03:08:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:00.085 03:08:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:00.085 03:08:02 -- common/autotest_common.sh@1220 -- # return 0 00:13:00.085 03:08:02 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:00.085 03:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.085 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:00.085 03:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.085 03:08:02 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:00.085 03:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.085 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:00.085 03:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.085 03:08:02 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:00.085 03:08:02 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:00.085 03:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.085 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:00.085 03:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.085 03:08:02 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:00.085 03:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.085 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:00.085 [2024-11-27 03:08:02.553183] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:00.085 03:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.085 03:08:02 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:00.085 03:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.085 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:00.085 03:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.085 03:08:02 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:00.085 03:08:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:00.085 03:08:02 -- common/autotest_common.sh@10 -- # set +x 00:13:00.085 03:08:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:00.085 03:08:02 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:00.654 03:08:03 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:00.654 03:08:03 -- common/autotest_common.sh@1187 -- # local i=0 00:13:00.654 03:08:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:00.654 03:08:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:00.654 03:08:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:02.557 03:08:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:02.557 03:08:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:02.558 03:08:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:02.816 03:08:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:02.816 03:08:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:02.816 03:08:05 -- common/autotest_common.sh@1197 -- # return 0 00:13:02.816 03:08:05 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:02.816 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:02.816 03:08:05 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:02.816 03:08:05 -- common/autotest_common.sh@1208 -- # local i=0 00:13:02.816 03:08:05 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:02.816 03:08:05 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.816 03:08:05 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:02.816 03:08:05 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:02.816 03:08:05 -- common/autotest_common.sh@1220 -- # return 0 00:13:02.816 03:08:05 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:02.816 03:08:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.816 03:08:05 -- common/autotest_common.sh@10 -- # set +x 00:13:02.816 03:08:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.816 03:08:05 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:02.816 03:08:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.816 03:08:05 -- common/autotest_common.sh@10 -- # set +x 00:13:02.816 03:08:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.816 03:08:05 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:02.816 03:08:05 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:02.816 03:08:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.816 03:08:05 -- common/autotest_common.sh@10 -- # set +x 00:13:02.816 03:08:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.816 03:08:05 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:02.816 03:08:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.816 03:08:05 -- common/autotest_common.sh@10 -- # set +x 00:13:02.816 [2024-11-27 03:08:05.286172] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:02.816 03:08:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.816 03:08:05 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:02.816 03:08:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.816 03:08:05 -- common/autotest_common.sh@10 -- # set +x 00:13:02.816 03:08:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.816 03:08:05 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:02.816 03:08:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:02.816 03:08:05 -- common/autotest_common.sh@10 -- # set +x 00:13:02.816 03:08:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:02.816 03:08:05 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:03.384 03:08:05 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:03.384 03:08:05 -- common/autotest_common.sh@1187 -- # local i=0 00:13:03.384 03:08:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:03.384 03:08:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:03.384 03:08:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:05.923 03:08:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:05.923 03:08:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:05.923 03:08:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:05.923 03:08:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:05.923 03:08:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:05.923 03:08:07 -- common/autotest_common.sh@1197 -- # return 0 00:13:05.923 03:08:07 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:05.923 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:05.923 03:08:08 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:05.923 03:08:08 -- common/autotest_common.sh@1208 -- # local i=0 00:13:05.923 03:08:08 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:05.924 03:08:08 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:05.924 03:08:08 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:05.924 03:08:08 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:05.924 03:08:08 -- common/autotest_common.sh@1220 -- # return 0 00:13:05.924 03:08:08 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:05.924 03:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.924 03:08:08 -- common/autotest_common.sh@10 -- # set +x 00:13:05.924 03:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.924 03:08:08 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:05.924 03:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.924 03:08:08 -- common/autotest_common.sh@10 -- # set +x 00:13:05.924 03:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.924 03:08:08 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:05.924 03:08:08 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:05.924 03:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.924 03:08:08 -- common/autotest_common.sh@10 -- # set +x 00:13:05.924 03:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.924 03:08:08 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:05.924 03:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.924 03:08:08 -- common/autotest_common.sh@10 -- # set +x 00:13:05.924 [2024-11-27 03:08:08.093926] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:05.924 03:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.924 03:08:08 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:05.924 03:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.924 03:08:08 -- common/autotest_common.sh@10 -- # set +x 00:13:05.924 03:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.924 03:08:08 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:05.924 03:08:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:05.924 03:08:08 -- common/autotest_common.sh@10 -- # set +x 00:13:05.924 03:08:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:05.924 03:08:08 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:06.183 03:08:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:06.183 03:08:08 -- common/autotest_common.sh@1187 -- # local i=0 00:13:06.183 03:08:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:06.183 03:08:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:06.183 03:08:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:08.768 03:08:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:08.768 03:08:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:08.768 03:08:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:08.768 03:08:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:08.768 03:08:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:08.768 03:08:10 -- common/autotest_common.sh@1197 -- # return 0 00:13:08.768 03:08:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:08.768 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:08.768 03:08:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:08.768 03:08:10 -- common/autotest_common.sh@1208 -- # local i=0 00:13:08.768 03:08:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:08.768 03:08:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:08.768 03:08:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:08.768 03:08:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:08.768 03:08:10 -- common/autotest_common.sh@1220 -- # return 0 00:13:08.768 03:08:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:08.768 03:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.768 03:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:08.768 03:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.768 03:08:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:08.768 03:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.768 03:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:08.768 03:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.768 03:08:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:08.768 03:08:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:08.768 03:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.768 03:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:08.768 03:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.768 03:08:10 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:08.768 03:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.768 03:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:08.768 [2024-11-27 03:08:10.919970] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:08.768 03:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.768 03:08:10 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:08.768 03:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.768 03:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:08.768 03:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.768 03:08:10 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:08.768 03:08:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:08.768 03:08:10 -- common/autotest_common.sh@10 -- # set +x 00:13:08.768 03:08:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:08.768 03:08:10 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:09.028 03:08:11 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:09.028 03:08:11 -- common/autotest_common.sh@1187 -- # local i=0 00:13:09.028 03:08:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:09.028 03:08:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:09.028 03:08:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:10.933 03:08:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:10.933 03:08:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:10.933 03:08:13 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:11.193 03:08:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:11.193 03:08:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:11.193 03:08:13 -- common/autotest_common.sh@1197 -- # return 0 00:13:11.193 03:08:13 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:11.193 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:11.193 03:08:13 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:11.193 03:08:13 -- common/autotest_common.sh@1208 -- # local i=0 00:13:11.193 03:08:13 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:11.193 03:08:13 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.193 03:08:13 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:11.193 03:08:13 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:11.193 03:08:13 -- common/autotest_common.sh@1220 -- # return 0 00:13:11.193 03:08:13 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@99 -- # seq 1 5 00:13:11.193 03:08:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:11.193 03:08:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 [2024-11-27 03:08:13.708281] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:11.193 03:08:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 [2024-11-27 03:08:13.756343] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:11.193 03:08:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.193 [2024-11-27 03:08:13.804546] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.193 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.193 03:08:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:11.193 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.193 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.453 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.453 03:08:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.453 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.453 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.453 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.453 03:08:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.453 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.453 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.453 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.453 03:08:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.453 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.453 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.453 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.453 03:08:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:11.453 03:08:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.453 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.453 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.453 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.453 03:08:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.453 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 [2024-11-27 03:08:13.852714] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:11.454 03:08:13 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 [2024-11-27 03:08:13.900885] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:11.454 03:08:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.454 03:08:13 -- common/autotest_common.sh@10 -- # set +x 00:13:11.454 03:08:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.454 03:08:13 -- target/rpc.sh@110 -- # stats='{ 00:13:11.454 "tick_rate": 2700000000, 00:13:11.454 "poll_groups": [ 00:13:11.454 { 00:13:11.454 "name": "nvmf_tgt_poll_group_0", 00:13:11.454 "admin_qpairs": 2, 00:13:11.454 "io_qpairs": 84, 00:13:11.454 "current_admin_qpairs": 0, 00:13:11.454 "current_io_qpairs": 0, 00:13:11.454 "pending_bdev_io": 0, 00:13:11.454 "completed_nvme_io": 133, 00:13:11.454 "transports": [ 00:13:11.454 { 00:13:11.454 "trtype": "TCP" 00:13:11.454 } 00:13:11.454 ] 00:13:11.454 }, 00:13:11.454 { 00:13:11.454 "name": "nvmf_tgt_poll_group_1", 00:13:11.454 "admin_qpairs": 2, 00:13:11.454 "io_qpairs": 84, 00:13:11.454 "current_admin_qpairs": 0, 00:13:11.454 "current_io_qpairs": 0, 00:13:11.454 "pending_bdev_io": 0, 00:13:11.454 "completed_nvme_io": 184, 00:13:11.454 "transports": [ 00:13:11.454 { 00:13:11.454 "trtype": "TCP" 00:13:11.454 } 00:13:11.454 ] 00:13:11.454 }, 00:13:11.454 { 00:13:11.454 "name": "nvmf_tgt_poll_group_2", 00:13:11.454 "admin_qpairs": 1, 00:13:11.454 "io_qpairs": 84, 00:13:11.454 "current_admin_qpairs": 0, 00:13:11.454 "current_io_qpairs": 0, 00:13:11.454 "pending_bdev_io": 0, 00:13:11.454 "completed_nvme_io": 183, 00:13:11.454 "transports": [ 00:13:11.454 { 00:13:11.454 "trtype": "TCP" 00:13:11.454 } 00:13:11.454 ] 00:13:11.454 }, 00:13:11.454 { 00:13:11.454 "name": "nvmf_tgt_poll_group_3", 00:13:11.454 "admin_qpairs": 2, 00:13:11.454 "io_qpairs": 84, 00:13:11.454 "current_admin_qpairs": 0, 00:13:11.454 "current_io_qpairs": 0, 00:13:11.454 "pending_bdev_io": 0, 00:13:11.454 "completed_nvme_io": 186, 00:13:11.454 "transports": [ 00:13:11.454 { 00:13:11.454 "trtype": "TCP" 00:13:11.454 } 00:13:11.454 ] 00:13:11.454 } 00:13:11.454 ] 00:13:11.454 }' 00:13:11.454 03:08:13 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:11.454 03:08:13 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:11.454 03:08:13 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:11.454 03:08:13 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:11.454 03:08:13 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:11.454 03:08:13 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:11.454 03:08:13 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:11.454 03:08:13 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:11.454 03:08:13 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:11.454 03:08:14 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:11.454 03:08:14 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:11.454 03:08:14 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:11.454 03:08:14 -- target/rpc.sh@123 -- # nvmftestfini 00:13:11.454 03:08:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:11.454 03:08:14 -- nvmf/common.sh@116 -- # sync 00:13:11.454 03:08:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:11.454 03:08:14 -- nvmf/common.sh@119 -- # set +e 00:13:11.454 03:08:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:11.454 03:08:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:11.454 rmmod nvme_tcp 00:13:11.454 rmmod nvme_fabrics 00:13:11.454 rmmod nvme_keyring 00:13:11.714 03:08:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:11.714 03:08:14 -- nvmf/common.sh@123 -- # set -e 00:13:11.714 03:08:14 -- nvmf/common.sh@124 -- # return 0 00:13:11.714 03:08:14 -- nvmf/common.sh@477 -- # '[' -n 2399797 ']' 00:13:11.714 03:08:14 -- nvmf/common.sh@478 -- # killprocess 2399797 00:13:11.714 03:08:14 -- common/autotest_common.sh@936 -- # '[' -z 2399797 ']' 00:13:11.714 03:08:14 -- common/autotest_common.sh@940 -- # kill -0 2399797 00:13:11.714 03:08:14 -- common/autotest_common.sh@941 -- # uname 00:13:11.714 03:08:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:11.714 03:08:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2399797 00:13:11.714 03:08:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:11.714 03:08:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:11.714 03:08:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2399797' 00:13:11.714 killing process with pid 2399797 00:13:11.714 03:08:14 -- common/autotest_common.sh@955 -- # kill 2399797 00:13:11.714 03:08:14 -- common/autotest_common.sh@960 -- # wait 2399797 00:13:11.975 03:08:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:11.975 03:08:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:11.975 03:08:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:11.975 03:08:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:11.975 03:08:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:11.975 03:08:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:11.975 03:08:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:11.975 03:08:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:13.913 03:08:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:13.913 00:13:13.913 real 0m25.985s 00:13:13.913 user 1m25.521s 00:13:13.913 sys 0m4.064s 00:13:13.913 03:08:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:13.913 03:08:16 -- common/autotest_common.sh@10 -- # set +x 00:13:13.913 ************************************ 00:13:13.913 END TEST nvmf_rpc 00:13:13.913 ************************************ 00:13:13.913 03:08:16 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:13.913 03:08:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:13.913 03:08:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:13.913 03:08:16 -- common/autotest_common.sh@10 -- # set +x 00:13:13.913 ************************************ 00:13:13.913 START TEST nvmf_invalid 00:13:13.913 ************************************ 00:13:13.913 03:08:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:14.196 * Looking for test storage... 00:13:14.196 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:14.196 03:08:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:14.196 03:08:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:14.196 03:08:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:14.196 03:08:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:14.196 03:08:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:14.196 03:08:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:14.196 03:08:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:14.196 03:08:16 -- scripts/common.sh@335 -- # IFS=.-: 00:13:14.196 03:08:16 -- scripts/common.sh@335 -- # read -ra ver1 00:13:14.196 03:08:16 -- scripts/common.sh@336 -- # IFS=.-: 00:13:14.196 03:08:16 -- scripts/common.sh@336 -- # read -ra ver2 00:13:14.196 03:08:16 -- scripts/common.sh@337 -- # local 'op=<' 00:13:14.196 03:08:16 -- scripts/common.sh@339 -- # ver1_l=2 00:13:14.196 03:08:16 -- scripts/common.sh@340 -- # ver2_l=1 00:13:14.196 03:08:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:14.196 03:08:16 -- scripts/common.sh@343 -- # case "$op" in 00:13:14.196 03:08:16 -- scripts/common.sh@344 -- # : 1 00:13:14.196 03:08:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:14.196 03:08:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:14.196 03:08:16 -- scripts/common.sh@364 -- # decimal 1 00:13:14.196 03:08:16 -- scripts/common.sh@352 -- # local d=1 00:13:14.196 03:08:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:14.196 03:08:16 -- scripts/common.sh@354 -- # echo 1 00:13:14.196 03:08:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:14.196 03:08:16 -- scripts/common.sh@365 -- # decimal 2 00:13:14.196 03:08:16 -- scripts/common.sh@352 -- # local d=2 00:13:14.196 03:08:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:14.196 03:08:16 -- scripts/common.sh@354 -- # echo 2 00:13:14.196 03:08:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:14.196 03:08:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:14.196 03:08:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:14.196 03:08:16 -- scripts/common.sh@367 -- # return 0 00:13:14.196 03:08:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:14.196 03:08:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:14.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.196 --rc genhtml_branch_coverage=1 00:13:14.196 --rc genhtml_function_coverage=1 00:13:14.196 --rc genhtml_legend=1 00:13:14.196 --rc geninfo_all_blocks=1 00:13:14.196 --rc geninfo_unexecuted_blocks=1 00:13:14.196 00:13:14.196 ' 00:13:14.196 03:08:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:14.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.196 --rc genhtml_branch_coverage=1 00:13:14.196 --rc genhtml_function_coverage=1 00:13:14.196 --rc genhtml_legend=1 00:13:14.196 --rc geninfo_all_blocks=1 00:13:14.196 --rc geninfo_unexecuted_blocks=1 00:13:14.196 00:13:14.196 ' 00:13:14.196 03:08:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:14.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.196 --rc genhtml_branch_coverage=1 00:13:14.196 --rc genhtml_function_coverage=1 00:13:14.196 --rc genhtml_legend=1 00:13:14.196 --rc geninfo_all_blocks=1 00:13:14.196 --rc geninfo_unexecuted_blocks=1 00:13:14.196 00:13:14.196 ' 00:13:14.196 03:08:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:14.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:14.196 --rc genhtml_branch_coverage=1 00:13:14.196 --rc genhtml_function_coverage=1 00:13:14.196 --rc genhtml_legend=1 00:13:14.196 --rc geninfo_all_blocks=1 00:13:14.196 --rc geninfo_unexecuted_blocks=1 00:13:14.196 00:13:14.196 ' 00:13:14.196 03:08:16 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:14.196 03:08:16 -- nvmf/common.sh@7 -- # uname -s 00:13:14.196 03:08:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:14.196 03:08:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:14.196 03:08:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:14.196 03:08:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:14.196 03:08:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:14.196 03:08:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:14.196 03:08:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:14.196 03:08:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:14.196 03:08:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:14.196 03:08:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:14.196 03:08:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:14.196 03:08:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:14.197 03:08:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:14.197 03:08:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:14.197 03:08:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:14.197 03:08:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:14.197 03:08:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:14.197 03:08:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:14.197 03:08:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:14.197 03:08:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:14.197 03:08:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:14.197 03:08:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:14.197 03:08:16 -- paths/export.sh@5 -- # export PATH 00:13:14.197 03:08:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:14.197 03:08:16 -- nvmf/common.sh@46 -- # : 0 00:13:14.197 03:08:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:14.197 03:08:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:14.197 03:08:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:14.197 03:08:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:14.197 03:08:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:14.197 03:08:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:14.197 03:08:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:14.197 03:08:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:14.197 03:08:16 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:14.197 03:08:16 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:14.197 03:08:16 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:14.197 03:08:16 -- target/invalid.sh@14 -- # target=foobar 00:13:14.197 03:08:16 -- target/invalid.sh@16 -- # RANDOM=0 00:13:14.197 03:08:16 -- target/invalid.sh@34 -- # nvmftestinit 00:13:14.197 03:08:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:14.197 03:08:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:14.197 03:08:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:14.197 03:08:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:14.197 03:08:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:14.197 03:08:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:14.197 03:08:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:14.197 03:08:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:14.197 03:08:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:14.197 03:08:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:14.197 03:08:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:14.197 03:08:16 -- common/autotest_common.sh@10 -- # set +x 00:13:16.729 03:08:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:16.729 03:08:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:16.729 03:08:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:16.729 03:08:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:16.729 03:08:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:16.729 03:08:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:16.729 03:08:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:16.729 03:08:18 -- nvmf/common.sh@294 -- # net_devs=() 00:13:16.729 03:08:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:16.729 03:08:18 -- nvmf/common.sh@295 -- # e810=() 00:13:16.729 03:08:18 -- nvmf/common.sh@295 -- # local -ga e810 00:13:16.729 03:08:18 -- nvmf/common.sh@296 -- # x722=() 00:13:16.729 03:08:18 -- nvmf/common.sh@296 -- # local -ga x722 00:13:16.729 03:08:18 -- nvmf/common.sh@297 -- # mlx=() 00:13:16.729 03:08:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:16.729 03:08:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:16.729 03:08:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:16.729 03:08:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:16.729 03:08:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:16.729 03:08:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:16.729 03:08:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:16.729 03:08:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:16.730 03:08:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:16.730 03:08:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:16.730 03:08:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:16.730 03:08:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:16.730 03:08:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:16.730 03:08:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:16.730 03:08:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:16.730 03:08:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:16.730 03:08:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:16.730 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:16.730 03:08:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:16.730 03:08:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:16.730 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:16.730 03:08:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:16.730 03:08:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:16.730 03:08:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:16.730 03:08:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:16.730 03:08:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:16.730 03:08:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:16.730 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:16.730 03:08:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:16.730 03:08:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:16.730 03:08:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:16.730 03:08:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:16.730 03:08:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:16.730 03:08:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:16.730 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:16.730 03:08:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:16.730 03:08:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:16.730 03:08:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:16.730 03:08:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:16.730 03:08:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:16.730 03:08:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:16.730 03:08:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:16.730 03:08:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:16.730 03:08:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:16.730 03:08:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:16.730 03:08:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:16.730 03:08:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:16.730 03:08:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:16.730 03:08:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:16.730 03:08:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:16.730 03:08:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:16.730 03:08:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:16.730 03:08:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:16.730 03:08:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:16.730 03:08:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:16.730 03:08:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:16.730 03:08:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:16.730 03:08:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:16.730 03:08:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:16.730 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:16.730 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.196 ms 00:13:16.730 00:13:16.730 --- 10.0.0.2 ping statistics --- 00:13:16.730 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:16.730 rtt min/avg/max/mdev = 0.196/0.196/0.196/0.000 ms 00:13:16.730 03:08:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:16.730 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:16.730 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:13:16.730 00:13:16.730 --- 10.0.0.1 ping statistics --- 00:13:16.730 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:16.730 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:13:16.730 03:08:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:16.730 03:08:18 -- nvmf/common.sh@410 -- # return 0 00:13:16.730 03:08:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:16.730 03:08:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:16.730 03:08:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:16.730 03:08:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:16.730 03:08:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:16.730 03:08:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:16.730 03:08:18 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:16.730 03:08:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:16.730 03:08:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:16.730 03:08:18 -- common/autotest_common.sh@10 -- # set +x 00:13:16.730 03:08:18 -- nvmf/common.sh@469 -- # nvmfpid=2404540 00:13:16.730 03:08:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:16.730 03:08:18 -- nvmf/common.sh@470 -- # waitforlisten 2404540 00:13:16.730 03:08:18 -- common/autotest_common.sh@829 -- # '[' -z 2404540 ']' 00:13:16.730 03:08:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:16.730 03:08:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:16.730 03:08:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:16.730 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:16.730 03:08:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:16.730 03:08:18 -- common/autotest_common.sh@10 -- # set +x 00:13:16.730 [2024-11-27 03:08:19.037854] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:16.730 [2024-11-27 03:08:19.037941] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:16.730 EAL: No free 2048 kB hugepages reported on node 1 00:13:16.730 [2024-11-27 03:08:19.110941] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:16.730 [2024-11-27 03:08:19.202184] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:16.730 [2024-11-27 03:08:19.202342] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:16.730 [2024-11-27 03:08:19.202361] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:16.730 [2024-11-27 03:08:19.202375] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:16.730 [2024-11-27 03:08:19.202465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:16.730 [2024-11-27 03:08:19.202520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:16.730 [2024-11-27 03:08:19.202571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:16.730 [2024-11-27 03:08:19.202575] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:17.662 03:08:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:17.662 03:08:20 -- common/autotest_common.sh@862 -- # return 0 00:13:17.662 03:08:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:17.662 03:08:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:17.662 03:08:20 -- common/autotest_common.sh@10 -- # set +x 00:13:17.662 03:08:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:17.662 03:08:20 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:17.662 03:08:20 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode31502 00:13:17.919 [2024-11-27 03:08:20.338240] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:17.919 03:08:20 -- target/invalid.sh@40 -- # out='request: 00:13:17.919 { 00:13:17.919 "nqn": "nqn.2016-06.io.spdk:cnode31502", 00:13:17.919 "tgt_name": "foobar", 00:13:17.919 "method": "nvmf_create_subsystem", 00:13:17.919 "req_id": 1 00:13:17.919 } 00:13:17.919 Got JSON-RPC error response 00:13:17.919 response: 00:13:17.919 { 00:13:17.919 "code": -32603, 00:13:17.919 "message": "Unable to find target foobar" 00:13:17.919 }' 00:13:17.919 03:08:20 -- target/invalid.sh@41 -- # [[ request: 00:13:17.919 { 00:13:17.919 "nqn": "nqn.2016-06.io.spdk:cnode31502", 00:13:17.919 "tgt_name": "foobar", 00:13:17.919 "method": "nvmf_create_subsystem", 00:13:17.919 "req_id": 1 00:13:17.919 } 00:13:17.919 Got JSON-RPC error response 00:13:17.919 response: 00:13:17.919 { 00:13:17.919 "code": -32603, 00:13:17.919 "message": "Unable to find target foobar" 00:13:17.920 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:17.920 03:08:20 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:17.920 03:08:20 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode27851 00:13:18.177 [2024-11-27 03:08:20.595113] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode27851: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:18.177 03:08:20 -- target/invalid.sh@45 -- # out='request: 00:13:18.177 { 00:13:18.177 "nqn": "nqn.2016-06.io.spdk:cnode27851", 00:13:18.177 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:18.177 "method": "nvmf_create_subsystem", 00:13:18.177 "req_id": 1 00:13:18.177 } 00:13:18.177 Got JSON-RPC error response 00:13:18.177 response: 00:13:18.177 { 00:13:18.177 "code": -32602, 00:13:18.177 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:18.177 }' 00:13:18.177 03:08:20 -- target/invalid.sh@46 -- # [[ request: 00:13:18.177 { 00:13:18.177 "nqn": "nqn.2016-06.io.spdk:cnode27851", 00:13:18.177 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:18.177 "method": "nvmf_create_subsystem", 00:13:18.177 "req_id": 1 00:13:18.177 } 00:13:18.177 Got JSON-RPC error response 00:13:18.177 response: 00:13:18.177 { 00:13:18.177 "code": -32602, 00:13:18.177 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:18.177 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:18.177 03:08:20 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:18.177 03:08:20 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode28581 00:13:18.435 [2024-11-27 03:08:20.843884] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28581: invalid model number 'SPDK_Controller' 00:13:18.435 03:08:20 -- target/invalid.sh@50 -- # out='request: 00:13:18.435 { 00:13:18.435 "nqn": "nqn.2016-06.io.spdk:cnode28581", 00:13:18.435 "model_number": "SPDK_Controller\u001f", 00:13:18.435 "method": "nvmf_create_subsystem", 00:13:18.435 "req_id": 1 00:13:18.435 } 00:13:18.435 Got JSON-RPC error response 00:13:18.435 response: 00:13:18.435 { 00:13:18.435 "code": -32602, 00:13:18.435 "message": "Invalid MN SPDK_Controller\u001f" 00:13:18.435 }' 00:13:18.435 03:08:20 -- target/invalid.sh@51 -- # [[ request: 00:13:18.435 { 00:13:18.435 "nqn": "nqn.2016-06.io.spdk:cnode28581", 00:13:18.435 "model_number": "SPDK_Controller\u001f", 00:13:18.435 "method": "nvmf_create_subsystem", 00:13:18.435 "req_id": 1 00:13:18.435 } 00:13:18.435 Got JSON-RPC error response 00:13:18.435 response: 00:13:18.435 { 00:13:18.435 "code": -32602, 00:13:18.435 "message": "Invalid MN SPDK_Controller\u001f" 00:13:18.435 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:18.435 03:08:20 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:18.435 03:08:20 -- target/invalid.sh@19 -- # local length=21 ll 00:13:18.435 03:08:20 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:18.435 03:08:20 -- target/invalid.sh@21 -- # local chars 00:13:18.435 03:08:20 -- target/invalid.sh@22 -- # local string 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 122 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=z 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 85 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=U 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 125 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+='}' 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 63 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+='?' 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 48 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=0 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 42 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+='*' 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 101 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=e 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 96 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+='`' 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 71 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=G 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 101 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=e 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 100 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=d 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 111 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=o 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 96 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+='`' 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 48 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x30' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=0 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 89 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x59' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=Y 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 41 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x29' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=')' 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 97 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=a 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 116 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # string+=t 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.435 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # printf %x 83 00:13:18.435 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:18.436 03:08:20 -- target/invalid.sh@25 -- # string+=S 00:13:18.436 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.436 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.436 03:08:20 -- target/invalid.sh@25 -- # printf %x 77 00:13:18.436 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:18.436 03:08:20 -- target/invalid.sh@25 -- # string+=M 00:13:18.436 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.436 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.436 03:08:20 -- target/invalid.sh@25 -- # printf %x 64 00:13:18.436 03:08:20 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:18.436 03:08:20 -- target/invalid.sh@25 -- # string+=@ 00:13:18.436 03:08:20 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.436 03:08:20 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.436 03:08:20 -- target/invalid.sh@28 -- # [[ z == \- ]] 00:13:18.436 03:08:20 -- target/invalid.sh@31 -- # echo 'zU}?0*e`Gedo`0Y)atSM@' 00:13:18.436 03:08:20 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'zU}?0*e`Gedo`0Y)atSM@' nqn.2016-06.io.spdk:cnode23399 00:13:18.694 [2024-11-27 03:08:21.160943] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23399: invalid serial number 'zU}?0*e`Gedo`0Y)atSM@' 00:13:18.694 03:08:21 -- target/invalid.sh@54 -- # out='request: 00:13:18.694 { 00:13:18.694 "nqn": "nqn.2016-06.io.spdk:cnode23399", 00:13:18.694 "serial_number": "zU}?0*e`Gedo`0Y)atSM@", 00:13:18.694 "method": "nvmf_create_subsystem", 00:13:18.694 "req_id": 1 00:13:18.694 } 00:13:18.694 Got JSON-RPC error response 00:13:18.694 response: 00:13:18.694 { 00:13:18.694 "code": -32602, 00:13:18.694 "message": "Invalid SN zU}?0*e`Gedo`0Y)atSM@" 00:13:18.694 }' 00:13:18.694 03:08:21 -- target/invalid.sh@55 -- # [[ request: 00:13:18.694 { 00:13:18.694 "nqn": "nqn.2016-06.io.spdk:cnode23399", 00:13:18.694 "serial_number": "zU}?0*e`Gedo`0Y)atSM@", 00:13:18.694 "method": "nvmf_create_subsystem", 00:13:18.694 "req_id": 1 00:13:18.694 } 00:13:18.694 Got JSON-RPC error response 00:13:18.694 response: 00:13:18.694 { 00:13:18.694 "code": -32602, 00:13:18.694 "message": "Invalid SN zU}?0*e`Gedo`0Y)atSM@" 00:13:18.694 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:18.694 03:08:21 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:18.694 03:08:21 -- target/invalid.sh@19 -- # local length=41 ll 00:13:18.694 03:08:21 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:18.694 03:08:21 -- target/invalid.sh@21 -- # local chars 00:13:18.694 03:08:21 -- target/invalid.sh@22 -- # local string 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 111 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=o 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 90 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=Z 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 115 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x73' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=s 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 42 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+='*' 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 67 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=C 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 64 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=@ 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 38 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x26' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+='&' 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 81 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x51' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=Q 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 59 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=';' 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 123 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+='{' 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 121 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=y 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 90 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=Z 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 63 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+='?' 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 82 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x52' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=R 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 114 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x72' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=r 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 109 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=m 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 106 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=j 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 72 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=H 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 40 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x28' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+='(' 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.694 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # printf %x 56 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x38' 00:13:18.694 03:08:21 -- target/invalid.sh@25 -- # string+=8 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 32 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x20' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=' ' 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 95 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=_ 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 107 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=k 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 75 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=K 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 101 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x65' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=e 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 106 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=j 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 127 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=$'\177' 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 123 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+='{' 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 42 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+='*' 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 59 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=';' 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 50 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x32' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=2 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 83 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=S 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 102 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=f 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 98 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x62' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=b 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # printf %x 57 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x39' 00:13:18.695 03:08:21 -- target/invalid.sh@25 -- # string+=9 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.695 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.952 03:08:21 -- target/invalid.sh@25 -- # printf %x 113 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x71' 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # string+=q 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # printf %x 90 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # string+=Z 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # printf %x 59 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x3b' 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # string+=';' 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # printf %x 120 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x78' 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # string+=x 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # printf %x 127 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # string+=$'\177' 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # printf %x 39 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # echo -e '\x27' 00:13:18.953 03:08:21 -- target/invalid.sh@25 -- # string+=\' 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:18.953 03:08:21 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:18.953 03:08:21 -- target/invalid.sh@28 -- # [[ o == \- ]] 00:13:18.953 03:08:21 -- target/invalid.sh@31 -- # echo 'oZs*C@&Q;{yZ?RrmjH(8 _kKej{*;2Sfb9qZ;x'\''' 00:13:18.953 03:08:21 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'oZs*C@&Q;{yZ?RrmjH(8 _kKej{*;2Sfb9qZ;x'\''' nqn.2016-06.io.spdk:cnode4895 00:13:18.953 [2024-11-27 03:08:21.558271] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4895: invalid model number 'oZs*C@&Q;{yZ?RrmjH(8 _kKej{*;2Sfb9qZ;x'' 00:13:19.211 03:08:21 -- target/invalid.sh@58 -- # out='request: 00:13:19.211 { 00:13:19.211 "nqn": "nqn.2016-06.io.spdk:cnode4895", 00:13:19.211 "model_number": "oZs*C@&Q;{yZ?RrmjH(8 _kKej\u007f{*;2Sfb9qZ;x\u007f'\''", 00:13:19.211 "method": "nvmf_create_subsystem", 00:13:19.211 "req_id": 1 00:13:19.211 } 00:13:19.211 Got JSON-RPC error response 00:13:19.211 response: 00:13:19.211 { 00:13:19.211 "code": -32602, 00:13:19.211 "message": "Invalid MN oZs*C@&Q;{yZ?RrmjH(8 _kKej\u007f{*;2Sfb9qZ;x\u007f'\''" 00:13:19.211 }' 00:13:19.211 03:08:21 -- target/invalid.sh@59 -- # [[ request: 00:13:19.211 { 00:13:19.211 "nqn": "nqn.2016-06.io.spdk:cnode4895", 00:13:19.211 "model_number": "oZs*C@&Q;{yZ?RrmjH(8 _kKej\u007f{*;2Sfb9qZ;x\u007f'", 00:13:19.211 "method": "nvmf_create_subsystem", 00:13:19.211 "req_id": 1 00:13:19.211 } 00:13:19.211 Got JSON-RPC error response 00:13:19.211 response: 00:13:19.211 { 00:13:19.211 "code": -32602, 00:13:19.211 "message": "Invalid MN oZs*C@&Q;{yZ?RrmjH(8 _kKej\u007f{*;2Sfb9qZ;x\u007f'" 00:13:19.211 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:19.211 03:08:21 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:19.211 [2024-11-27 03:08:21.811175] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:19.469 03:08:21 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:19.726 03:08:22 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:19.726 03:08:22 -- target/invalid.sh@67 -- # echo '' 00:13:19.726 03:08:22 -- target/invalid.sh@67 -- # head -n 1 00:13:19.726 03:08:22 -- target/invalid.sh@67 -- # IP= 00:13:19.726 03:08:22 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:19.726 [2024-11-27 03:08:22.324933] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:19.984 03:08:22 -- target/invalid.sh@69 -- # out='request: 00:13:19.984 { 00:13:19.984 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:19.984 "listen_address": { 00:13:19.984 "trtype": "tcp", 00:13:19.984 "traddr": "", 00:13:19.984 "trsvcid": "4421" 00:13:19.984 }, 00:13:19.984 "method": "nvmf_subsystem_remove_listener", 00:13:19.984 "req_id": 1 00:13:19.984 } 00:13:19.984 Got JSON-RPC error response 00:13:19.984 response: 00:13:19.984 { 00:13:19.984 "code": -32602, 00:13:19.984 "message": "Invalid parameters" 00:13:19.984 }' 00:13:19.984 03:08:22 -- target/invalid.sh@70 -- # [[ request: 00:13:19.984 { 00:13:19.984 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:19.984 "listen_address": { 00:13:19.984 "trtype": "tcp", 00:13:19.984 "traddr": "", 00:13:19.984 "trsvcid": "4421" 00:13:19.984 }, 00:13:19.984 "method": "nvmf_subsystem_remove_listener", 00:13:19.984 "req_id": 1 00:13:19.984 } 00:13:19.984 Got JSON-RPC error response 00:13:19.984 response: 00:13:19.984 { 00:13:19.984 "code": -32602, 00:13:19.984 "message": "Invalid parameters" 00:13:19.984 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:19.984 03:08:22 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode23527 -i 0 00:13:19.984 [2024-11-27 03:08:22.585721] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode23527: invalid cntlid range [0-65519] 00:13:20.242 03:08:22 -- target/invalid.sh@73 -- # out='request: 00:13:20.242 { 00:13:20.242 "nqn": "nqn.2016-06.io.spdk:cnode23527", 00:13:20.242 "min_cntlid": 0, 00:13:20.242 "method": "nvmf_create_subsystem", 00:13:20.242 "req_id": 1 00:13:20.242 } 00:13:20.242 Got JSON-RPC error response 00:13:20.242 response: 00:13:20.242 { 00:13:20.242 "code": -32602, 00:13:20.242 "message": "Invalid cntlid range [0-65519]" 00:13:20.242 }' 00:13:20.242 03:08:22 -- target/invalid.sh@74 -- # [[ request: 00:13:20.242 { 00:13:20.242 "nqn": "nqn.2016-06.io.spdk:cnode23527", 00:13:20.242 "min_cntlid": 0, 00:13:20.242 "method": "nvmf_create_subsystem", 00:13:20.242 "req_id": 1 00:13:20.242 } 00:13:20.242 Got JSON-RPC error response 00:13:20.242 response: 00:13:20.242 { 00:13:20.242 "code": -32602, 00:13:20.242 "message": "Invalid cntlid range [0-65519]" 00:13:20.242 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:20.242 03:08:22 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode22066 -i 65520 00:13:20.242 [2024-11-27 03:08:22.834537] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22066: invalid cntlid range [65520-65519] 00:13:20.242 03:08:22 -- target/invalid.sh@75 -- # out='request: 00:13:20.242 { 00:13:20.242 "nqn": "nqn.2016-06.io.spdk:cnode22066", 00:13:20.242 "min_cntlid": 65520, 00:13:20.242 "method": "nvmf_create_subsystem", 00:13:20.242 "req_id": 1 00:13:20.242 } 00:13:20.242 Got JSON-RPC error response 00:13:20.242 response: 00:13:20.242 { 00:13:20.242 "code": -32602, 00:13:20.242 "message": "Invalid cntlid range [65520-65519]" 00:13:20.242 }' 00:13:20.242 03:08:22 -- target/invalid.sh@76 -- # [[ request: 00:13:20.242 { 00:13:20.242 "nqn": "nqn.2016-06.io.spdk:cnode22066", 00:13:20.242 "min_cntlid": 65520, 00:13:20.242 "method": "nvmf_create_subsystem", 00:13:20.242 "req_id": 1 00:13:20.242 } 00:13:20.242 Got JSON-RPC error response 00:13:20.242 response: 00:13:20.242 { 00:13:20.242 "code": -32602, 00:13:20.242 "message": "Invalid cntlid range [65520-65519]" 00:13:20.242 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:20.242 03:08:22 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode19217 -I 0 00:13:20.499 [2024-11-27 03:08:23.095423] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode19217: invalid cntlid range [1-0] 00:13:20.500 03:08:23 -- target/invalid.sh@77 -- # out='request: 00:13:20.500 { 00:13:20.500 "nqn": "nqn.2016-06.io.spdk:cnode19217", 00:13:20.500 "max_cntlid": 0, 00:13:20.500 "method": "nvmf_create_subsystem", 00:13:20.500 "req_id": 1 00:13:20.500 } 00:13:20.500 Got JSON-RPC error response 00:13:20.500 response: 00:13:20.500 { 00:13:20.500 "code": -32602, 00:13:20.500 "message": "Invalid cntlid range [1-0]" 00:13:20.500 }' 00:13:20.500 03:08:23 -- target/invalid.sh@78 -- # [[ request: 00:13:20.500 { 00:13:20.500 "nqn": "nqn.2016-06.io.spdk:cnode19217", 00:13:20.500 "max_cntlid": 0, 00:13:20.500 "method": "nvmf_create_subsystem", 00:13:20.500 "req_id": 1 00:13:20.500 } 00:13:20.500 Got JSON-RPC error response 00:13:20.500 response: 00:13:20.500 { 00:13:20.500 "code": -32602, 00:13:20.500 "message": "Invalid cntlid range [1-0]" 00:13:20.500 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:20.500 03:08:23 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode31257 -I 65520 00:13:20.757 [2024-11-27 03:08:23.348298] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode31257: invalid cntlid range [1-65520] 00:13:20.757 03:08:23 -- target/invalid.sh@79 -- # out='request: 00:13:20.757 { 00:13:20.757 "nqn": "nqn.2016-06.io.spdk:cnode31257", 00:13:20.757 "max_cntlid": 65520, 00:13:20.757 "method": "nvmf_create_subsystem", 00:13:20.757 "req_id": 1 00:13:20.757 } 00:13:20.757 Got JSON-RPC error response 00:13:20.757 response: 00:13:20.757 { 00:13:20.757 "code": -32602, 00:13:20.757 "message": "Invalid cntlid range [1-65520]" 00:13:20.757 }' 00:13:20.757 03:08:23 -- target/invalid.sh@80 -- # [[ request: 00:13:20.757 { 00:13:20.757 "nqn": "nqn.2016-06.io.spdk:cnode31257", 00:13:20.757 "max_cntlid": 65520, 00:13:20.757 "method": "nvmf_create_subsystem", 00:13:20.757 "req_id": 1 00:13:20.757 } 00:13:20.757 Got JSON-RPC error response 00:13:20.757 response: 00:13:20.757 { 00:13:20.757 "code": -32602, 00:13:20.757 "message": "Invalid cntlid range [1-65520]" 00:13:20.757 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:20.757 03:08:23 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6649 -i 6 -I 5 00:13:21.014 [2024-11-27 03:08:23.613225] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6649: invalid cntlid range [6-5] 00:13:21.272 03:08:23 -- target/invalid.sh@83 -- # out='request: 00:13:21.272 { 00:13:21.272 "nqn": "nqn.2016-06.io.spdk:cnode6649", 00:13:21.272 "min_cntlid": 6, 00:13:21.272 "max_cntlid": 5, 00:13:21.272 "method": "nvmf_create_subsystem", 00:13:21.272 "req_id": 1 00:13:21.272 } 00:13:21.272 Got JSON-RPC error response 00:13:21.272 response: 00:13:21.272 { 00:13:21.272 "code": -32602, 00:13:21.272 "message": "Invalid cntlid range [6-5]" 00:13:21.272 }' 00:13:21.272 03:08:23 -- target/invalid.sh@84 -- # [[ request: 00:13:21.272 { 00:13:21.272 "nqn": "nqn.2016-06.io.spdk:cnode6649", 00:13:21.272 "min_cntlid": 6, 00:13:21.272 "max_cntlid": 5, 00:13:21.272 "method": "nvmf_create_subsystem", 00:13:21.272 "req_id": 1 00:13:21.272 } 00:13:21.272 Got JSON-RPC error response 00:13:21.272 response: 00:13:21.272 { 00:13:21.272 "code": -32602, 00:13:21.272 "message": "Invalid cntlid range [6-5]" 00:13:21.272 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:21.272 03:08:23 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:21.272 03:08:23 -- target/invalid.sh@87 -- # out='request: 00:13:21.272 { 00:13:21.272 "name": "foobar", 00:13:21.272 "method": "nvmf_delete_target", 00:13:21.272 "req_id": 1 00:13:21.272 } 00:13:21.272 Got JSON-RPC error response 00:13:21.272 response: 00:13:21.272 { 00:13:21.272 "code": -32602, 00:13:21.272 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:21.272 }' 00:13:21.272 03:08:23 -- target/invalid.sh@88 -- # [[ request: 00:13:21.272 { 00:13:21.272 "name": "foobar", 00:13:21.272 "method": "nvmf_delete_target", 00:13:21.272 "req_id": 1 00:13:21.272 } 00:13:21.272 Got JSON-RPC error response 00:13:21.272 response: 00:13:21.272 { 00:13:21.272 "code": -32602, 00:13:21.272 "message": "The specified target doesn't exist, cannot delete it." 00:13:21.272 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:21.272 03:08:23 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:21.272 03:08:23 -- target/invalid.sh@91 -- # nvmftestfini 00:13:21.272 03:08:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:21.272 03:08:23 -- nvmf/common.sh@116 -- # sync 00:13:21.272 03:08:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:21.272 03:08:23 -- nvmf/common.sh@119 -- # set +e 00:13:21.272 03:08:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:21.272 03:08:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:21.272 rmmod nvme_tcp 00:13:21.272 rmmod nvme_fabrics 00:13:21.272 rmmod nvme_keyring 00:13:21.272 03:08:23 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:21.272 03:08:23 -- nvmf/common.sh@123 -- # set -e 00:13:21.272 03:08:23 -- nvmf/common.sh@124 -- # return 0 00:13:21.272 03:08:23 -- nvmf/common.sh@477 -- # '[' -n 2404540 ']' 00:13:21.272 03:08:23 -- nvmf/common.sh@478 -- # killprocess 2404540 00:13:21.272 03:08:23 -- common/autotest_common.sh@936 -- # '[' -z 2404540 ']' 00:13:21.272 03:08:23 -- common/autotest_common.sh@940 -- # kill -0 2404540 00:13:21.272 03:08:23 -- common/autotest_common.sh@941 -- # uname 00:13:21.272 03:08:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:21.272 03:08:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2404540 00:13:21.272 03:08:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:21.272 03:08:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:21.272 03:08:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2404540' 00:13:21.272 killing process with pid 2404540 00:13:21.272 03:08:23 -- common/autotest_common.sh@955 -- # kill 2404540 00:13:21.272 03:08:23 -- common/autotest_common.sh@960 -- # wait 2404540 00:13:21.530 03:08:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:21.530 03:08:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:21.530 03:08:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:21.530 03:08:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:21.530 03:08:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:21.530 03:08:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:21.530 03:08:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:21.530 03:08:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:24.067 03:08:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:24.067 00:13:24.067 real 0m9.663s 00:13:24.067 user 0m23.532s 00:13:24.067 sys 0m2.603s 00:13:24.067 03:08:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:24.067 03:08:26 -- common/autotest_common.sh@10 -- # set +x 00:13:24.067 ************************************ 00:13:24.067 END TEST nvmf_invalid 00:13:24.067 ************************************ 00:13:24.067 03:08:26 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:24.067 03:08:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:24.067 03:08:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:24.067 03:08:26 -- common/autotest_common.sh@10 -- # set +x 00:13:24.067 ************************************ 00:13:24.067 START TEST nvmf_abort 00:13:24.067 ************************************ 00:13:24.067 03:08:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:24.067 * Looking for test storage... 00:13:24.067 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:24.067 03:08:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:24.067 03:08:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:24.067 03:08:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:24.067 03:08:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:24.067 03:08:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:24.067 03:08:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:24.067 03:08:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:24.067 03:08:26 -- scripts/common.sh@335 -- # IFS=.-: 00:13:24.067 03:08:26 -- scripts/common.sh@335 -- # read -ra ver1 00:13:24.067 03:08:26 -- scripts/common.sh@336 -- # IFS=.-: 00:13:24.067 03:08:26 -- scripts/common.sh@336 -- # read -ra ver2 00:13:24.067 03:08:26 -- scripts/common.sh@337 -- # local 'op=<' 00:13:24.067 03:08:26 -- scripts/common.sh@339 -- # ver1_l=2 00:13:24.067 03:08:26 -- scripts/common.sh@340 -- # ver2_l=1 00:13:24.067 03:08:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:24.067 03:08:26 -- scripts/common.sh@343 -- # case "$op" in 00:13:24.067 03:08:26 -- scripts/common.sh@344 -- # : 1 00:13:24.067 03:08:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:24.067 03:08:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:24.067 03:08:26 -- scripts/common.sh@364 -- # decimal 1 00:13:24.067 03:08:26 -- scripts/common.sh@352 -- # local d=1 00:13:24.067 03:08:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:24.067 03:08:26 -- scripts/common.sh@354 -- # echo 1 00:13:24.067 03:08:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:24.067 03:08:26 -- scripts/common.sh@365 -- # decimal 2 00:13:24.067 03:08:26 -- scripts/common.sh@352 -- # local d=2 00:13:24.067 03:08:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:24.067 03:08:26 -- scripts/common.sh@354 -- # echo 2 00:13:24.067 03:08:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:24.067 03:08:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:24.067 03:08:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:24.067 03:08:26 -- scripts/common.sh@367 -- # return 0 00:13:24.067 03:08:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:24.067 03:08:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:24.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:24.067 --rc genhtml_branch_coverage=1 00:13:24.067 --rc genhtml_function_coverage=1 00:13:24.067 --rc genhtml_legend=1 00:13:24.067 --rc geninfo_all_blocks=1 00:13:24.067 --rc geninfo_unexecuted_blocks=1 00:13:24.067 00:13:24.067 ' 00:13:24.067 03:08:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:24.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:24.067 --rc genhtml_branch_coverage=1 00:13:24.067 --rc genhtml_function_coverage=1 00:13:24.067 --rc genhtml_legend=1 00:13:24.067 --rc geninfo_all_blocks=1 00:13:24.067 --rc geninfo_unexecuted_blocks=1 00:13:24.067 00:13:24.067 ' 00:13:24.067 03:08:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:24.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:24.067 --rc genhtml_branch_coverage=1 00:13:24.067 --rc genhtml_function_coverage=1 00:13:24.067 --rc genhtml_legend=1 00:13:24.067 --rc geninfo_all_blocks=1 00:13:24.067 --rc geninfo_unexecuted_blocks=1 00:13:24.067 00:13:24.067 ' 00:13:24.067 03:08:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:24.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:24.067 --rc genhtml_branch_coverage=1 00:13:24.067 --rc genhtml_function_coverage=1 00:13:24.067 --rc genhtml_legend=1 00:13:24.067 --rc geninfo_all_blocks=1 00:13:24.068 --rc geninfo_unexecuted_blocks=1 00:13:24.068 00:13:24.068 ' 00:13:24.068 03:08:26 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:24.068 03:08:26 -- nvmf/common.sh@7 -- # uname -s 00:13:24.068 03:08:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:24.068 03:08:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:24.068 03:08:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:24.068 03:08:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:24.068 03:08:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:24.068 03:08:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:24.068 03:08:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:24.068 03:08:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:24.068 03:08:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:24.068 03:08:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:24.068 03:08:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:24.068 03:08:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:24.068 03:08:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:24.068 03:08:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:24.068 03:08:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:24.068 03:08:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:24.068 03:08:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:24.068 03:08:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:24.068 03:08:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:24.068 03:08:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.068 03:08:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.068 03:08:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.068 03:08:26 -- paths/export.sh@5 -- # export PATH 00:13:24.068 03:08:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:24.068 03:08:26 -- nvmf/common.sh@46 -- # : 0 00:13:24.068 03:08:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:24.068 03:08:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:24.068 03:08:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:24.068 03:08:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:24.068 03:08:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:24.068 03:08:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:24.068 03:08:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:24.068 03:08:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:24.068 03:08:26 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:24.068 03:08:26 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:24.068 03:08:26 -- target/abort.sh@14 -- # nvmftestinit 00:13:24.068 03:08:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:24.068 03:08:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:24.068 03:08:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:24.068 03:08:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:24.068 03:08:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:24.068 03:08:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:24.068 03:08:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:24.068 03:08:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:24.068 03:08:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:24.068 03:08:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:24.068 03:08:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:24.068 03:08:26 -- common/autotest_common.sh@10 -- # set +x 00:13:25.967 03:08:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:25.967 03:08:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:25.967 03:08:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:25.968 03:08:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:25.968 03:08:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:25.968 03:08:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:25.968 03:08:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:25.968 03:08:28 -- nvmf/common.sh@294 -- # net_devs=() 00:13:25.968 03:08:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:25.968 03:08:28 -- nvmf/common.sh@295 -- # e810=() 00:13:25.968 03:08:28 -- nvmf/common.sh@295 -- # local -ga e810 00:13:25.968 03:08:28 -- nvmf/common.sh@296 -- # x722=() 00:13:25.968 03:08:28 -- nvmf/common.sh@296 -- # local -ga x722 00:13:25.968 03:08:28 -- nvmf/common.sh@297 -- # mlx=() 00:13:25.968 03:08:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:25.968 03:08:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:25.968 03:08:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:25.968 03:08:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:25.968 03:08:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:25.968 03:08:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:25.968 03:08:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:25.968 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:25.968 03:08:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:25.968 03:08:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:25.968 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:25.968 03:08:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:25.968 03:08:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:25.968 03:08:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:25.968 03:08:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:25.968 03:08:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:25.968 03:08:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:25.968 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:25.968 03:08:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:25.968 03:08:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:25.968 03:08:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:25.968 03:08:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:25.968 03:08:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:25.968 03:08:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:25.968 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:25.968 03:08:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:25.968 03:08:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:25.968 03:08:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:25.968 03:08:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:25.968 03:08:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:25.968 03:08:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:25.968 03:08:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:25.968 03:08:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:25.968 03:08:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:25.968 03:08:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:25.968 03:08:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:25.968 03:08:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:25.968 03:08:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:25.968 03:08:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:25.968 03:08:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:25.968 03:08:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:25.968 03:08:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:25.968 03:08:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:25.968 03:08:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:25.968 03:08:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:25.968 03:08:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:25.968 03:08:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:26.226 03:08:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:26.226 03:08:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:26.226 03:08:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:26.226 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:26.226 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.244 ms 00:13:26.226 00:13:26.226 --- 10.0.0.2 ping statistics --- 00:13:26.226 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:26.226 rtt min/avg/max/mdev = 0.244/0.244/0.244/0.000 ms 00:13:26.226 03:08:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:26.226 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:26.226 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:13:26.226 00:13:26.226 --- 10.0.0.1 ping statistics --- 00:13:26.226 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:26.226 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:13:26.226 03:08:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:26.226 03:08:28 -- nvmf/common.sh@410 -- # return 0 00:13:26.226 03:08:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:26.226 03:08:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:26.226 03:08:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:26.226 03:08:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:26.226 03:08:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:26.226 03:08:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:26.226 03:08:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:26.226 03:08:28 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:26.226 03:08:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:26.226 03:08:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:26.226 03:08:28 -- common/autotest_common.sh@10 -- # set +x 00:13:26.226 03:08:28 -- nvmf/common.sh@469 -- # nvmfpid=2407339 00:13:26.226 03:08:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:26.226 03:08:28 -- nvmf/common.sh@470 -- # waitforlisten 2407339 00:13:26.226 03:08:28 -- common/autotest_common.sh@829 -- # '[' -z 2407339 ']' 00:13:26.226 03:08:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:26.226 03:08:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:26.226 03:08:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:26.226 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:26.226 03:08:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:26.226 03:08:28 -- common/autotest_common.sh@10 -- # set +x 00:13:26.226 [2024-11-27 03:08:28.697003] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:26.226 [2024-11-27 03:08:28.697070] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:26.226 EAL: No free 2048 kB hugepages reported on node 1 00:13:26.226 [2024-11-27 03:08:28.762466] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:26.485 [2024-11-27 03:08:28.848218] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:26.485 [2024-11-27 03:08:28.848365] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:26.485 [2024-11-27 03:08:28.848384] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:26.485 [2024-11-27 03:08:28.848404] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:26.485 [2024-11-27 03:08:28.848480] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:26.485 [2024-11-27 03:08:28.848549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:26.485 [2024-11-27 03:08:28.848553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:27.420 03:08:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:27.420 03:08:29 -- common/autotest_common.sh@862 -- # return 0 00:13:27.420 03:08:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:27.420 03:08:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:27.420 03:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:27.420 03:08:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:27.420 03:08:29 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:27.420 03:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.420 03:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:27.420 [2024-11-27 03:08:29.734682] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:27.420 03:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.420 03:08:29 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:27.420 03:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.420 03:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:27.420 Malloc0 00:13:27.420 03:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.420 03:08:29 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:27.420 03:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.420 03:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:27.420 Delay0 00:13:27.420 03:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.420 03:08:29 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:27.420 03:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.420 03:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:27.420 03:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.420 03:08:29 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:27.421 03:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.421 03:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:27.421 03:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.421 03:08:29 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:27.421 03:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.421 03:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:27.421 [2024-11-27 03:08:29.808733] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:27.421 03:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.421 03:08:29 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:27.421 03:08:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:27.421 03:08:29 -- common/autotest_common.sh@10 -- # set +x 00:13:27.421 03:08:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:27.421 03:08:29 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:27.421 EAL: No free 2048 kB hugepages reported on node 1 00:13:27.421 [2024-11-27 03:08:29.914470] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:29.949 Initializing NVMe Controllers 00:13:29.949 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:29.949 controller IO queue size 128 less than required 00:13:29.949 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:29.949 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:29.949 Initialization complete. Launching workers. 00:13:29.949 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 34122 00:13:29.949 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 34183, failed to submit 62 00:13:29.949 success 34122, unsuccess 61, failed 0 00:13:29.949 03:08:32 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:29.949 03:08:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:29.949 03:08:32 -- common/autotest_common.sh@10 -- # set +x 00:13:29.949 03:08:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:29.949 03:08:32 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:29.949 03:08:32 -- target/abort.sh@38 -- # nvmftestfini 00:13:29.949 03:08:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:29.949 03:08:32 -- nvmf/common.sh@116 -- # sync 00:13:29.949 03:08:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:29.949 03:08:32 -- nvmf/common.sh@119 -- # set +e 00:13:29.949 03:08:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:29.949 03:08:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:29.949 rmmod nvme_tcp 00:13:29.949 rmmod nvme_fabrics 00:13:29.949 rmmod nvme_keyring 00:13:29.949 03:08:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:29.949 03:08:32 -- nvmf/common.sh@123 -- # set -e 00:13:29.949 03:08:32 -- nvmf/common.sh@124 -- # return 0 00:13:29.949 03:08:32 -- nvmf/common.sh@477 -- # '[' -n 2407339 ']' 00:13:29.950 03:08:32 -- nvmf/common.sh@478 -- # killprocess 2407339 00:13:29.950 03:08:32 -- common/autotest_common.sh@936 -- # '[' -z 2407339 ']' 00:13:29.950 03:08:32 -- common/autotest_common.sh@940 -- # kill -0 2407339 00:13:29.950 03:08:32 -- common/autotest_common.sh@941 -- # uname 00:13:29.950 03:08:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:29.950 03:08:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2407339 00:13:29.950 03:08:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:29.950 03:08:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:29.950 03:08:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2407339' 00:13:29.950 killing process with pid 2407339 00:13:29.950 03:08:32 -- common/autotest_common.sh@955 -- # kill 2407339 00:13:29.950 03:08:32 -- common/autotest_common.sh@960 -- # wait 2407339 00:13:29.950 03:08:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:29.950 03:08:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:29.950 03:08:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:29.950 03:08:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:29.950 03:08:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:29.950 03:08:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:29.950 03:08:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:29.950 03:08:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:31.855 03:08:34 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:32.114 00:13:32.114 real 0m8.296s 00:13:32.114 user 0m13.354s 00:13:32.114 sys 0m2.682s 00:13:32.114 03:08:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:32.114 03:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:32.114 ************************************ 00:13:32.114 END TEST nvmf_abort 00:13:32.114 ************************************ 00:13:32.114 03:08:34 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:32.114 03:08:34 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:32.114 03:08:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:32.114 03:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:32.114 ************************************ 00:13:32.114 START TEST nvmf_ns_hotplug_stress 00:13:32.114 ************************************ 00:13:32.114 03:08:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:32.114 * Looking for test storage... 00:13:32.114 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:32.114 03:08:34 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:32.114 03:08:34 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:32.114 03:08:34 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:32.114 03:08:34 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:32.114 03:08:34 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:32.114 03:08:34 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:32.114 03:08:34 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:32.114 03:08:34 -- scripts/common.sh@335 -- # IFS=.-: 00:13:32.114 03:08:34 -- scripts/common.sh@335 -- # read -ra ver1 00:13:32.114 03:08:34 -- scripts/common.sh@336 -- # IFS=.-: 00:13:32.114 03:08:34 -- scripts/common.sh@336 -- # read -ra ver2 00:13:32.114 03:08:34 -- scripts/common.sh@337 -- # local 'op=<' 00:13:32.114 03:08:34 -- scripts/common.sh@339 -- # ver1_l=2 00:13:32.114 03:08:34 -- scripts/common.sh@340 -- # ver2_l=1 00:13:32.114 03:08:34 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:32.114 03:08:34 -- scripts/common.sh@343 -- # case "$op" in 00:13:32.114 03:08:34 -- scripts/common.sh@344 -- # : 1 00:13:32.114 03:08:34 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:32.114 03:08:34 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:32.114 03:08:34 -- scripts/common.sh@364 -- # decimal 1 00:13:32.114 03:08:34 -- scripts/common.sh@352 -- # local d=1 00:13:32.114 03:08:34 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:32.114 03:08:34 -- scripts/common.sh@354 -- # echo 1 00:13:32.114 03:08:34 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:32.114 03:08:34 -- scripts/common.sh@365 -- # decimal 2 00:13:32.114 03:08:34 -- scripts/common.sh@352 -- # local d=2 00:13:32.115 03:08:34 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:32.115 03:08:34 -- scripts/common.sh@354 -- # echo 2 00:13:32.115 03:08:34 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:32.115 03:08:34 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:32.115 03:08:34 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:32.115 03:08:34 -- scripts/common.sh@367 -- # return 0 00:13:32.115 03:08:34 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:32.115 03:08:34 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:32.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.115 --rc genhtml_branch_coverage=1 00:13:32.115 --rc genhtml_function_coverage=1 00:13:32.115 --rc genhtml_legend=1 00:13:32.115 --rc geninfo_all_blocks=1 00:13:32.115 --rc geninfo_unexecuted_blocks=1 00:13:32.115 00:13:32.115 ' 00:13:32.115 03:08:34 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:32.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.115 --rc genhtml_branch_coverage=1 00:13:32.115 --rc genhtml_function_coverage=1 00:13:32.115 --rc genhtml_legend=1 00:13:32.115 --rc geninfo_all_blocks=1 00:13:32.115 --rc geninfo_unexecuted_blocks=1 00:13:32.115 00:13:32.115 ' 00:13:32.115 03:08:34 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:32.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.115 --rc genhtml_branch_coverage=1 00:13:32.115 --rc genhtml_function_coverage=1 00:13:32.115 --rc genhtml_legend=1 00:13:32.115 --rc geninfo_all_blocks=1 00:13:32.115 --rc geninfo_unexecuted_blocks=1 00:13:32.115 00:13:32.115 ' 00:13:32.115 03:08:34 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:32.115 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:32.115 --rc genhtml_branch_coverage=1 00:13:32.115 --rc genhtml_function_coverage=1 00:13:32.115 --rc genhtml_legend=1 00:13:32.115 --rc geninfo_all_blocks=1 00:13:32.115 --rc geninfo_unexecuted_blocks=1 00:13:32.115 00:13:32.115 ' 00:13:32.115 03:08:34 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:32.115 03:08:34 -- nvmf/common.sh@7 -- # uname -s 00:13:32.115 03:08:34 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:32.115 03:08:34 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:32.115 03:08:34 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:32.115 03:08:34 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:32.115 03:08:34 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:32.115 03:08:34 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:32.115 03:08:34 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:32.115 03:08:34 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:32.115 03:08:34 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:32.115 03:08:34 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:32.115 03:08:34 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.115 03:08:34 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:32.115 03:08:34 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:32.115 03:08:34 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:32.115 03:08:34 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:32.115 03:08:34 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:32.115 03:08:34 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:32.115 03:08:34 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:32.115 03:08:34 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:32.115 03:08:34 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.115 03:08:34 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.115 03:08:34 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.115 03:08:34 -- paths/export.sh@5 -- # export PATH 00:13:32.115 03:08:34 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:32.115 03:08:34 -- nvmf/common.sh@46 -- # : 0 00:13:32.115 03:08:34 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:32.115 03:08:34 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:32.115 03:08:34 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:32.115 03:08:34 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:32.115 03:08:34 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:32.115 03:08:34 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:32.115 03:08:34 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:32.115 03:08:34 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:32.115 03:08:34 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:32.115 03:08:34 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:32.115 03:08:34 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:32.115 03:08:34 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:32.115 03:08:34 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:32.115 03:08:34 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:32.115 03:08:34 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:32.115 03:08:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:32.115 03:08:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:32.115 03:08:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:32.115 03:08:34 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:32.115 03:08:34 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:32.115 03:08:34 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:32.115 03:08:34 -- common/autotest_common.sh@10 -- # set +x 00:13:34.646 03:08:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:34.646 03:08:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:34.646 03:08:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:34.646 03:08:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:34.646 03:08:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:34.646 03:08:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:34.646 03:08:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:34.646 03:08:36 -- nvmf/common.sh@294 -- # net_devs=() 00:13:34.646 03:08:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:34.646 03:08:36 -- nvmf/common.sh@295 -- # e810=() 00:13:34.646 03:08:36 -- nvmf/common.sh@295 -- # local -ga e810 00:13:34.646 03:08:36 -- nvmf/common.sh@296 -- # x722=() 00:13:34.646 03:08:36 -- nvmf/common.sh@296 -- # local -ga x722 00:13:34.646 03:08:36 -- nvmf/common.sh@297 -- # mlx=() 00:13:34.646 03:08:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:34.646 03:08:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:34.646 03:08:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:34.646 03:08:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:34.646 03:08:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:34.646 03:08:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.646 03:08:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:34.646 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:34.646 03:08:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:34.646 03:08:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:34.646 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:34.646 03:08:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:34.646 03:08:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:34.647 03:08:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:34.647 03:08:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:34.647 03:08:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:34.647 03:08:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:34.647 03:08:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.647 03:08:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.647 03:08:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.647 03:08:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:34.647 03:08:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:34.647 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:34.647 03:08:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:34.647 03:08:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:34.647 03:08:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:34.647 03:08:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:34.647 03:08:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:34.647 03:08:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:34.647 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:34.647 03:08:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:34.647 03:08:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:34.647 03:08:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:34.647 03:08:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:34.647 03:08:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:34.647 03:08:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:34.647 03:08:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:34.647 03:08:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:34.647 03:08:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:34.647 03:08:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:34.647 03:08:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:34.647 03:08:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:34.647 03:08:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:34.647 03:08:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:34.647 03:08:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:34.647 03:08:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:34.647 03:08:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:34.647 03:08:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:34.647 03:08:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:34.647 03:08:36 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:34.647 03:08:36 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:34.647 03:08:36 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:34.647 03:08:36 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:34.647 03:08:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:34.647 03:08:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:34.647 03:08:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:34.647 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:34.647 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.324 ms 00:13:34.647 00:13:34.647 --- 10.0.0.2 ping statistics --- 00:13:34.647 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:34.647 rtt min/avg/max/mdev = 0.324/0.324/0.324/0.000 ms 00:13:34.647 03:08:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:34.647 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:34.647 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:13:34.647 00:13:34.647 --- 10.0.0.1 ping statistics --- 00:13:34.647 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:34.647 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:13:34.647 03:08:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:34.647 03:08:36 -- nvmf/common.sh@410 -- # return 0 00:13:34.647 03:08:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:34.647 03:08:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:34.647 03:08:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:34.647 03:08:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:34.647 03:08:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:34.647 03:08:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:34.647 03:08:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:34.647 03:08:36 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:34.647 03:08:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:34.647 03:08:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:34.647 03:08:36 -- common/autotest_common.sh@10 -- # set +x 00:13:34.647 03:08:36 -- nvmf/common.sh@469 -- # nvmfpid=2409729 00:13:34.647 03:08:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:34.647 03:08:36 -- nvmf/common.sh@470 -- # waitforlisten 2409729 00:13:34.647 03:08:36 -- common/autotest_common.sh@829 -- # '[' -z 2409729 ']' 00:13:34.647 03:08:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:34.647 03:08:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:34.647 03:08:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:34.647 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:34.647 03:08:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:34.647 03:08:36 -- common/autotest_common.sh@10 -- # set +x 00:13:34.647 [2024-11-27 03:08:37.000053] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:34.647 [2024-11-27 03:08:37.000120] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:34.647 EAL: No free 2048 kB hugepages reported on node 1 00:13:34.647 [2024-11-27 03:08:37.067671] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:34.647 [2024-11-27 03:08:37.153348] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:34.647 [2024-11-27 03:08:37.153485] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:34.647 [2024-11-27 03:08:37.153519] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:34.647 [2024-11-27 03:08:37.153541] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:34.647 [2024-11-27 03:08:37.153630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:34.647 [2024-11-27 03:08:37.153680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:34.647 [2024-11-27 03:08:37.153683] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:35.580 03:08:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:35.581 03:08:38 -- common/autotest_common.sh@862 -- # return 0 00:13:35.581 03:08:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:35.581 03:08:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:35.581 03:08:38 -- common/autotest_common.sh@10 -- # set +x 00:13:35.581 03:08:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:35.581 03:08:38 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:35.581 03:08:38 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:35.838 [2024-11-27 03:08:38.273535] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:35.838 03:08:38 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:36.095 03:08:38 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:36.353 [2024-11-27 03:08:38.780447] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:36.353 03:08:38 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:36.618 03:08:39 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:36.875 Malloc0 00:13:36.875 03:08:39 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:37.131 Delay0 00:13:37.131 03:08:39 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:37.387 03:08:39 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:37.643 NULL1 00:13:37.643 03:08:40 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:37.900 03:08:40 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2410175 00:13:37.900 03:08:40 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:37.900 03:08:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:37.900 03:08:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.900 EAL: No free 2048 kB hugepages reported on node 1 00:13:38.156 03:08:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.412 03:08:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:38.412 03:08:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:38.669 true 00:13:38.669 03:08:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:38.669 03:08:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.925 03:08:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:39.182 03:08:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:39.182 03:08:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:39.438 true 00:13:39.438 03:08:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:39.438 03:08:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:39.695 03:08:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:39.953 03:08:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:39.953 03:08:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:40.211 true 00:13:40.211 03:08:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:40.211 03:08:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.144 Read completed with error (sct=0, sc=11) 00:13:41.144 03:08:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:41.144 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:41.402 03:08:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:13:41.402 03:08:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:41.660 true 00:13:41.660 03:08:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:41.660 03:08:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.917 03:08:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.175 03:08:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:13:42.175 03:08:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:42.432 true 00:13:42.432 03:08:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:42.432 03:08:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.366 03:08:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.366 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.366 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.366 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:43.624 03:08:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:13:43.624 03:08:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:43.882 true 00:13:43.882 03:08:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:43.882 03:08:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.140 03:08:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:44.398 03:08:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:13:44.398 03:08:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:44.655 true 00:13:44.655 03:08:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:44.655 03:08:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.590 03:08:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.590 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:45.590 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:45.848 03:08:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:13:45.848 03:08:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:46.105 true 00:13:46.105 03:08:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:46.105 03:08:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:46.363 03:08:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.621 03:08:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:13:46.621 03:08:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:46.878 true 00:13:46.878 03:08:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:46.878 03:08:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:47.812 03:08:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:47.812 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:47.812 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:47.812 03:08:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:13:47.812 03:08:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:48.070 true 00:13:48.070 03:08:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:48.070 03:08:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.327 03:08:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:48.585 03:08:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:48.585 03:08:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:48.842 true 00:13:48.842 03:08:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:48.842 03:08:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:49.777 03:08:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:49.777 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:50.035 03:08:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:50.035 03:08:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:50.293 true 00:13:50.293 03:08:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:50.293 03:08:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.550 03:08:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:50.808 03:08:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:50.808 03:08:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:51.066 true 00:13:51.066 03:08:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:51.066 03:08:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.003 03:08:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:52.003 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:52.261 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:52.261 03:08:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:52.261 03:08:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:52.518 true 00:13:52.519 03:08:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:52.519 03:08:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.777 03:08:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.035 03:08:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:53.035 03:08:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:53.294 true 00:13:53.294 03:08:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:53.294 03:08:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:53.552 03:08:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:53.811 03:08:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:53.811 03:08:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:54.069 true 00:13:54.069 03:08:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:54.069 03:08:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:55.445 03:08:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:55.445 03:08:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:55.445 03:08:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:55.704 true 00:13:55.704 03:08:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:55.704 03:08:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:55.963 03:08:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:56.270 03:08:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:56.270 03:08:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:56.558 true 00:13:56.558 03:08:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:56.558 03:08:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.558 03:08:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:56.817 03:08:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:56.817 03:08:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:57.075 true 00:13:57.075 03:08:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:57.076 03:08:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:58.457 03:09:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.457 03:09:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:58.457 03:09:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:58.716 true 00:13:58.716 03:09:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:58.716 03:09:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:58.975 03:09:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.234 03:09:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:59.234 03:09:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:59.492 true 00:13:59.492 03:09:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:13:59.492 03:09:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.750 03:09:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.009 03:09:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:00.009 03:09:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:00.267 true 00:14:00.267 03:09:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:14:00.267 03:09:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.204 03:09:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:01.462 03:09:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:01.462 03:09:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:01.721 true 00:14:01.721 03:09:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:14:01.721 03:09:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.979 03:09:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.237 03:09:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:02.237 03:09:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:02.495 true 00:14:02.495 03:09:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:14:02.495 03:09:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:02.753 03:09:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.012 03:09:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:03.012 03:09:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:03.270 true 00:14:03.270 03:09:05 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:14:03.270 03:09:05 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.652 03:09:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.652 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:04.652 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:04.652 03:09:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:04.652 03:09:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:04.910 true 00:14:04.910 03:09:07 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:14:04.910 03:09:07 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.168 03:09:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.427 03:09:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:05.427 03:09:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:05.685 true 00:14:05.685 03:09:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:14:05.685 03:09:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.944 03:09:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.202 03:09:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:06.202 03:09:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:06.460 true 00:14:06.460 03:09:09 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:14:06.460 03:09:09 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.399 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:07.399 03:09:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.966 03:09:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:07.966 03:09:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:07.966 true 00:14:07.966 03:09:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:14:07.966 03:09:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.224 Initializing NVMe Controllers 00:14:08.224 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:08.224 Controller IO queue size 128, less than required. 00:14:08.224 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:08.224 Controller IO queue size 128, less than required. 00:14:08.224 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:08.224 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:08.224 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:08.224 Initialization complete. Launching workers. 00:14:08.224 ======================================================== 00:14:08.224 Latency(us) 00:14:08.224 Device Information : IOPS MiB/s Average min max 00:14:08.225 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 528.10 0.26 99163.42 3012.91 1025589.29 00:14:08.225 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 9301.42 4.54 13720.15 2641.22 364530.94 00:14:08.225 ======================================================== 00:14:08.225 Total : 9829.52 4.80 18310.67 2641.22 1025589.29 00:14:08.225 00:14:08.225 03:09:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:08.483 03:09:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:14:08.483 03:09:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:14:08.741 true 00:14:08.742 03:09:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2410175 00:14:08.742 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2410175) - No such process 00:14:08.742 03:09:11 -- target/ns_hotplug_stress.sh@53 -- # wait 2410175 00:14:08.742 03:09:11 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.000 03:09:11 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:09.258 03:09:11 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:09.258 03:09:11 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:09.258 03:09:11 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:09.258 03:09:11 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:09.258 03:09:11 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:09.516 null0 00:14:09.516 03:09:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:09.516 03:09:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:09.516 03:09:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:09.774 null1 00:14:09.774 03:09:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:09.774 03:09:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:09.774 03:09:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:10.032 null2 00:14:10.032 03:09:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:10.032 03:09:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:10.032 03:09:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:10.290 null3 00:14:10.290 03:09:12 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:10.290 03:09:12 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:10.290 03:09:12 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:10.549 null4 00:14:10.549 03:09:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:10.549 03:09:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:10.549 03:09:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:10.808 null5 00:14:10.808 03:09:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:10.808 03:09:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:10.808 03:09:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:11.066 null6 00:14:11.066 03:09:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:11.066 03:09:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:11.066 03:09:13 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:11.323 null7 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:11.323 03:09:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@66 -- # wait 2415067 2415068 2415070 2415072 2415074 2415076 2415078 2415080 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.324 03:09:13 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:11.582 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:11.582 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:11.582 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.582 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:11.582 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:11.582 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:11.582 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:11.582 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:11.841 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:12.100 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:12.100 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:12.100 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.100 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:12.100 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:12.100 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:12.100 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:12.100 03:09:14 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.359 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:12.618 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.618 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.618 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:12.618 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.618 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.618 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:12.618 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:12.618 03:09:14 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:12.618 03:09:14 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:12.877 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:12.877 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:12.877 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.877 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:12.877 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:12.877 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:12.877 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:12.877 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.136 03:09:15 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:13.395 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:13.395 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:13.395 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:13.395 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.395 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:13.395 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:13.395 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:13.395 03:09:15 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:13.654 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:13.914 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:13.914 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:13.914 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:13.914 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:13.914 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.914 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:13.914 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:13.914 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.172 03:09:16 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.173 03:09:16 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:14.431 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:14.431 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:14.431 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:14.431 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:14.431 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:14.431 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:14.431 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:14.431 03:09:16 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:14.740 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:15.020 03:09:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:15.020 03:09:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:15.020 03:09:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:15.020 03:09:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:15.020 03:09:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:15.020 03:09:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.020 03:09:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:15.020 03:09:17 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.278 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.279 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:15.279 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.279 03:09:17 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.279 03:09:17 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:15.537 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:15.537 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:15.537 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:15.537 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.537 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:15.537 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:15.537 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:15.537 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:15.796 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:16.055 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:16.055 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:16.055 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:16.055 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:16.055 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:16.055 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:16.055 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.055 03:09:18 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.313 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.314 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:16.314 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.314 03:09:18 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.314 03:09:18 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:16.572 03:09:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:16.572 03:09:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:16.572 03:09:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:16.572 03:09:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:16.572 03:09:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:16.572 03:09:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:16.572 03:09:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:16.830 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.088 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.088 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.088 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:17.088 03:09:19 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:17.088 03:09:19 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:17.088 03:09:19 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:17.088 03:09:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:17.088 03:09:19 -- nvmf/common.sh@116 -- # sync 00:14:17.088 03:09:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:17.088 03:09:19 -- nvmf/common.sh@119 -- # set +e 00:14:17.088 03:09:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:17.088 03:09:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:17.088 rmmod nvme_tcp 00:14:17.088 rmmod nvme_fabrics 00:14:17.088 rmmod nvme_keyring 00:14:17.088 03:09:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:17.088 03:09:19 -- nvmf/common.sh@123 -- # set -e 00:14:17.088 03:09:19 -- nvmf/common.sh@124 -- # return 0 00:14:17.088 03:09:19 -- nvmf/common.sh@477 -- # '[' -n 2409729 ']' 00:14:17.088 03:09:19 -- nvmf/common.sh@478 -- # killprocess 2409729 00:14:17.088 03:09:19 -- common/autotest_common.sh@936 -- # '[' -z 2409729 ']' 00:14:17.088 03:09:19 -- common/autotest_common.sh@940 -- # kill -0 2409729 00:14:17.088 03:09:19 -- common/autotest_common.sh@941 -- # uname 00:14:17.088 03:09:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:17.088 03:09:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2409729 00:14:17.088 03:09:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:17.088 03:09:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:17.088 03:09:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2409729' 00:14:17.088 killing process with pid 2409729 00:14:17.088 03:09:19 -- common/autotest_common.sh@955 -- # kill 2409729 00:14:17.088 03:09:19 -- common/autotest_common.sh@960 -- # wait 2409729 00:14:17.347 03:09:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:17.347 03:09:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:17.347 03:09:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:17.347 03:09:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:17.347 03:09:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:17.347 03:09:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:17.347 03:09:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:17.347 03:09:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:19.247 03:09:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:19.247 00:14:19.247 real 0m47.343s 00:14:19.247 user 3m37.016s 00:14:19.247 sys 0m15.055s 00:14:19.247 03:09:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:19.247 03:09:21 -- common/autotest_common.sh@10 -- # set +x 00:14:19.247 ************************************ 00:14:19.247 END TEST nvmf_ns_hotplug_stress 00:14:19.247 ************************************ 00:14:19.505 03:09:21 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:19.505 03:09:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:19.505 03:09:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:19.505 03:09:21 -- common/autotest_common.sh@10 -- # set +x 00:14:19.505 ************************************ 00:14:19.505 START TEST nvmf_connect_stress 00:14:19.505 ************************************ 00:14:19.505 03:09:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:19.505 * Looking for test storage... 00:14:19.505 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:19.505 03:09:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:19.505 03:09:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:19.505 03:09:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:19.505 03:09:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:19.505 03:09:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:19.505 03:09:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:19.505 03:09:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:19.505 03:09:22 -- scripts/common.sh@335 -- # IFS=.-: 00:14:19.505 03:09:22 -- scripts/common.sh@335 -- # read -ra ver1 00:14:19.505 03:09:22 -- scripts/common.sh@336 -- # IFS=.-: 00:14:19.505 03:09:22 -- scripts/common.sh@336 -- # read -ra ver2 00:14:19.505 03:09:22 -- scripts/common.sh@337 -- # local 'op=<' 00:14:19.505 03:09:22 -- scripts/common.sh@339 -- # ver1_l=2 00:14:19.505 03:09:22 -- scripts/common.sh@340 -- # ver2_l=1 00:14:19.505 03:09:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:19.505 03:09:22 -- scripts/common.sh@343 -- # case "$op" in 00:14:19.505 03:09:22 -- scripts/common.sh@344 -- # : 1 00:14:19.505 03:09:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:19.505 03:09:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:19.505 03:09:22 -- scripts/common.sh@364 -- # decimal 1 00:14:19.505 03:09:22 -- scripts/common.sh@352 -- # local d=1 00:14:19.505 03:09:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:19.505 03:09:22 -- scripts/common.sh@354 -- # echo 1 00:14:19.505 03:09:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:19.505 03:09:22 -- scripts/common.sh@365 -- # decimal 2 00:14:19.505 03:09:22 -- scripts/common.sh@352 -- # local d=2 00:14:19.505 03:09:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:19.505 03:09:22 -- scripts/common.sh@354 -- # echo 2 00:14:19.505 03:09:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:19.505 03:09:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:19.505 03:09:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:19.505 03:09:22 -- scripts/common.sh@367 -- # return 0 00:14:19.505 03:09:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:19.505 03:09:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:19.506 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:19.506 --rc genhtml_branch_coverage=1 00:14:19.506 --rc genhtml_function_coverage=1 00:14:19.506 --rc genhtml_legend=1 00:14:19.506 --rc geninfo_all_blocks=1 00:14:19.506 --rc geninfo_unexecuted_blocks=1 00:14:19.506 00:14:19.506 ' 00:14:19.506 03:09:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:19.506 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:19.506 --rc genhtml_branch_coverage=1 00:14:19.506 --rc genhtml_function_coverage=1 00:14:19.506 --rc genhtml_legend=1 00:14:19.506 --rc geninfo_all_blocks=1 00:14:19.506 --rc geninfo_unexecuted_blocks=1 00:14:19.506 00:14:19.506 ' 00:14:19.506 03:09:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:19.506 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:19.506 --rc genhtml_branch_coverage=1 00:14:19.506 --rc genhtml_function_coverage=1 00:14:19.506 --rc genhtml_legend=1 00:14:19.506 --rc geninfo_all_blocks=1 00:14:19.506 --rc geninfo_unexecuted_blocks=1 00:14:19.506 00:14:19.506 ' 00:14:19.506 03:09:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:19.506 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:19.506 --rc genhtml_branch_coverage=1 00:14:19.506 --rc genhtml_function_coverage=1 00:14:19.506 --rc genhtml_legend=1 00:14:19.506 --rc geninfo_all_blocks=1 00:14:19.506 --rc geninfo_unexecuted_blocks=1 00:14:19.506 00:14:19.506 ' 00:14:19.506 03:09:22 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:19.506 03:09:22 -- nvmf/common.sh@7 -- # uname -s 00:14:19.506 03:09:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:19.506 03:09:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:19.506 03:09:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:19.506 03:09:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:19.506 03:09:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:19.506 03:09:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:19.506 03:09:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:19.506 03:09:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:19.506 03:09:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:19.506 03:09:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:19.506 03:09:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:19.506 03:09:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:19.506 03:09:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:19.506 03:09:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:19.506 03:09:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:19.506 03:09:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:19.506 03:09:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:19.506 03:09:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:19.506 03:09:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:19.506 03:09:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.506 03:09:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.506 03:09:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.506 03:09:22 -- paths/export.sh@5 -- # export PATH 00:14:19.506 03:09:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:19.506 03:09:22 -- nvmf/common.sh@46 -- # : 0 00:14:19.506 03:09:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:19.506 03:09:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:19.506 03:09:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:19.506 03:09:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:19.506 03:09:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:19.506 03:09:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:19.506 03:09:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:19.506 03:09:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:19.506 03:09:22 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:19.506 03:09:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:19.506 03:09:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:19.506 03:09:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:19.506 03:09:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:19.506 03:09:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:19.506 03:09:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:19.506 03:09:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:19.506 03:09:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:19.506 03:09:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:19.506 03:09:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:19.506 03:09:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:19.506 03:09:22 -- common/autotest_common.sh@10 -- # set +x 00:14:22.035 03:09:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:22.035 03:09:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:22.035 03:09:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:22.035 03:09:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:22.035 03:09:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:22.035 03:09:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:22.035 03:09:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:22.035 03:09:24 -- nvmf/common.sh@294 -- # net_devs=() 00:14:22.035 03:09:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:22.035 03:09:24 -- nvmf/common.sh@295 -- # e810=() 00:14:22.035 03:09:24 -- nvmf/common.sh@295 -- # local -ga e810 00:14:22.035 03:09:24 -- nvmf/common.sh@296 -- # x722=() 00:14:22.035 03:09:24 -- nvmf/common.sh@296 -- # local -ga x722 00:14:22.036 03:09:24 -- nvmf/common.sh@297 -- # mlx=() 00:14:22.036 03:09:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:22.036 03:09:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:22.036 03:09:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:22.036 03:09:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:22.036 03:09:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:22.036 03:09:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:22.036 03:09:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:22.036 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:22.036 03:09:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:22.036 03:09:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:22.036 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:22.036 03:09:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:22.036 03:09:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:22.036 03:09:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.036 03:09:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:22.036 03:09:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.036 03:09:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:22.036 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:22.036 03:09:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.036 03:09:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:22.036 03:09:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.036 03:09:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:22.036 03:09:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.036 03:09:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:22.036 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:22.036 03:09:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.036 03:09:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:22.036 03:09:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:22.036 03:09:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:22.036 03:09:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:22.036 03:09:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:22.036 03:09:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:22.036 03:09:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:22.036 03:09:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:22.036 03:09:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:22.036 03:09:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:22.036 03:09:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:22.036 03:09:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:22.036 03:09:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:22.036 03:09:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:22.036 03:09:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:22.036 03:09:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:22.036 03:09:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:22.036 03:09:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:22.036 03:09:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:22.036 03:09:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:22.036 03:09:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:22.036 03:09:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:22.036 03:09:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:22.036 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:22.036 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.359 ms 00:14:22.036 00:14:22.036 --- 10.0.0.2 ping statistics --- 00:14:22.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.036 rtt min/avg/max/mdev = 0.359/0.359/0.359/0.000 ms 00:14:22.036 03:09:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:22.036 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:22.036 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:14:22.036 00:14:22.036 --- 10.0.0.1 ping statistics --- 00:14:22.036 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.036 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:14:22.036 03:09:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:22.036 03:09:24 -- nvmf/common.sh@410 -- # return 0 00:14:22.036 03:09:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:22.036 03:09:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:22.036 03:09:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:22.036 03:09:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:22.036 03:09:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:22.036 03:09:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:22.036 03:09:24 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:22.036 03:09:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:22.036 03:09:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:22.036 03:09:24 -- common/autotest_common.sh@10 -- # set +x 00:14:22.036 03:09:24 -- nvmf/common.sh@469 -- # nvmfpid=2417876 00:14:22.036 03:09:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:22.036 03:09:24 -- nvmf/common.sh@470 -- # waitforlisten 2417876 00:14:22.036 03:09:24 -- common/autotest_common.sh@829 -- # '[' -z 2417876 ']' 00:14:22.036 03:09:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:22.036 03:09:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:22.036 03:09:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:22.036 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:22.036 03:09:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:22.036 03:09:24 -- common/autotest_common.sh@10 -- # set +x 00:14:22.036 [2024-11-27 03:09:24.349518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:22.036 [2024-11-27 03:09:24.349603] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:22.036 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.036 [2024-11-27 03:09:24.416408] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:22.036 [2024-11-27 03:09:24.504395] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:22.036 [2024-11-27 03:09:24.504563] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:22.036 [2024-11-27 03:09:24.504584] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:22.036 [2024-11-27 03:09:24.504599] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:22.036 [2024-11-27 03:09:24.504714] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:22.036 [2024-11-27 03:09:24.504801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:22.036 [2024-11-27 03:09:24.504804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:22.971 03:09:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:22.971 03:09:25 -- common/autotest_common.sh@862 -- # return 0 00:14:22.971 03:09:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:22.971 03:09:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:22.971 03:09:25 -- common/autotest_common.sh@10 -- # set +x 00:14:22.971 03:09:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:22.971 03:09:25 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:22.971 03:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.971 03:09:25 -- common/autotest_common.sh@10 -- # set +x 00:14:22.971 [2024-11-27 03:09:25.323537] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:22.971 03:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.971 03:09:25 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:22.971 03:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.971 03:09:25 -- common/autotest_common.sh@10 -- # set +x 00:14:22.971 03:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.971 03:09:25 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:22.971 03:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.971 03:09:25 -- common/autotest_common.sh@10 -- # set +x 00:14:22.971 [2024-11-27 03:09:25.352680] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:22.971 03:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.971 03:09:25 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:22.971 03:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.971 03:09:25 -- common/autotest_common.sh@10 -- # set +x 00:14:22.971 NULL1 00:14:22.971 03:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.971 03:09:25 -- target/connect_stress.sh@21 -- # PERF_PID=2418035 00:14:22.971 03:09:25 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:22.971 03:09:25 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:22.971 03:09:25 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:22.971 03:09:25 -- target/connect_stress.sh@28 -- # cat 00:14:22.971 03:09:25 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:22.971 03:09:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:22.971 03:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.971 03:09:25 -- common/autotest_common.sh@10 -- # set +x 00:14:23.228 03:09:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.228 03:09:25 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:23.228 03:09:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:23.228 03:09:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.228 03:09:25 -- common/autotest_common.sh@10 -- # set +x 00:14:23.485 03:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:23.485 03:09:26 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:23.485 03:09:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:23.485 03:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:23.485 03:09:26 -- common/autotest_common.sh@10 -- # set +x 00:14:24.060 03:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.060 03:09:26 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:24.060 03:09:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:24.060 03:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.060 03:09:26 -- common/autotest_common.sh@10 -- # set +x 00:14:24.317 03:09:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.317 03:09:26 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:24.317 03:09:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:24.317 03:09:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.317 03:09:26 -- common/autotest_common.sh@10 -- # set +x 00:14:24.575 03:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.575 03:09:27 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:24.575 03:09:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:24.575 03:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.575 03:09:27 -- common/autotest_common.sh@10 -- # set +x 00:14:24.832 03:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:24.832 03:09:27 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:24.832 03:09:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:24.832 03:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:24.832 03:09:27 -- common/autotest_common.sh@10 -- # set +x 00:14:25.090 03:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.090 03:09:27 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:25.090 03:09:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:25.090 03:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.090 03:09:27 -- common/autotest_common.sh@10 -- # set +x 00:14:25.655 03:09:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.655 03:09:27 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:25.655 03:09:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:25.655 03:09:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.655 03:09:27 -- common/autotest_common.sh@10 -- # set +x 00:14:25.913 03:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:25.913 03:09:28 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:25.913 03:09:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:25.913 03:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:25.913 03:09:28 -- common/autotest_common.sh@10 -- # set +x 00:14:26.170 03:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.170 03:09:28 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:26.170 03:09:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:26.170 03:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.170 03:09:28 -- common/autotest_common.sh@10 -- # set +x 00:14:26.428 03:09:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.428 03:09:28 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:26.428 03:09:28 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:26.428 03:09:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.428 03:09:28 -- common/autotest_common.sh@10 -- # set +x 00:14:26.696 03:09:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:26.696 03:09:29 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:26.696 03:09:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:26.696 03:09:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:26.696 03:09:29 -- common/autotest_common.sh@10 -- # set +x 00:14:27.265 03:09:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.265 03:09:29 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:27.265 03:09:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.265 03:09:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.265 03:09:29 -- common/autotest_common.sh@10 -- # set +x 00:14:27.524 03:09:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.524 03:09:29 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:27.524 03:09:29 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.524 03:09:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.524 03:09:29 -- common/autotest_common.sh@10 -- # set +x 00:14:27.781 03:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:27.781 03:09:30 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:27.781 03:09:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:27.781 03:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:27.781 03:09:30 -- common/autotest_common.sh@10 -- # set +x 00:14:28.039 03:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.039 03:09:30 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:28.039 03:09:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.039 03:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.039 03:09:30 -- common/autotest_common.sh@10 -- # set +x 00:14:28.296 03:09:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.296 03:09:30 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:28.296 03:09:30 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.296 03:09:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.296 03:09:30 -- common/autotest_common.sh@10 -- # set +x 00:14:28.861 03:09:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:28.861 03:09:31 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:28.861 03:09:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:28.861 03:09:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:28.861 03:09:31 -- common/autotest_common.sh@10 -- # set +x 00:14:29.119 03:09:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.119 03:09:31 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:29.119 03:09:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.119 03:09:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.119 03:09:31 -- common/autotest_common.sh@10 -- # set +x 00:14:29.377 03:09:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.377 03:09:31 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:29.377 03:09:31 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.377 03:09:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.377 03:09:31 -- common/autotest_common.sh@10 -- # set +x 00:14:29.634 03:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.634 03:09:32 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:29.634 03:09:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.634 03:09:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.634 03:09:32 -- common/autotest_common.sh@10 -- # set +x 00:14:29.892 03:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:29.892 03:09:32 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:29.892 03:09:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:29.892 03:09:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:29.892 03:09:32 -- common/autotest_common.sh@10 -- # set +x 00:14:30.457 03:09:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:30.457 03:09:32 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:30.457 03:09:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.457 03:09:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:30.457 03:09:32 -- common/autotest_common.sh@10 -- # set +x 00:14:30.715 03:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:30.715 03:09:33 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:30.715 03:09:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.715 03:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:30.715 03:09:33 -- common/autotest_common.sh@10 -- # set +x 00:14:30.973 03:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:30.973 03:09:33 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:30.973 03:09:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:30.973 03:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:30.973 03:09:33 -- common/autotest_common.sh@10 -- # set +x 00:14:31.230 03:09:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.230 03:09:33 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:31.230 03:09:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.230 03:09:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.230 03:09:33 -- common/autotest_common.sh@10 -- # set +x 00:14:31.489 03:09:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:31.489 03:09:34 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:31.489 03:09:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:31.489 03:09:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:31.489 03:09:34 -- common/autotest_common.sh@10 -- # set +x 00:14:32.054 03:09:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.054 03:09:34 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:32.054 03:09:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.054 03:09:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.054 03:09:34 -- common/autotest_common.sh@10 -- # set +x 00:14:32.312 03:09:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.312 03:09:34 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:32.312 03:09:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.312 03:09:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.312 03:09:34 -- common/autotest_common.sh@10 -- # set +x 00:14:32.570 03:09:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.570 03:09:35 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:32.570 03:09:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.570 03:09:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.570 03:09:35 -- common/autotest_common.sh@10 -- # set +x 00:14:32.828 03:09:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:32.828 03:09:35 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:32.828 03:09:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:32.828 03:09:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:32.828 03:09:35 -- common/autotest_common.sh@10 -- # set +x 00:14:33.086 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:33.086 03:09:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.086 03:09:35 -- target/connect_stress.sh@34 -- # kill -0 2418035 00:14:33.086 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2418035) - No such process 00:14:33.086 03:09:35 -- target/connect_stress.sh@38 -- # wait 2418035 00:14:33.086 03:09:35 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:33.086 03:09:35 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:33.086 03:09:35 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:33.087 03:09:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:33.087 03:09:35 -- nvmf/common.sh@116 -- # sync 00:14:33.087 03:09:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:33.087 03:09:35 -- nvmf/common.sh@119 -- # set +e 00:14:33.087 03:09:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:33.087 03:09:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:33.087 rmmod nvme_tcp 00:14:33.344 rmmod nvme_fabrics 00:14:33.344 rmmod nvme_keyring 00:14:33.344 03:09:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:33.344 03:09:35 -- nvmf/common.sh@123 -- # set -e 00:14:33.345 03:09:35 -- nvmf/common.sh@124 -- # return 0 00:14:33.345 03:09:35 -- nvmf/common.sh@477 -- # '[' -n 2417876 ']' 00:14:33.345 03:09:35 -- nvmf/common.sh@478 -- # killprocess 2417876 00:14:33.345 03:09:35 -- common/autotest_common.sh@936 -- # '[' -z 2417876 ']' 00:14:33.345 03:09:35 -- common/autotest_common.sh@940 -- # kill -0 2417876 00:14:33.345 03:09:35 -- common/autotest_common.sh@941 -- # uname 00:14:33.345 03:09:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:33.345 03:09:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2417876 00:14:33.345 03:09:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:33.345 03:09:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:33.345 03:09:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2417876' 00:14:33.345 killing process with pid 2417876 00:14:33.345 03:09:35 -- common/autotest_common.sh@955 -- # kill 2417876 00:14:33.345 03:09:35 -- common/autotest_common.sh@960 -- # wait 2417876 00:14:33.603 03:09:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:33.603 03:09:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:33.603 03:09:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:33.603 03:09:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:33.603 03:09:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:33.603 03:09:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:33.603 03:09:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:33.604 03:09:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:35.508 03:09:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:35.508 00:14:35.508 real 0m16.206s 00:14:35.508 user 0m40.953s 00:14:35.508 sys 0m5.795s 00:14:35.508 03:09:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:35.508 03:09:38 -- common/autotest_common.sh@10 -- # set +x 00:14:35.508 ************************************ 00:14:35.508 END TEST nvmf_connect_stress 00:14:35.508 ************************************ 00:14:35.508 03:09:38 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:35.508 03:09:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:35.508 03:09:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:35.508 03:09:38 -- common/autotest_common.sh@10 -- # set +x 00:14:35.508 ************************************ 00:14:35.508 START TEST nvmf_fused_ordering 00:14:35.508 ************************************ 00:14:35.508 03:09:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:35.767 * Looking for test storage... 00:14:35.767 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:35.767 03:09:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:35.767 03:09:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:35.767 03:09:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:35.767 03:09:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:35.767 03:09:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:35.767 03:09:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:35.767 03:09:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:35.767 03:09:38 -- scripts/common.sh@335 -- # IFS=.-: 00:14:35.767 03:09:38 -- scripts/common.sh@335 -- # read -ra ver1 00:14:35.767 03:09:38 -- scripts/common.sh@336 -- # IFS=.-: 00:14:35.767 03:09:38 -- scripts/common.sh@336 -- # read -ra ver2 00:14:35.767 03:09:38 -- scripts/common.sh@337 -- # local 'op=<' 00:14:35.767 03:09:38 -- scripts/common.sh@339 -- # ver1_l=2 00:14:35.767 03:09:38 -- scripts/common.sh@340 -- # ver2_l=1 00:14:35.767 03:09:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:35.767 03:09:38 -- scripts/common.sh@343 -- # case "$op" in 00:14:35.767 03:09:38 -- scripts/common.sh@344 -- # : 1 00:14:35.767 03:09:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:35.767 03:09:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:35.767 03:09:38 -- scripts/common.sh@364 -- # decimal 1 00:14:35.767 03:09:38 -- scripts/common.sh@352 -- # local d=1 00:14:35.767 03:09:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:35.767 03:09:38 -- scripts/common.sh@354 -- # echo 1 00:14:35.767 03:09:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:35.767 03:09:38 -- scripts/common.sh@365 -- # decimal 2 00:14:35.767 03:09:38 -- scripts/common.sh@352 -- # local d=2 00:14:35.767 03:09:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:35.767 03:09:38 -- scripts/common.sh@354 -- # echo 2 00:14:35.767 03:09:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:35.767 03:09:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:35.767 03:09:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:35.767 03:09:38 -- scripts/common.sh@367 -- # return 0 00:14:35.767 03:09:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:35.767 03:09:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:35.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.767 --rc genhtml_branch_coverage=1 00:14:35.767 --rc genhtml_function_coverage=1 00:14:35.767 --rc genhtml_legend=1 00:14:35.767 --rc geninfo_all_blocks=1 00:14:35.767 --rc geninfo_unexecuted_blocks=1 00:14:35.767 00:14:35.767 ' 00:14:35.767 03:09:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:35.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.767 --rc genhtml_branch_coverage=1 00:14:35.767 --rc genhtml_function_coverage=1 00:14:35.767 --rc genhtml_legend=1 00:14:35.767 --rc geninfo_all_blocks=1 00:14:35.767 --rc geninfo_unexecuted_blocks=1 00:14:35.767 00:14:35.767 ' 00:14:35.767 03:09:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:35.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.767 --rc genhtml_branch_coverage=1 00:14:35.767 --rc genhtml_function_coverage=1 00:14:35.767 --rc genhtml_legend=1 00:14:35.767 --rc geninfo_all_blocks=1 00:14:35.767 --rc geninfo_unexecuted_blocks=1 00:14:35.767 00:14:35.767 ' 00:14:35.767 03:09:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:35.767 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:35.767 --rc genhtml_branch_coverage=1 00:14:35.767 --rc genhtml_function_coverage=1 00:14:35.767 --rc genhtml_legend=1 00:14:35.767 --rc geninfo_all_blocks=1 00:14:35.767 --rc geninfo_unexecuted_blocks=1 00:14:35.767 00:14:35.767 ' 00:14:35.767 03:09:38 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:35.767 03:09:38 -- nvmf/common.sh@7 -- # uname -s 00:14:35.767 03:09:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:35.767 03:09:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:35.767 03:09:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:35.767 03:09:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:35.767 03:09:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:35.767 03:09:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:35.767 03:09:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:35.767 03:09:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:35.767 03:09:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:35.767 03:09:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:35.767 03:09:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:35.767 03:09:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:35.767 03:09:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:35.767 03:09:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:35.767 03:09:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:35.767 03:09:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:35.767 03:09:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:35.767 03:09:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:35.767 03:09:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:35.767 03:09:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.767 03:09:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.767 03:09:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.767 03:09:38 -- paths/export.sh@5 -- # export PATH 00:14:35.767 03:09:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:35.768 03:09:38 -- nvmf/common.sh@46 -- # : 0 00:14:35.768 03:09:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:35.768 03:09:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:35.768 03:09:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:35.768 03:09:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:35.768 03:09:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:35.768 03:09:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:35.768 03:09:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:35.768 03:09:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:35.768 03:09:38 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:35.768 03:09:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:35.768 03:09:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:35.768 03:09:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:35.768 03:09:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:35.768 03:09:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:35.768 03:09:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:35.768 03:09:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:35.768 03:09:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:35.768 03:09:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:35.768 03:09:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:35.768 03:09:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:35.768 03:09:38 -- common/autotest_common.sh@10 -- # set +x 00:14:37.690 03:09:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:37.690 03:09:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:37.690 03:09:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:37.690 03:09:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:37.690 03:09:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:37.690 03:09:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:37.690 03:09:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:37.690 03:09:40 -- nvmf/common.sh@294 -- # net_devs=() 00:14:37.690 03:09:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:37.690 03:09:40 -- nvmf/common.sh@295 -- # e810=() 00:14:37.690 03:09:40 -- nvmf/common.sh@295 -- # local -ga e810 00:14:37.690 03:09:40 -- nvmf/common.sh@296 -- # x722=() 00:14:37.690 03:09:40 -- nvmf/common.sh@296 -- # local -ga x722 00:14:37.690 03:09:40 -- nvmf/common.sh@297 -- # mlx=() 00:14:37.690 03:09:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:37.690 03:09:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:37.690 03:09:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:37.690 03:09:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:37.690 03:09:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:37.690 03:09:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:37.690 03:09:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:37.690 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:37.690 03:09:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:37.690 03:09:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:37.690 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:37.690 03:09:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:37.690 03:09:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:37.690 03:09:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:37.690 03:09:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:37.690 03:09:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:37.690 03:09:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:37.949 03:09:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:37.949 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:37.949 03:09:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:37.949 03:09:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:37.949 03:09:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:37.949 03:09:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:37.949 03:09:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:37.949 03:09:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:37.949 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:37.949 03:09:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:37.949 03:09:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:37.949 03:09:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:37.949 03:09:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:37.949 03:09:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:37.949 03:09:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:37.949 03:09:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:37.949 03:09:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:37.949 03:09:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:37.949 03:09:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:37.949 03:09:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:37.949 03:09:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:37.949 03:09:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:37.949 03:09:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:37.949 03:09:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:37.949 03:09:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:37.949 03:09:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:37.949 03:09:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:37.949 03:09:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:37.949 03:09:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:37.949 03:09:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:37.949 03:09:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:37.949 03:09:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:37.949 03:09:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:37.949 03:09:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:37.949 03:09:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:37.949 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:37.949 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.269 ms 00:14:37.949 00:14:37.949 --- 10.0.0.2 ping statistics --- 00:14:37.949 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:37.949 rtt min/avg/max/mdev = 0.269/0.269/0.269/0.000 ms 00:14:37.949 03:09:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:37.949 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:37.949 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:14:37.949 00:14:37.949 --- 10.0.0.1 ping statistics --- 00:14:37.949 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:37.949 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:14:37.949 03:09:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:37.949 03:09:40 -- nvmf/common.sh@410 -- # return 0 00:14:37.949 03:09:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:37.949 03:09:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:37.949 03:09:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:37.949 03:09:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:37.949 03:09:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:37.949 03:09:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:37.949 03:09:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:37.949 03:09:40 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:37.949 03:09:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:37.949 03:09:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:37.949 03:09:40 -- common/autotest_common.sh@10 -- # set +x 00:14:37.949 03:09:40 -- nvmf/common.sh@469 -- # nvmfpid=2421237 00:14:37.949 03:09:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:37.949 03:09:40 -- nvmf/common.sh@470 -- # waitforlisten 2421237 00:14:37.949 03:09:40 -- common/autotest_common.sh@829 -- # '[' -z 2421237 ']' 00:14:37.949 03:09:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:37.949 03:09:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:37.949 03:09:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:37.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:37.949 03:09:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:37.949 03:09:40 -- common/autotest_common.sh@10 -- # set +x 00:14:37.949 [2024-11-27 03:09:40.501668] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:37.949 [2024-11-27 03:09:40.501742] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:37.950 EAL: No free 2048 kB hugepages reported on node 1 00:14:38.209 [2024-11-27 03:09:40.573071] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:38.209 [2024-11-27 03:09:40.661144] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:38.209 [2024-11-27 03:09:40.661317] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:38.209 [2024-11-27 03:09:40.661336] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:38.209 [2024-11-27 03:09:40.661350] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:38.209 [2024-11-27 03:09:40.661389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:39.145 03:09:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:39.145 03:09:41 -- common/autotest_common.sh@862 -- # return 0 00:14:39.145 03:09:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:39.145 03:09:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:39.145 03:09:41 -- common/autotest_common.sh@10 -- # set +x 00:14:39.145 03:09:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:39.145 03:09:41 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:39.145 03:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.145 03:09:41 -- common/autotest_common.sh@10 -- # set +x 00:14:39.145 [2024-11-27 03:09:41.492366] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:39.145 03:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.145 03:09:41 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:39.145 03:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.145 03:09:41 -- common/autotest_common.sh@10 -- # set +x 00:14:39.145 03:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.145 03:09:41 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:39.145 03:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.145 03:09:41 -- common/autotest_common.sh@10 -- # set +x 00:14:39.145 [2024-11-27 03:09:41.508541] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:39.145 03:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.145 03:09:41 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:39.145 03:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.146 03:09:41 -- common/autotest_common.sh@10 -- # set +x 00:14:39.146 NULL1 00:14:39.146 03:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.146 03:09:41 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:39.146 03:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.146 03:09:41 -- common/autotest_common.sh@10 -- # set +x 00:14:39.146 03:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.146 03:09:41 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:39.146 03:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:39.146 03:09:41 -- common/autotest_common.sh@10 -- # set +x 00:14:39.146 03:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:39.146 03:09:41 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:39.146 [2024-11-27 03:09:41.552965] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:39.146 [2024-11-27 03:09:41.553005] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2421391 ] 00:14:39.146 EAL: No free 2048 kB hugepages reported on node 1 00:14:39.404 Attached to nqn.2016-06.io.spdk:cnode1 00:14:39.404 Namespace ID: 1 size: 1GB 00:14:39.404 fused_ordering(0) 00:14:39.404 fused_ordering(1) 00:14:39.404 fused_ordering(2) 00:14:39.404 fused_ordering(3) 00:14:39.404 fused_ordering(4) 00:14:39.404 fused_ordering(5) 00:14:39.404 fused_ordering(6) 00:14:39.404 fused_ordering(7) 00:14:39.404 fused_ordering(8) 00:14:39.404 fused_ordering(9) 00:14:39.404 fused_ordering(10) 00:14:39.404 fused_ordering(11) 00:14:39.404 fused_ordering(12) 00:14:39.404 fused_ordering(13) 00:14:39.404 fused_ordering(14) 00:14:39.404 fused_ordering(15) 00:14:39.404 fused_ordering(16) 00:14:39.404 fused_ordering(17) 00:14:39.404 fused_ordering(18) 00:14:39.404 fused_ordering(19) 00:14:39.404 fused_ordering(20) 00:14:39.404 fused_ordering(21) 00:14:39.404 fused_ordering(22) 00:14:39.404 fused_ordering(23) 00:14:39.404 fused_ordering(24) 00:14:39.404 fused_ordering(25) 00:14:39.404 fused_ordering(26) 00:14:39.404 fused_ordering(27) 00:14:39.404 fused_ordering(28) 00:14:39.404 fused_ordering(29) 00:14:39.404 fused_ordering(30) 00:14:39.404 fused_ordering(31) 00:14:39.404 fused_ordering(32) 00:14:39.404 fused_ordering(33) 00:14:39.404 fused_ordering(34) 00:14:39.404 fused_ordering(35) 00:14:39.404 fused_ordering(36) 00:14:39.404 fused_ordering(37) 00:14:39.404 fused_ordering(38) 00:14:39.404 fused_ordering(39) 00:14:39.404 fused_ordering(40) 00:14:39.404 fused_ordering(41) 00:14:39.404 fused_ordering(42) 00:14:39.404 fused_ordering(43) 00:14:39.404 fused_ordering(44) 00:14:39.404 fused_ordering(45) 00:14:39.404 fused_ordering(46) 00:14:39.404 fused_ordering(47) 00:14:39.404 fused_ordering(48) 00:14:39.404 fused_ordering(49) 00:14:39.404 fused_ordering(50) 00:14:39.404 fused_ordering(51) 00:14:39.404 fused_ordering(52) 00:14:39.404 fused_ordering(53) 00:14:39.404 fused_ordering(54) 00:14:39.404 fused_ordering(55) 00:14:39.404 fused_ordering(56) 00:14:39.404 fused_ordering(57) 00:14:39.404 fused_ordering(58) 00:14:39.404 fused_ordering(59) 00:14:39.404 fused_ordering(60) 00:14:39.404 fused_ordering(61) 00:14:39.404 fused_ordering(62) 00:14:39.404 fused_ordering(63) 00:14:39.404 fused_ordering(64) 00:14:39.404 fused_ordering(65) 00:14:39.404 fused_ordering(66) 00:14:39.404 fused_ordering(67) 00:14:39.404 fused_ordering(68) 00:14:39.404 fused_ordering(69) 00:14:39.404 fused_ordering(70) 00:14:39.404 fused_ordering(71) 00:14:39.404 fused_ordering(72) 00:14:39.404 fused_ordering(73) 00:14:39.404 fused_ordering(74) 00:14:39.404 fused_ordering(75) 00:14:39.404 fused_ordering(76) 00:14:39.404 fused_ordering(77) 00:14:39.404 fused_ordering(78) 00:14:39.404 fused_ordering(79) 00:14:39.404 fused_ordering(80) 00:14:39.404 fused_ordering(81) 00:14:39.404 fused_ordering(82) 00:14:39.404 fused_ordering(83) 00:14:39.404 fused_ordering(84) 00:14:39.404 fused_ordering(85) 00:14:39.404 fused_ordering(86) 00:14:39.404 fused_ordering(87) 00:14:39.404 fused_ordering(88) 00:14:39.404 fused_ordering(89) 00:14:39.404 fused_ordering(90) 00:14:39.404 fused_ordering(91) 00:14:39.404 fused_ordering(92) 00:14:39.404 fused_ordering(93) 00:14:39.404 fused_ordering(94) 00:14:39.404 fused_ordering(95) 00:14:39.404 fused_ordering(96) 00:14:39.404 fused_ordering(97) 00:14:39.404 fused_ordering(98) 00:14:39.404 fused_ordering(99) 00:14:39.404 fused_ordering(100) 00:14:39.404 fused_ordering(101) 00:14:39.404 fused_ordering(102) 00:14:39.404 fused_ordering(103) 00:14:39.404 fused_ordering(104) 00:14:39.404 fused_ordering(105) 00:14:39.404 fused_ordering(106) 00:14:39.404 fused_ordering(107) 00:14:39.404 fused_ordering(108) 00:14:39.404 fused_ordering(109) 00:14:39.404 fused_ordering(110) 00:14:39.404 fused_ordering(111) 00:14:39.404 fused_ordering(112) 00:14:39.404 fused_ordering(113) 00:14:39.404 fused_ordering(114) 00:14:39.404 fused_ordering(115) 00:14:39.404 fused_ordering(116) 00:14:39.404 fused_ordering(117) 00:14:39.404 fused_ordering(118) 00:14:39.404 fused_ordering(119) 00:14:39.404 fused_ordering(120) 00:14:39.404 fused_ordering(121) 00:14:39.404 fused_ordering(122) 00:14:39.404 fused_ordering(123) 00:14:39.404 fused_ordering(124) 00:14:39.404 fused_ordering(125) 00:14:39.404 fused_ordering(126) 00:14:39.404 fused_ordering(127) 00:14:39.404 fused_ordering(128) 00:14:39.404 fused_ordering(129) 00:14:39.404 fused_ordering(130) 00:14:39.404 fused_ordering(131) 00:14:39.404 fused_ordering(132) 00:14:39.404 fused_ordering(133) 00:14:39.404 fused_ordering(134) 00:14:39.404 fused_ordering(135) 00:14:39.404 fused_ordering(136) 00:14:39.404 fused_ordering(137) 00:14:39.404 fused_ordering(138) 00:14:39.404 fused_ordering(139) 00:14:39.404 fused_ordering(140) 00:14:39.404 fused_ordering(141) 00:14:39.404 fused_ordering(142) 00:14:39.404 fused_ordering(143) 00:14:39.404 fused_ordering(144) 00:14:39.404 fused_ordering(145) 00:14:39.404 fused_ordering(146) 00:14:39.404 fused_ordering(147) 00:14:39.404 fused_ordering(148) 00:14:39.404 fused_ordering(149) 00:14:39.404 fused_ordering(150) 00:14:39.404 fused_ordering(151) 00:14:39.404 fused_ordering(152) 00:14:39.404 fused_ordering(153) 00:14:39.404 fused_ordering(154) 00:14:39.404 fused_ordering(155) 00:14:39.404 fused_ordering(156) 00:14:39.404 fused_ordering(157) 00:14:39.404 fused_ordering(158) 00:14:39.404 fused_ordering(159) 00:14:39.404 fused_ordering(160) 00:14:39.404 fused_ordering(161) 00:14:39.404 fused_ordering(162) 00:14:39.404 fused_ordering(163) 00:14:39.404 fused_ordering(164) 00:14:39.404 fused_ordering(165) 00:14:39.404 fused_ordering(166) 00:14:39.404 fused_ordering(167) 00:14:39.404 fused_ordering(168) 00:14:39.404 fused_ordering(169) 00:14:39.404 fused_ordering(170) 00:14:39.404 fused_ordering(171) 00:14:39.404 fused_ordering(172) 00:14:39.404 fused_ordering(173) 00:14:39.404 fused_ordering(174) 00:14:39.404 fused_ordering(175) 00:14:39.404 fused_ordering(176) 00:14:39.404 fused_ordering(177) 00:14:39.404 fused_ordering(178) 00:14:39.404 fused_ordering(179) 00:14:39.404 fused_ordering(180) 00:14:39.404 fused_ordering(181) 00:14:39.405 fused_ordering(182) 00:14:39.405 fused_ordering(183) 00:14:39.405 fused_ordering(184) 00:14:39.405 fused_ordering(185) 00:14:39.405 fused_ordering(186) 00:14:39.405 fused_ordering(187) 00:14:39.405 fused_ordering(188) 00:14:39.405 fused_ordering(189) 00:14:39.405 fused_ordering(190) 00:14:39.405 fused_ordering(191) 00:14:39.405 fused_ordering(192) 00:14:39.405 fused_ordering(193) 00:14:39.405 fused_ordering(194) 00:14:39.405 fused_ordering(195) 00:14:39.405 fused_ordering(196) 00:14:39.405 fused_ordering(197) 00:14:39.405 fused_ordering(198) 00:14:39.405 fused_ordering(199) 00:14:39.405 fused_ordering(200) 00:14:39.405 fused_ordering(201) 00:14:39.405 fused_ordering(202) 00:14:39.405 fused_ordering(203) 00:14:39.405 fused_ordering(204) 00:14:39.405 fused_ordering(205) 00:14:39.969 fused_ordering(206) 00:14:39.969 fused_ordering(207) 00:14:39.969 fused_ordering(208) 00:14:39.969 fused_ordering(209) 00:14:39.969 fused_ordering(210) 00:14:39.969 fused_ordering(211) 00:14:39.969 fused_ordering(212) 00:14:39.969 fused_ordering(213) 00:14:39.969 fused_ordering(214) 00:14:39.969 fused_ordering(215) 00:14:39.969 fused_ordering(216) 00:14:39.969 fused_ordering(217) 00:14:39.969 fused_ordering(218) 00:14:39.969 fused_ordering(219) 00:14:39.969 fused_ordering(220) 00:14:39.969 fused_ordering(221) 00:14:39.969 fused_ordering(222) 00:14:39.969 fused_ordering(223) 00:14:39.969 fused_ordering(224) 00:14:39.970 fused_ordering(225) 00:14:39.970 fused_ordering(226) 00:14:39.970 fused_ordering(227) 00:14:39.970 fused_ordering(228) 00:14:39.970 fused_ordering(229) 00:14:39.970 fused_ordering(230) 00:14:39.970 fused_ordering(231) 00:14:39.970 fused_ordering(232) 00:14:39.970 fused_ordering(233) 00:14:39.970 fused_ordering(234) 00:14:39.970 fused_ordering(235) 00:14:39.970 fused_ordering(236) 00:14:39.970 fused_ordering(237) 00:14:39.970 fused_ordering(238) 00:14:39.970 fused_ordering(239) 00:14:39.970 fused_ordering(240) 00:14:39.970 fused_ordering(241) 00:14:39.970 fused_ordering(242) 00:14:39.970 fused_ordering(243) 00:14:39.970 fused_ordering(244) 00:14:39.970 fused_ordering(245) 00:14:39.970 fused_ordering(246) 00:14:39.970 fused_ordering(247) 00:14:39.970 fused_ordering(248) 00:14:39.970 fused_ordering(249) 00:14:39.970 fused_ordering(250) 00:14:39.970 fused_ordering(251) 00:14:39.970 fused_ordering(252) 00:14:39.970 fused_ordering(253) 00:14:39.970 fused_ordering(254) 00:14:39.970 fused_ordering(255) 00:14:39.970 fused_ordering(256) 00:14:39.970 fused_ordering(257) 00:14:39.970 fused_ordering(258) 00:14:39.970 fused_ordering(259) 00:14:39.970 fused_ordering(260) 00:14:39.970 fused_ordering(261) 00:14:39.970 fused_ordering(262) 00:14:39.970 fused_ordering(263) 00:14:39.970 fused_ordering(264) 00:14:39.970 fused_ordering(265) 00:14:39.970 fused_ordering(266) 00:14:39.970 fused_ordering(267) 00:14:39.970 fused_ordering(268) 00:14:39.970 fused_ordering(269) 00:14:39.970 fused_ordering(270) 00:14:39.970 fused_ordering(271) 00:14:39.970 fused_ordering(272) 00:14:39.970 fused_ordering(273) 00:14:39.970 fused_ordering(274) 00:14:39.970 fused_ordering(275) 00:14:39.970 fused_ordering(276) 00:14:39.970 fused_ordering(277) 00:14:39.970 fused_ordering(278) 00:14:39.970 fused_ordering(279) 00:14:39.970 fused_ordering(280) 00:14:39.970 fused_ordering(281) 00:14:39.970 fused_ordering(282) 00:14:39.970 fused_ordering(283) 00:14:39.970 fused_ordering(284) 00:14:39.970 fused_ordering(285) 00:14:39.970 fused_ordering(286) 00:14:39.970 fused_ordering(287) 00:14:39.970 fused_ordering(288) 00:14:39.970 fused_ordering(289) 00:14:39.970 fused_ordering(290) 00:14:39.970 fused_ordering(291) 00:14:39.970 fused_ordering(292) 00:14:39.970 fused_ordering(293) 00:14:39.970 fused_ordering(294) 00:14:39.970 fused_ordering(295) 00:14:39.970 fused_ordering(296) 00:14:39.970 fused_ordering(297) 00:14:39.970 fused_ordering(298) 00:14:39.970 fused_ordering(299) 00:14:39.970 fused_ordering(300) 00:14:39.970 fused_ordering(301) 00:14:39.970 fused_ordering(302) 00:14:39.970 fused_ordering(303) 00:14:39.970 fused_ordering(304) 00:14:39.970 fused_ordering(305) 00:14:39.970 fused_ordering(306) 00:14:39.970 fused_ordering(307) 00:14:39.970 fused_ordering(308) 00:14:39.970 fused_ordering(309) 00:14:39.970 fused_ordering(310) 00:14:39.970 fused_ordering(311) 00:14:39.970 fused_ordering(312) 00:14:39.970 fused_ordering(313) 00:14:39.970 fused_ordering(314) 00:14:39.970 fused_ordering(315) 00:14:39.970 fused_ordering(316) 00:14:39.970 fused_ordering(317) 00:14:39.970 fused_ordering(318) 00:14:39.970 fused_ordering(319) 00:14:39.970 fused_ordering(320) 00:14:39.970 fused_ordering(321) 00:14:39.970 fused_ordering(322) 00:14:39.970 fused_ordering(323) 00:14:39.970 fused_ordering(324) 00:14:39.970 fused_ordering(325) 00:14:39.970 fused_ordering(326) 00:14:39.970 fused_ordering(327) 00:14:39.970 fused_ordering(328) 00:14:39.970 fused_ordering(329) 00:14:39.970 fused_ordering(330) 00:14:39.970 fused_ordering(331) 00:14:39.970 fused_ordering(332) 00:14:39.970 fused_ordering(333) 00:14:39.970 fused_ordering(334) 00:14:39.970 fused_ordering(335) 00:14:39.970 fused_ordering(336) 00:14:39.970 fused_ordering(337) 00:14:39.970 fused_ordering(338) 00:14:39.970 fused_ordering(339) 00:14:39.970 fused_ordering(340) 00:14:39.970 fused_ordering(341) 00:14:39.970 fused_ordering(342) 00:14:39.970 fused_ordering(343) 00:14:39.970 fused_ordering(344) 00:14:39.970 fused_ordering(345) 00:14:39.970 fused_ordering(346) 00:14:39.970 fused_ordering(347) 00:14:39.970 fused_ordering(348) 00:14:39.970 fused_ordering(349) 00:14:39.970 fused_ordering(350) 00:14:39.970 fused_ordering(351) 00:14:39.970 fused_ordering(352) 00:14:39.970 fused_ordering(353) 00:14:39.970 fused_ordering(354) 00:14:39.970 fused_ordering(355) 00:14:39.970 fused_ordering(356) 00:14:39.970 fused_ordering(357) 00:14:39.970 fused_ordering(358) 00:14:39.970 fused_ordering(359) 00:14:39.970 fused_ordering(360) 00:14:39.970 fused_ordering(361) 00:14:39.970 fused_ordering(362) 00:14:39.970 fused_ordering(363) 00:14:39.970 fused_ordering(364) 00:14:39.970 fused_ordering(365) 00:14:39.970 fused_ordering(366) 00:14:39.970 fused_ordering(367) 00:14:39.970 fused_ordering(368) 00:14:39.970 fused_ordering(369) 00:14:39.970 fused_ordering(370) 00:14:39.970 fused_ordering(371) 00:14:39.970 fused_ordering(372) 00:14:39.970 fused_ordering(373) 00:14:39.970 fused_ordering(374) 00:14:39.970 fused_ordering(375) 00:14:39.970 fused_ordering(376) 00:14:39.970 fused_ordering(377) 00:14:39.970 fused_ordering(378) 00:14:39.970 fused_ordering(379) 00:14:39.970 fused_ordering(380) 00:14:39.970 fused_ordering(381) 00:14:39.970 fused_ordering(382) 00:14:39.970 fused_ordering(383) 00:14:39.970 fused_ordering(384) 00:14:39.970 fused_ordering(385) 00:14:39.970 fused_ordering(386) 00:14:39.970 fused_ordering(387) 00:14:39.970 fused_ordering(388) 00:14:39.970 fused_ordering(389) 00:14:39.970 fused_ordering(390) 00:14:39.970 fused_ordering(391) 00:14:39.970 fused_ordering(392) 00:14:39.970 fused_ordering(393) 00:14:39.970 fused_ordering(394) 00:14:39.970 fused_ordering(395) 00:14:39.970 fused_ordering(396) 00:14:39.970 fused_ordering(397) 00:14:39.970 fused_ordering(398) 00:14:39.970 fused_ordering(399) 00:14:39.970 fused_ordering(400) 00:14:39.970 fused_ordering(401) 00:14:39.970 fused_ordering(402) 00:14:39.970 fused_ordering(403) 00:14:39.970 fused_ordering(404) 00:14:39.970 fused_ordering(405) 00:14:39.970 fused_ordering(406) 00:14:39.970 fused_ordering(407) 00:14:39.970 fused_ordering(408) 00:14:39.970 fused_ordering(409) 00:14:39.970 fused_ordering(410) 00:14:40.228 fused_ordering(411) 00:14:40.228 fused_ordering(412) 00:14:40.228 fused_ordering(413) 00:14:40.228 fused_ordering(414) 00:14:40.228 fused_ordering(415) 00:14:40.228 fused_ordering(416) 00:14:40.228 fused_ordering(417) 00:14:40.228 fused_ordering(418) 00:14:40.228 fused_ordering(419) 00:14:40.228 fused_ordering(420) 00:14:40.228 fused_ordering(421) 00:14:40.228 fused_ordering(422) 00:14:40.228 fused_ordering(423) 00:14:40.228 fused_ordering(424) 00:14:40.228 fused_ordering(425) 00:14:40.228 fused_ordering(426) 00:14:40.228 fused_ordering(427) 00:14:40.228 fused_ordering(428) 00:14:40.228 fused_ordering(429) 00:14:40.228 fused_ordering(430) 00:14:40.228 fused_ordering(431) 00:14:40.228 fused_ordering(432) 00:14:40.228 fused_ordering(433) 00:14:40.228 fused_ordering(434) 00:14:40.228 fused_ordering(435) 00:14:40.228 fused_ordering(436) 00:14:40.228 fused_ordering(437) 00:14:40.228 fused_ordering(438) 00:14:40.228 fused_ordering(439) 00:14:40.228 fused_ordering(440) 00:14:40.228 fused_ordering(441) 00:14:40.228 fused_ordering(442) 00:14:40.228 fused_ordering(443) 00:14:40.228 fused_ordering(444) 00:14:40.228 fused_ordering(445) 00:14:40.228 fused_ordering(446) 00:14:40.228 fused_ordering(447) 00:14:40.228 fused_ordering(448) 00:14:40.228 fused_ordering(449) 00:14:40.228 fused_ordering(450) 00:14:40.228 fused_ordering(451) 00:14:40.228 fused_ordering(452) 00:14:40.228 fused_ordering(453) 00:14:40.228 fused_ordering(454) 00:14:40.228 fused_ordering(455) 00:14:40.228 fused_ordering(456) 00:14:40.228 fused_ordering(457) 00:14:40.228 fused_ordering(458) 00:14:40.228 fused_ordering(459) 00:14:40.228 fused_ordering(460) 00:14:40.228 fused_ordering(461) 00:14:40.228 fused_ordering(462) 00:14:40.228 fused_ordering(463) 00:14:40.228 fused_ordering(464) 00:14:40.228 fused_ordering(465) 00:14:40.228 fused_ordering(466) 00:14:40.228 fused_ordering(467) 00:14:40.228 fused_ordering(468) 00:14:40.228 fused_ordering(469) 00:14:40.228 fused_ordering(470) 00:14:40.228 fused_ordering(471) 00:14:40.228 fused_ordering(472) 00:14:40.228 fused_ordering(473) 00:14:40.228 fused_ordering(474) 00:14:40.228 fused_ordering(475) 00:14:40.228 fused_ordering(476) 00:14:40.228 fused_ordering(477) 00:14:40.228 fused_ordering(478) 00:14:40.228 fused_ordering(479) 00:14:40.228 fused_ordering(480) 00:14:40.228 fused_ordering(481) 00:14:40.228 fused_ordering(482) 00:14:40.229 fused_ordering(483) 00:14:40.229 fused_ordering(484) 00:14:40.229 fused_ordering(485) 00:14:40.229 fused_ordering(486) 00:14:40.229 fused_ordering(487) 00:14:40.229 fused_ordering(488) 00:14:40.229 fused_ordering(489) 00:14:40.229 fused_ordering(490) 00:14:40.229 fused_ordering(491) 00:14:40.229 fused_ordering(492) 00:14:40.229 fused_ordering(493) 00:14:40.229 fused_ordering(494) 00:14:40.229 fused_ordering(495) 00:14:40.229 fused_ordering(496) 00:14:40.229 fused_ordering(497) 00:14:40.229 fused_ordering(498) 00:14:40.229 fused_ordering(499) 00:14:40.229 fused_ordering(500) 00:14:40.229 fused_ordering(501) 00:14:40.229 fused_ordering(502) 00:14:40.229 fused_ordering(503) 00:14:40.229 fused_ordering(504) 00:14:40.229 fused_ordering(505) 00:14:40.229 fused_ordering(506) 00:14:40.229 fused_ordering(507) 00:14:40.229 fused_ordering(508) 00:14:40.229 fused_ordering(509) 00:14:40.229 fused_ordering(510) 00:14:40.229 fused_ordering(511) 00:14:40.229 fused_ordering(512) 00:14:40.229 fused_ordering(513) 00:14:40.229 fused_ordering(514) 00:14:40.229 fused_ordering(515) 00:14:40.229 fused_ordering(516) 00:14:40.229 fused_ordering(517) 00:14:40.229 fused_ordering(518) 00:14:40.229 fused_ordering(519) 00:14:40.229 fused_ordering(520) 00:14:40.229 fused_ordering(521) 00:14:40.229 fused_ordering(522) 00:14:40.229 fused_ordering(523) 00:14:40.229 fused_ordering(524) 00:14:40.229 fused_ordering(525) 00:14:40.229 fused_ordering(526) 00:14:40.229 fused_ordering(527) 00:14:40.229 fused_ordering(528) 00:14:40.229 fused_ordering(529) 00:14:40.229 fused_ordering(530) 00:14:40.229 fused_ordering(531) 00:14:40.229 fused_ordering(532) 00:14:40.229 fused_ordering(533) 00:14:40.229 fused_ordering(534) 00:14:40.229 fused_ordering(535) 00:14:40.229 fused_ordering(536) 00:14:40.229 fused_ordering(537) 00:14:40.229 fused_ordering(538) 00:14:40.229 fused_ordering(539) 00:14:40.229 fused_ordering(540) 00:14:40.229 fused_ordering(541) 00:14:40.229 fused_ordering(542) 00:14:40.229 fused_ordering(543) 00:14:40.229 fused_ordering(544) 00:14:40.229 fused_ordering(545) 00:14:40.229 fused_ordering(546) 00:14:40.229 fused_ordering(547) 00:14:40.229 fused_ordering(548) 00:14:40.229 fused_ordering(549) 00:14:40.229 fused_ordering(550) 00:14:40.229 fused_ordering(551) 00:14:40.229 fused_ordering(552) 00:14:40.229 fused_ordering(553) 00:14:40.229 fused_ordering(554) 00:14:40.229 fused_ordering(555) 00:14:40.229 fused_ordering(556) 00:14:40.229 fused_ordering(557) 00:14:40.229 fused_ordering(558) 00:14:40.229 fused_ordering(559) 00:14:40.229 fused_ordering(560) 00:14:40.229 fused_ordering(561) 00:14:40.229 fused_ordering(562) 00:14:40.229 fused_ordering(563) 00:14:40.229 fused_ordering(564) 00:14:40.229 fused_ordering(565) 00:14:40.229 fused_ordering(566) 00:14:40.229 fused_ordering(567) 00:14:40.229 fused_ordering(568) 00:14:40.229 fused_ordering(569) 00:14:40.229 fused_ordering(570) 00:14:40.229 fused_ordering(571) 00:14:40.229 fused_ordering(572) 00:14:40.229 fused_ordering(573) 00:14:40.229 fused_ordering(574) 00:14:40.229 fused_ordering(575) 00:14:40.229 fused_ordering(576) 00:14:40.229 fused_ordering(577) 00:14:40.229 fused_ordering(578) 00:14:40.229 fused_ordering(579) 00:14:40.229 fused_ordering(580) 00:14:40.229 fused_ordering(581) 00:14:40.229 fused_ordering(582) 00:14:40.229 fused_ordering(583) 00:14:40.229 fused_ordering(584) 00:14:40.229 fused_ordering(585) 00:14:40.229 fused_ordering(586) 00:14:40.229 fused_ordering(587) 00:14:40.229 fused_ordering(588) 00:14:40.229 fused_ordering(589) 00:14:40.229 fused_ordering(590) 00:14:40.229 fused_ordering(591) 00:14:40.229 fused_ordering(592) 00:14:40.229 fused_ordering(593) 00:14:40.229 fused_ordering(594) 00:14:40.229 fused_ordering(595) 00:14:40.229 fused_ordering(596) 00:14:40.229 fused_ordering(597) 00:14:40.229 fused_ordering(598) 00:14:40.229 fused_ordering(599) 00:14:40.229 fused_ordering(600) 00:14:40.229 fused_ordering(601) 00:14:40.229 fused_ordering(602) 00:14:40.229 fused_ordering(603) 00:14:40.229 fused_ordering(604) 00:14:40.229 fused_ordering(605) 00:14:40.229 fused_ordering(606) 00:14:40.229 fused_ordering(607) 00:14:40.229 fused_ordering(608) 00:14:40.229 fused_ordering(609) 00:14:40.229 fused_ordering(610) 00:14:40.229 fused_ordering(611) 00:14:40.229 fused_ordering(612) 00:14:40.229 fused_ordering(613) 00:14:40.229 fused_ordering(614) 00:14:40.229 fused_ordering(615) 00:14:40.795 fused_ordering(616) 00:14:40.795 fused_ordering(617) 00:14:40.795 fused_ordering(618) 00:14:40.795 fused_ordering(619) 00:14:40.795 fused_ordering(620) 00:14:40.795 fused_ordering(621) 00:14:40.795 fused_ordering(622) 00:14:40.795 fused_ordering(623) 00:14:40.795 fused_ordering(624) 00:14:40.795 fused_ordering(625) 00:14:40.795 fused_ordering(626) 00:14:40.795 fused_ordering(627) 00:14:40.795 fused_ordering(628) 00:14:40.795 fused_ordering(629) 00:14:40.795 fused_ordering(630) 00:14:40.795 fused_ordering(631) 00:14:40.795 fused_ordering(632) 00:14:40.795 fused_ordering(633) 00:14:40.795 fused_ordering(634) 00:14:40.795 fused_ordering(635) 00:14:40.795 fused_ordering(636) 00:14:40.795 fused_ordering(637) 00:14:40.795 fused_ordering(638) 00:14:40.795 fused_ordering(639) 00:14:40.795 fused_ordering(640) 00:14:40.795 fused_ordering(641) 00:14:40.795 fused_ordering(642) 00:14:40.795 fused_ordering(643) 00:14:40.795 fused_ordering(644) 00:14:40.795 fused_ordering(645) 00:14:40.795 fused_ordering(646) 00:14:40.795 fused_ordering(647) 00:14:40.795 fused_ordering(648) 00:14:40.795 fused_ordering(649) 00:14:40.795 fused_ordering(650) 00:14:40.795 fused_ordering(651) 00:14:40.795 fused_ordering(652) 00:14:40.795 fused_ordering(653) 00:14:40.795 fused_ordering(654) 00:14:40.795 fused_ordering(655) 00:14:40.795 fused_ordering(656) 00:14:40.795 fused_ordering(657) 00:14:40.795 fused_ordering(658) 00:14:40.795 fused_ordering(659) 00:14:40.795 fused_ordering(660) 00:14:40.795 fused_ordering(661) 00:14:40.795 fused_ordering(662) 00:14:40.795 fused_ordering(663) 00:14:40.795 fused_ordering(664) 00:14:40.795 fused_ordering(665) 00:14:40.795 fused_ordering(666) 00:14:40.795 fused_ordering(667) 00:14:40.795 fused_ordering(668) 00:14:40.795 fused_ordering(669) 00:14:40.795 fused_ordering(670) 00:14:40.795 fused_ordering(671) 00:14:40.795 fused_ordering(672) 00:14:40.795 fused_ordering(673) 00:14:40.795 fused_ordering(674) 00:14:40.795 fused_ordering(675) 00:14:40.795 fused_ordering(676) 00:14:40.795 fused_ordering(677) 00:14:40.795 fused_ordering(678) 00:14:40.795 fused_ordering(679) 00:14:40.795 fused_ordering(680) 00:14:40.795 fused_ordering(681) 00:14:40.795 fused_ordering(682) 00:14:40.795 fused_ordering(683) 00:14:40.795 fused_ordering(684) 00:14:40.795 fused_ordering(685) 00:14:40.795 fused_ordering(686) 00:14:40.795 fused_ordering(687) 00:14:40.795 fused_ordering(688) 00:14:40.795 fused_ordering(689) 00:14:40.795 fused_ordering(690) 00:14:40.795 fused_ordering(691) 00:14:40.795 fused_ordering(692) 00:14:40.795 fused_ordering(693) 00:14:40.795 fused_ordering(694) 00:14:40.795 fused_ordering(695) 00:14:40.795 fused_ordering(696) 00:14:40.795 fused_ordering(697) 00:14:40.795 fused_ordering(698) 00:14:40.795 fused_ordering(699) 00:14:40.795 fused_ordering(700) 00:14:40.795 fused_ordering(701) 00:14:40.795 fused_ordering(702) 00:14:40.795 fused_ordering(703) 00:14:40.795 fused_ordering(704) 00:14:40.795 fused_ordering(705) 00:14:40.795 fused_ordering(706) 00:14:40.795 fused_ordering(707) 00:14:40.795 fused_ordering(708) 00:14:40.795 fused_ordering(709) 00:14:40.795 fused_ordering(710) 00:14:40.795 fused_ordering(711) 00:14:40.795 fused_ordering(712) 00:14:40.795 fused_ordering(713) 00:14:40.795 fused_ordering(714) 00:14:40.795 fused_ordering(715) 00:14:40.795 fused_ordering(716) 00:14:40.795 fused_ordering(717) 00:14:40.795 fused_ordering(718) 00:14:40.795 fused_ordering(719) 00:14:40.795 fused_ordering(720) 00:14:40.795 fused_ordering(721) 00:14:40.795 fused_ordering(722) 00:14:40.795 fused_ordering(723) 00:14:40.795 fused_ordering(724) 00:14:40.795 fused_ordering(725) 00:14:40.795 fused_ordering(726) 00:14:40.795 fused_ordering(727) 00:14:40.795 fused_ordering(728) 00:14:40.795 fused_ordering(729) 00:14:40.795 fused_ordering(730) 00:14:40.795 fused_ordering(731) 00:14:40.795 fused_ordering(732) 00:14:40.795 fused_ordering(733) 00:14:40.795 fused_ordering(734) 00:14:40.795 fused_ordering(735) 00:14:40.795 fused_ordering(736) 00:14:40.795 fused_ordering(737) 00:14:40.795 fused_ordering(738) 00:14:40.795 fused_ordering(739) 00:14:40.795 fused_ordering(740) 00:14:40.795 fused_ordering(741) 00:14:40.795 fused_ordering(742) 00:14:40.795 fused_ordering(743) 00:14:40.795 fused_ordering(744) 00:14:40.795 fused_ordering(745) 00:14:40.795 fused_ordering(746) 00:14:40.795 fused_ordering(747) 00:14:40.795 fused_ordering(748) 00:14:40.795 fused_ordering(749) 00:14:40.795 fused_ordering(750) 00:14:40.795 fused_ordering(751) 00:14:40.795 fused_ordering(752) 00:14:40.795 fused_ordering(753) 00:14:40.795 fused_ordering(754) 00:14:40.795 fused_ordering(755) 00:14:40.795 fused_ordering(756) 00:14:40.795 fused_ordering(757) 00:14:40.795 fused_ordering(758) 00:14:40.795 fused_ordering(759) 00:14:40.795 fused_ordering(760) 00:14:40.795 fused_ordering(761) 00:14:40.795 fused_ordering(762) 00:14:40.795 fused_ordering(763) 00:14:40.795 fused_ordering(764) 00:14:40.795 fused_ordering(765) 00:14:40.795 fused_ordering(766) 00:14:40.795 fused_ordering(767) 00:14:40.795 fused_ordering(768) 00:14:40.795 fused_ordering(769) 00:14:40.795 fused_ordering(770) 00:14:40.795 fused_ordering(771) 00:14:40.795 fused_ordering(772) 00:14:40.795 fused_ordering(773) 00:14:40.795 fused_ordering(774) 00:14:40.795 fused_ordering(775) 00:14:40.795 fused_ordering(776) 00:14:40.795 fused_ordering(777) 00:14:40.795 fused_ordering(778) 00:14:40.795 fused_ordering(779) 00:14:40.795 fused_ordering(780) 00:14:40.795 fused_ordering(781) 00:14:40.795 fused_ordering(782) 00:14:40.795 fused_ordering(783) 00:14:40.795 fused_ordering(784) 00:14:40.795 fused_ordering(785) 00:14:40.795 fused_ordering(786) 00:14:40.795 fused_ordering(787) 00:14:40.795 fused_ordering(788) 00:14:40.795 fused_ordering(789) 00:14:40.795 fused_ordering(790) 00:14:40.795 fused_ordering(791) 00:14:40.795 fused_ordering(792) 00:14:40.795 fused_ordering(793) 00:14:40.795 fused_ordering(794) 00:14:40.795 fused_ordering(795) 00:14:40.795 fused_ordering(796) 00:14:40.795 fused_ordering(797) 00:14:40.795 fused_ordering(798) 00:14:40.795 fused_ordering(799) 00:14:40.795 fused_ordering(800) 00:14:40.795 fused_ordering(801) 00:14:40.795 fused_ordering(802) 00:14:40.795 fused_ordering(803) 00:14:40.795 fused_ordering(804) 00:14:40.795 fused_ordering(805) 00:14:40.795 fused_ordering(806) 00:14:40.795 fused_ordering(807) 00:14:40.795 fused_ordering(808) 00:14:40.795 fused_ordering(809) 00:14:40.795 fused_ordering(810) 00:14:40.795 fused_ordering(811) 00:14:40.795 fused_ordering(812) 00:14:40.795 fused_ordering(813) 00:14:40.795 fused_ordering(814) 00:14:40.795 fused_ordering(815) 00:14:40.795 fused_ordering(816) 00:14:40.795 fused_ordering(817) 00:14:40.795 fused_ordering(818) 00:14:40.795 fused_ordering(819) 00:14:40.795 fused_ordering(820) 00:14:41.729 fused_ordering(821) 00:14:41.729 fused_ordering(822) 00:14:41.729 fused_ordering(823) 00:14:41.729 fused_ordering(824) 00:14:41.729 fused_ordering(825) 00:14:41.729 fused_ordering(826) 00:14:41.729 fused_ordering(827) 00:14:41.729 fused_ordering(828) 00:14:41.729 fused_ordering(829) 00:14:41.729 fused_ordering(830) 00:14:41.729 fused_ordering(831) 00:14:41.729 fused_ordering(832) 00:14:41.729 fused_ordering(833) 00:14:41.729 fused_ordering(834) 00:14:41.729 fused_ordering(835) 00:14:41.729 fused_ordering(836) 00:14:41.729 fused_ordering(837) 00:14:41.729 fused_ordering(838) 00:14:41.729 fused_ordering(839) 00:14:41.729 fused_ordering(840) 00:14:41.729 fused_ordering(841) 00:14:41.729 fused_ordering(842) 00:14:41.729 fused_ordering(843) 00:14:41.729 fused_ordering(844) 00:14:41.729 fused_ordering(845) 00:14:41.729 fused_ordering(846) 00:14:41.729 fused_ordering(847) 00:14:41.729 fused_ordering(848) 00:14:41.729 fused_ordering(849) 00:14:41.729 fused_ordering(850) 00:14:41.729 fused_ordering(851) 00:14:41.729 fused_ordering(852) 00:14:41.729 fused_ordering(853) 00:14:41.729 fused_ordering(854) 00:14:41.729 fused_ordering(855) 00:14:41.729 fused_ordering(856) 00:14:41.729 fused_ordering(857) 00:14:41.729 fused_ordering(858) 00:14:41.729 fused_ordering(859) 00:14:41.729 fused_ordering(860) 00:14:41.729 fused_ordering(861) 00:14:41.729 fused_ordering(862) 00:14:41.729 fused_ordering(863) 00:14:41.729 fused_ordering(864) 00:14:41.729 fused_ordering(865) 00:14:41.729 fused_ordering(866) 00:14:41.729 fused_ordering(867) 00:14:41.729 fused_ordering(868) 00:14:41.729 fused_ordering(869) 00:14:41.729 fused_ordering(870) 00:14:41.729 fused_ordering(871) 00:14:41.729 fused_ordering(872) 00:14:41.729 fused_ordering(873) 00:14:41.729 fused_ordering(874) 00:14:41.729 fused_ordering(875) 00:14:41.729 fused_ordering(876) 00:14:41.729 fused_ordering(877) 00:14:41.729 fused_ordering(878) 00:14:41.729 fused_ordering(879) 00:14:41.729 fused_ordering(880) 00:14:41.729 fused_ordering(881) 00:14:41.729 fused_ordering(882) 00:14:41.729 fused_ordering(883) 00:14:41.729 fused_ordering(884) 00:14:41.729 fused_ordering(885) 00:14:41.729 fused_ordering(886) 00:14:41.729 fused_ordering(887) 00:14:41.729 fused_ordering(888) 00:14:41.729 fused_ordering(889) 00:14:41.729 fused_ordering(890) 00:14:41.729 fused_ordering(891) 00:14:41.729 fused_ordering(892) 00:14:41.729 fused_ordering(893) 00:14:41.729 fused_ordering(894) 00:14:41.729 fused_ordering(895) 00:14:41.729 fused_ordering(896) 00:14:41.729 fused_ordering(897) 00:14:41.729 fused_ordering(898) 00:14:41.729 fused_ordering(899) 00:14:41.729 fused_ordering(900) 00:14:41.729 fused_ordering(901) 00:14:41.729 fused_ordering(902) 00:14:41.729 fused_ordering(903) 00:14:41.729 fused_ordering(904) 00:14:41.729 fused_ordering(905) 00:14:41.729 fused_ordering(906) 00:14:41.729 fused_ordering(907) 00:14:41.729 fused_ordering(908) 00:14:41.729 fused_ordering(909) 00:14:41.729 fused_ordering(910) 00:14:41.729 fused_ordering(911) 00:14:41.729 fused_ordering(912) 00:14:41.729 fused_ordering(913) 00:14:41.729 fused_ordering(914) 00:14:41.729 fused_ordering(915) 00:14:41.729 fused_ordering(916) 00:14:41.729 fused_ordering(917) 00:14:41.729 fused_ordering(918) 00:14:41.729 fused_ordering(919) 00:14:41.729 fused_ordering(920) 00:14:41.729 fused_ordering(921) 00:14:41.729 fused_ordering(922) 00:14:41.729 fused_ordering(923) 00:14:41.729 fused_ordering(924) 00:14:41.729 fused_ordering(925) 00:14:41.729 fused_ordering(926) 00:14:41.729 fused_ordering(927) 00:14:41.729 fused_ordering(928) 00:14:41.729 fused_ordering(929) 00:14:41.729 fused_ordering(930) 00:14:41.729 fused_ordering(931) 00:14:41.729 fused_ordering(932) 00:14:41.729 fused_ordering(933) 00:14:41.729 fused_ordering(934) 00:14:41.729 fused_ordering(935) 00:14:41.729 fused_ordering(936) 00:14:41.729 fused_ordering(937) 00:14:41.729 fused_ordering(938) 00:14:41.729 fused_ordering(939) 00:14:41.729 fused_ordering(940) 00:14:41.729 fused_ordering(941) 00:14:41.729 fused_ordering(942) 00:14:41.729 fused_ordering(943) 00:14:41.729 fused_ordering(944) 00:14:41.729 fused_ordering(945) 00:14:41.729 fused_ordering(946) 00:14:41.729 fused_ordering(947) 00:14:41.729 fused_ordering(948) 00:14:41.729 fused_ordering(949) 00:14:41.729 fused_ordering(950) 00:14:41.729 fused_ordering(951) 00:14:41.729 fused_ordering(952) 00:14:41.729 fused_ordering(953) 00:14:41.729 fused_ordering(954) 00:14:41.729 fused_ordering(955) 00:14:41.729 fused_ordering(956) 00:14:41.729 fused_ordering(957) 00:14:41.729 fused_ordering(958) 00:14:41.729 fused_ordering(959) 00:14:41.729 fused_ordering(960) 00:14:41.729 fused_ordering(961) 00:14:41.729 fused_ordering(962) 00:14:41.729 fused_ordering(963) 00:14:41.729 fused_ordering(964) 00:14:41.729 fused_ordering(965) 00:14:41.729 fused_ordering(966) 00:14:41.729 fused_ordering(967) 00:14:41.729 fused_ordering(968) 00:14:41.729 fused_ordering(969) 00:14:41.729 fused_ordering(970) 00:14:41.729 fused_ordering(971) 00:14:41.729 fused_ordering(972) 00:14:41.729 fused_ordering(973) 00:14:41.729 fused_ordering(974) 00:14:41.729 fused_ordering(975) 00:14:41.729 fused_ordering(976) 00:14:41.729 fused_ordering(977) 00:14:41.729 fused_ordering(978) 00:14:41.729 fused_ordering(979) 00:14:41.729 fused_ordering(980) 00:14:41.729 fused_ordering(981) 00:14:41.729 fused_ordering(982) 00:14:41.729 fused_ordering(983) 00:14:41.729 fused_ordering(984) 00:14:41.729 fused_ordering(985) 00:14:41.729 fused_ordering(986) 00:14:41.729 fused_ordering(987) 00:14:41.729 fused_ordering(988) 00:14:41.729 fused_ordering(989) 00:14:41.729 fused_ordering(990) 00:14:41.729 fused_ordering(991) 00:14:41.729 fused_ordering(992) 00:14:41.729 fused_ordering(993) 00:14:41.729 fused_ordering(994) 00:14:41.729 fused_ordering(995) 00:14:41.729 fused_ordering(996) 00:14:41.729 fused_ordering(997) 00:14:41.729 fused_ordering(998) 00:14:41.729 fused_ordering(999) 00:14:41.729 fused_ordering(1000) 00:14:41.729 fused_ordering(1001) 00:14:41.729 fused_ordering(1002) 00:14:41.729 fused_ordering(1003) 00:14:41.729 fused_ordering(1004) 00:14:41.729 fused_ordering(1005) 00:14:41.729 fused_ordering(1006) 00:14:41.729 fused_ordering(1007) 00:14:41.729 fused_ordering(1008) 00:14:41.729 fused_ordering(1009) 00:14:41.729 fused_ordering(1010) 00:14:41.729 fused_ordering(1011) 00:14:41.729 fused_ordering(1012) 00:14:41.729 fused_ordering(1013) 00:14:41.729 fused_ordering(1014) 00:14:41.729 fused_ordering(1015) 00:14:41.729 fused_ordering(1016) 00:14:41.729 fused_ordering(1017) 00:14:41.729 fused_ordering(1018) 00:14:41.729 fused_ordering(1019) 00:14:41.729 fused_ordering(1020) 00:14:41.729 fused_ordering(1021) 00:14:41.729 fused_ordering(1022) 00:14:41.729 fused_ordering(1023) 00:14:41.729 03:09:44 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:41.729 03:09:44 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:41.729 03:09:44 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:41.729 03:09:44 -- nvmf/common.sh@116 -- # sync 00:14:41.729 03:09:44 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:41.729 03:09:44 -- nvmf/common.sh@119 -- # set +e 00:14:41.729 03:09:44 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:41.729 03:09:44 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:41.729 rmmod nvme_tcp 00:14:41.729 rmmod nvme_fabrics 00:14:41.729 rmmod nvme_keyring 00:14:41.729 03:09:44 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:41.729 03:09:44 -- nvmf/common.sh@123 -- # set -e 00:14:41.729 03:09:44 -- nvmf/common.sh@124 -- # return 0 00:14:41.729 03:09:44 -- nvmf/common.sh@477 -- # '[' -n 2421237 ']' 00:14:41.729 03:09:44 -- nvmf/common.sh@478 -- # killprocess 2421237 00:14:41.729 03:09:44 -- common/autotest_common.sh@936 -- # '[' -z 2421237 ']' 00:14:41.729 03:09:44 -- common/autotest_common.sh@940 -- # kill -0 2421237 00:14:41.729 03:09:44 -- common/autotest_common.sh@941 -- # uname 00:14:41.729 03:09:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:41.729 03:09:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2421237 00:14:41.729 03:09:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:41.729 03:09:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:41.729 03:09:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2421237' 00:14:41.730 killing process with pid 2421237 00:14:41.730 03:09:44 -- common/autotest_common.sh@955 -- # kill 2421237 00:14:41.730 03:09:44 -- common/autotest_common.sh@960 -- # wait 2421237 00:14:41.988 03:09:44 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:41.988 03:09:44 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:41.988 03:09:44 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:41.988 03:09:44 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:41.988 03:09:44 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:41.988 03:09:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.988 03:09:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:41.988 03:09:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:43.903 03:09:46 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:43.903 00:14:43.903 real 0m8.329s 00:14:43.903 user 0m6.100s 00:14:43.903 sys 0m3.315s 00:14:43.903 03:09:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:43.903 03:09:46 -- common/autotest_common.sh@10 -- # set +x 00:14:43.903 ************************************ 00:14:43.903 END TEST nvmf_fused_ordering 00:14:43.903 ************************************ 00:14:43.903 03:09:46 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:43.903 03:09:46 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:43.903 03:09:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:43.903 03:09:46 -- common/autotest_common.sh@10 -- # set +x 00:14:43.903 ************************************ 00:14:43.903 START TEST nvmf_delete_subsystem 00:14:43.903 ************************************ 00:14:43.903 03:09:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:44.215 * Looking for test storage... 00:14:44.215 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:44.215 03:09:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:44.215 03:09:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:44.216 03:09:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:44.216 03:09:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:44.216 03:09:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:44.216 03:09:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:44.216 03:09:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:44.216 03:09:46 -- scripts/common.sh@335 -- # IFS=.-: 00:14:44.216 03:09:46 -- scripts/common.sh@335 -- # read -ra ver1 00:14:44.216 03:09:46 -- scripts/common.sh@336 -- # IFS=.-: 00:14:44.216 03:09:46 -- scripts/common.sh@336 -- # read -ra ver2 00:14:44.216 03:09:46 -- scripts/common.sh@337 -- # local 'op=<' 00:14:44.216 03:09:46 -- scripts/common.sh@339 -- # ver1_l=2 00:14:44.216 03:09:46 -- scripts/common.sh@340 -- # ver2_l=1 00:14:44.216 03:09:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:44.216 03:09:46 -- scripts/common.sh@343 -- # case "$op" in 00:14:44.216 03:09:46 -- scripts/common.sh@344 -- # : 1 00:14:44.216 03:09:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:44.216 03:09:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:44.216 03:09:46 -- scripts/common.sh@364 -- # decimal 1 00:14:44.216 03:09:46 -- scripts/common.sh@352 -- # local d=1 00:14:44.216 03:09:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:44.216 03:09:46 -- scripts/common.sh@354 -- # echo 1 00:14:44.216 03:09:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:44.216 03:09:46 -- scripts/common.sh@365 -- # decimal 2 00:14:44.216 03:09:46 -- scripts/common.sh@352 -- # local d=2 00:14:44.216 03:09:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:44.216 03:09:46 -- scripts/common.sh@354 -- # echo 2 00:14:44.216 03:09:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:44.216 03:09:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:44.216 03:09:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:44.216 03:09:46 -- scripts/common.sh@367 -- # return 0 00:14:44.216 03:09:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:44.216 03:09:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:44.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:44.216 --rc genhtml_branch_coverage=1 00:14:44.216 --rc genhtml_function_coverage=1 00:14:44.216 --rc genhtml_legend=1 00:14:44.216 --rc geninfo_all_blocks=1 00:14:44.216 --rc geninfo_unexecuted_blocks=1 00:14:44.216 00:14:44.216 ' 00:14:44.216 03:09:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:44.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:44.216 --rc genhtml_branch_coverage=1 00:14:44.216 --rc genhtml_function_coverage=1 00:14:44.216 --rc genhtml_legend=1 00:14:44.216 --rc geninfo_all_blocks=1 00:14:44.216 --rc geninfo_unexecuted_blocks=1 00:14:44.216 00:14:44.216 ' 00:14:44.216 03:09:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:44.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:44.216 --rc genhtml_branch_coverage=1 00:14:44.216 --rc genhtml_function_coverage=1 00:14:44.216 --rc genhtml_legend=1 00:14:44.216 --rc geninfo_all_blocks=1 00:14:44.216 --rc geninfo_unexecuted_blocks=1 00:14:44.216 00:14:44.216 ' 00:14:44.216 03:09:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:44.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:44.216 --rc genhtml_branch_coverage=1 00:14:44.216 --rc genhtml_function_coverage=1 00:14:44.216 --rc genhtml_legend=1 00:14:44.216 --rc geninfo_all_blocks=1 00:14:44.216 --rc geninfo_unexecuted_blocks=1 00:14:44.216 00:14:44.216 ' 00:14:44.216 03:09:46 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:44.216 03:09:46 -- nvmf/common.sh@7 -- # uname -s 00:14:44.216 03:09:46 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:44.216 03:09:46 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:44.216 03:09:46 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:44.216 03:09:46 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:44.216 03:09:46 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:44.216 03:09:46 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:44.216 03:09:46 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:44.216 03:09:46 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:44.216 03:09:46 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:44.216 03:09:46 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:44.216 03:09:46 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:44.216 03:09:46 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:44.216 03:09:46 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:44.216 03:09:46 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:44.216 03:09:46 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:44.216 03:09:46 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:44.216 03:09:46 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:44.216 03:09:46 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:44.216 03:09:46 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:44.216 03:09:46 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.216 03:09:46 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.216 03:09:46 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.216 03:09:46 -- paths/export.sh@5 -- # export PATH 00:14:44.216 03:09:46 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:44.216 03:09:46 -- nvmf/common.sh@46 -- # : 0 00:14:44.216 03:09:46 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:44.216 03:09:46 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:44.216 03:09:46 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:44.216 03:09:46 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:44.216 03:09:46 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:44.216 03:09:46 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:44.216 03:09:46 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:44.216 03:09:46 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:44.216 03:09:46 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:44.216 03:09:46 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:44.216 03:09:46 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:44.216 03:09:46 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:44.216 03:09:46 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:44.216 03:09:46 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:44.216 03:09:46 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.216 03:09:46 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.216 03:09:46 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:44.216 03:09:46 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:44.216 03:09:46 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:44.216 03:09:46 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:44.216 03:09:46 -- common/autotest_common.sh@10 -- # set +x 00:14:46.140 03:09:48 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:46.140 03:09:48 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:46.140 03:09:48 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:46.140 03:09:48 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:46.140 03:09:48 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:46.140 03:09:48 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:46.140 03:09:48 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:46.140 03:09:48 -- nvmf/common.sh@294 -- # net_devs=() 00:14:46.140 03:09:48 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:46.140 03:09:48 -- nvmf/common.sh@295 -- # e810=() 00:14:46.140 03:09:48 -- nvmf/common.sh@295 -- # local -ga e810 00:14:46.140 03:09:48 -- nvmf/common.sh@296 -- # x722=() 00:14:46.140 03:09:48 -- nvmf/common.sh@296 -- # local -ga x722 00:14:46.140 03:09:48 -- nvmf/common.sh@297 -- # mlx=() 00:14:46.140 03:09:48 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:46.140 03:09:48 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:46.140 03:09:48 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:46.140 03:09:48 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:46.140 03:09:48 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:46.140 03:09:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:46.140 03:09:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:46.140 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:46.140 03:09:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:46.140 03:09:48 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:46.140 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:46.140 03:09:48 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:46.140 03:09:48 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:46.140 03:09:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:46.140 03:09:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:46.140 03:09:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:46.140 03:09:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:46.140 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:46.140 03:09:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:46.140 03:09:48 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:46.140 03:09:48 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:46.140 03:09:48 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:46.140 03:09:48 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:46.140 03:09:48 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:46.140 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:46.140 03:09:48 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:46.140 03:09:48 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:46.140 03:09:48 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:46.140 03:09:48 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:46.140 03:09:48 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:46.140 03:09:48 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:46.140 03:09:48 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:46.140 03:09:48 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:46.140 03:09:48 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:46.140 03:09:48 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:46.140 03:09:48 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:46.140 03:09:48 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:46.140 03:09:48 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:46.140 03:09:48 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:46.140 03:09:48 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:46.140 03:09:48 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:46.140 03:09:48 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:46.140 03:09:48 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:46.399 03:09:48 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:46.399 03:09:48 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:46.399 03:09:48 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:46.399 03:09:48 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:46.399 03:09:48 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:46.399 03:09:48 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:46.399 03:09:48 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:46.399 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:46.399 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.336 ms 00:14:46.399 00:14:46.399 --- 10.0.0.2 ping statistics --- 00:14:46.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:46.399 rtt min/avg/max/mdev = 0.336/0.336/0.336/0.000 ms 00:14:46.399 03:09:48 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:46.399 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:46.399 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:14:46.399 00:14:46.399 --- 10.0.0.1 ping statistics --- 00:14:46.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:46.399 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:14:46.399 03:09:48 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:46.399 03:09:48 -- nvmf/common.sh@410 -- # return 0 00:14:46.399 03:09:48 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:46.399 03:09:48 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:46.399 03:09:48 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:46.399 03:09:48 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:46.399 03:09:48 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:46.399 03:09:48 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:46.399 03:09:48 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:46.399 03:09:48 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:46.399 03:09:48 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:46.399 03:09:48 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:46.399 03:09:48 -- common/autotest_common.sh@10 -- # set +x 00:14:46.399 03:09:48 -- nvmf/common.sh@469 -- # nvmfpid=2423743 00:14:46.399 03:09:48 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:46.399 03:09:48 -- nvmf/common.sh@470 -- # waitforlisten 2423743 00:14:46.399 03:09:48 -- common/autotest_common.sh@829 -- # '[' -z 2423743 ']' 00:14:46.399 03:09:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:46.399 03:09:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:46.399 03:09:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:46.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:46.399 03:09:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:46.399 03:09:48 -- common/autotest_common.sh@10 -- # set +x 00:14:46.399 [2024-11-27 03:09:48.961177] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:46.399 [2024-11-27 03:09:48.961245] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:46.399 EAL: No free 2048 kB hugepages reported on node 1 00:14:46.658 [2024-11-27 03:09:49.027709] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:46.658 [2024-11-27 03:09:49.112428] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:46.658 [2024-11-27 03:09:49.112607] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:46.658 [2024-11-27 03:09:49.112636] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:46.658 [2024-11-27 03:09:49.112650] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:46.658 [2024-11-27 03:09:49.112706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:46.658 [2024-11-27 03:09:49.112711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:47.591 03:09:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:47.591 03:09:49 -- common/autotest_common.sh@862 -- # return 0 00:14:47.591 03:09:49 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:47.591 03:09:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:47.591 03:09:49 -- common/autotest_common.sh@10 -- # set +x 00:14:47.591 03:09:49 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:47.591 03:09:49 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:47.591 03:09:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.591 03:09:49 -- common/autotest_common.sh@10 -- # set +x 00:14:47.591 [2024-11-27 03:09:49.966405] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:47.591 03:09:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.591 03:09:49 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:47.591 03:09:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.591 03:09:49 -- common/autotest_common.sh@10 -- # set +x 00:14:47.591 03:09:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.591 03:09:49 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:47.591 03:09:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.591 03:09:49 -- common/autotest_common.sh@10 -- # set +x 00:14:47.591 [2024-11-27 03:09:49.982701] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:47.591 03:09:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.591 03:09:49 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:47.591 03:09:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.591 03:09:49 -- common/autotest_common.sh@10 -- # set +x 00:14:47.591 NULL1 00:14:47.591 03:09:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.591 03:09:49 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:47.591 03:09:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.591 03:09:49 -- common/autotest_common.sh@10 -- # set +x 00:14:47.591 Delay0 00:14:47.591 03:09:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.591 03:09:50 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:47.591 03:09:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.591 03:09:50 -- common/autotest_common.sh@10 -- # set +x 00:14:47.591 03:09:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.591 03:09:50 -- target/delete_subsystem.sh@28 -- # perf_pid=2423897 00:14:47.591 03:09:50 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:47.591 03:09:50 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:47.591 EAL: No free 2048 kB hugepages reported on node 1 00:14:47.591 [2024-11-27 03:09:50.067438] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:49.490 03:09:52 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:49.490 03:09:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.490 03:09:52 -- common/autotest_common.sh@10 -- # set +x 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 [2024-11-27 03:09:52.239076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f9ac400c350 is same with the state(5) to be set 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 starting I/O failed: -6 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 [2024-11-27 03:09:52.239642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd02810 is same with the state(5) to be set 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Write completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.749 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Write completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 [2024-11-27 03:09:52.240089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f9ac4000c00 is same with the state(5) to be set 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:49.750 Read completed with error (sct=0, sc=8) 00:14:50.684 [2024-11-27 03:09:53.207052] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd03a40 is same with the state(5) to be set 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 [2024-11-27 03:09:53.237396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd03c90 is same with the state(5) to be set 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 [2024-11-27 03:09:53.237548] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd02690 is same with the state(5) to be set 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 [2024-11-27 03:09:53.243021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f9ac400c600 is same with the state(5) to be set 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Read completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 Write completed with error (sct=0, sc=8) 00:14:50.684 [2024-11-27 03:09:53.243176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7f9ac400bf20 is same with the state(5) to be set 00:14:50.684 [2024-11-27 03:09:53.243801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd03a40 (9): Bad file descriptor 00:14:50.684 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:50.684 03:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.684 03:09:53 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:50.684 03:09:53 -- target/delete_subsystem.sh@35 -- # kill -0 2423897 00:14:50.684 03:09:53 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:50.684 Initializing NVMe Controllers 00:14:50.684 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:50.684 Controller IO queue size 128, less than required. 00:14:50.684 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:50.684 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:50.684 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:50.684 Initialization complete. Launching workers. 00:14:50.684 ======================================================== 00:14:50.684 Latency(us) 00:14:50.685 Device Information : IOPS MiB/s Average min max 00:14:50.685 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 153.30 0.07 938123.01 513.45 1013418.88 00:14:50.685 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 159.75 0.08 938022.53 1043.67 2004931.28 00:14:50.685 ======================================================== 00:14:50.685 Total : 313.05 0.15 938071.73 513.45 2004931.28 00:14:50.685 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@35 -- # kill -0 2423897 00:14:51.251 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2423897) - No such process 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@45 -- # NOT wait 2423897 00:14:51.251 03:09:53 -- common/autotest_common.sh@650 -- # local es=0 00:14:51.251 03:09:53 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 2423897 00:14:51.251 03:09:53 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:51.251 03:09:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:51.251 03:09:53 -- common/autotest_common.sh@642 -- # type -t wait 00:14:51.251 03:09:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:51.251 03:09:53 -- common/autotest_common.sh@653 -- # wait 2423897 00:14:51.251 03:09:53 -- common/autotest_common.sh@653 -- # es=1 00:14:51.251 03:09:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:51.251 03:09:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:51.251 03:09:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:51.251 03:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.251 03:09:53 -- common/autotest_common.sh@10 -- # set +x 00:14:51.251 03:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:51.251 03:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.251 03:09:53 -- common/autotest_common.sh@10 -- # set +x 00:14:51.251 [2024-11-27 03:09:53.766975] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:51.251 03:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:51.251 03:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.251 03:09:53 -- common/autotest_common.sh@10 -- # set +x 00:14:51.251 03:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@54 -- # perf_pid=2424323 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@57 -- # kill -0 2424323 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:51.251 03:09:53 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:51.251 EAL: No free 2048 kB hugepages reported on node 1 00:14:51.251 [2024-11-27 03:09:53.829374] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:51.817 03:09:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:51.817 03:09:54 -- target/delete_subsystem.sh@57 -- # kill -0 2424323 00:14:51.817 03:09:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:52.383 03:09:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:52.383 03:09:54 -- target/delete_subsystem.sh@57 -- # kill -0 2424323 00:14:52.383 03:09:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:52.948 03:09:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:52.948 03:09:55 -- target/delete_subsystem.sh@57 -- # kill -0 2424323 00:14:52.948 03:09:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:53.206 03:09:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:53.206 03:09:55 -- target/delete_subsystem.sh@57 -- # kill -0 2424323 00:14:53.206 03:09:55 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:53.773 03:09:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:53.773 03:09:56 -- target/delete_subsystem.sh@57 -- # kill -0 2424323 00:14:53.773 03:09:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:54.342 03:09:56 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:54.342 03:09:56 -- target/delete_subsystem.sh@57 -- # kill -0 2424323 00:14:54.342 03:09:56 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:54.600 Initializing NVMe Controllers 00:14:54.600 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:54.600 Controller IO queue size 128, less than required. 00:14:54.600 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:54.600 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:54.600 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:54.600 Initialization complete. Launching workers. 00:14:54.600 ======================================================== 00:14:54.600 Latency(us) 00:14:54.600 Device Information : IOPS MiB/s Average min max 00:14:54.600 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1003699.95 1000152.23 1013290.94 00:14:54.600 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1005004.35 1000167.40 1013214.40 00:14:54.600 ======================================================== 00:14:54.600 Total : 256.00 0.12 1004352.15 1000152.23 1013290.94 00:14:54.600 00:14:54.857 03:09:57 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:54.858 03:09:57 -- target/delete_subsystem.sh@57 -- # kill -0 2424323 00:14:54.858 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2424323) - No such process 00:14:54.858 03:09:57 -- target/delete_subsystem.sh@67 -- # wait 2424323 00:14:54.858 03:09:57 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:54.858 03:09:57 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:54.858 03:09:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:54.858 03:09:57 -- nvmf/common.sh@116 -- # sync 00:14:54.858 03:09:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:54.858 03:09:57 -- nvmf/common.sh@119 -- # set +e 00:14:54.858 03:09:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:54.858 03:09:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:54.858 rmmod nvme_tcp 00:14:54.858 rmmod nvme_fabrics 00:14:54.858 rmmod nvme_keyring 00:14:54.858 03:09:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:54.858 03:09:57 -- nvmf/common.sh@123 -- # set -e 00:14:54.858 03:09:57 -- nvmf/common.sh@124 -- # return 0 00:14:54.858 03:09:57 -- nvmf/common.sh@477 -- # '[' -n 2423743 ']' 00:14:54.858 03:09:57 -- nvmf/common.sh@478 -- # killprocess 2423743 00:14:54.858 03:09:57 -- common/autotest_common.sh@936 -- # '[' -z 2423743 ']' 00:14:54.858 03:09:57 -- common/autotest_common.sh@940 -- # kill -0 2423743 00:14:54.858 03:09:57 -- common/autotest_common.sh@941 -- # uname 00:14:54.858 03:09:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:54.858 03:09:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2423743 00:14:54.858 03:09:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:54.858 03:09:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:54.858 03:09:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2423743' 00:14:54.858 killing process with pid 2423743 00:14:54.858 03:09:57 -- common/autotest_common.sh@955 -- # kill 2423743 00:14:54.858 03:09:57 -- common/autotest_common.sh@960 -- # wait 2423743 00:14:55.115 03:09:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:55.115 03:09:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:55.115 03:09:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:55.115 03:09:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:55.115 03:09:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:55.115 03:09:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:55.115 03:09:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:55.115 03:09:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.641 03:09:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:57.641 00:14:57.641 real 0m13.190s 00:14:57.641 user 0m29.600s 00:14:57.641 sys 0m3.047s 00:14:57.641 03:09:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:57.641 03:09:59 -- common/autotest_common.sh@10 -- # set +x 00:14:57.641 ************************************ 00:14:57.641 END TEST nvmf_delete_subsystem 00:14:57.641 ************************************ 00:14:57.641 03:09:59 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:57.641 03:09:59 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:57.641 03:09:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:57.641 03:09:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:57.641 03:09:59 -- common/autotest_common.sh@10 -- # set +x 00:14:57.641 ************************************ 00:14:57.641 START TEST nvmf_nvme_cli 00:14:57.641 ************************************ 00:14:57.641 03:09:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:57.641 * Looking for test storage... 00:14:57.641 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:57.641 03:09:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:57.641 03:09:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:57.641 03:09:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:57.641 03:09:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:57.641 03:09:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:57.641 03:09:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:57.641 03:09:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:57.641 03:09:59 -- scripts/common.sh@335 -- # IFS=.-: 00:14:57.641 03:09:59 -- scripts/common.sh@335 -- # read -ra ver1 00:14:57.641 03:09:59 -- scripts/common.sh@336 -- # IFS=.-: 00:14:57.641 03:09:59 -- scripts/common.sh@336 -- # read -ra ver2 00:14:57.641 03:09:59 -- scripts/common.sh@337 -- # local 'op=<' 00:14:57.641 03:09:59 -- scripts/common.sh@339 -- # ver1_l=2 00:14:57.641 03:09:59 -- scripts/common.sh@340 -- # ver2_l=1 00:14:57.641 03:09:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:57.641 03:09:59 -- scripts/common.sh@343 -- # case "$op" in 00:14:57.641 03:09:59 -- scripts/common.sh@344 -- # : 1 00:14:57.641 03:09:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:57.641 03:09:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:57.641 03:09:59 -- scripts/common.sh@364 -- # decimal 1 00:14:57.641 03:09:59 -- scripts/common.sh@352 -- # local d=1 00:14:57.641 03:09:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:57.641 03:09:59 -- scripts/common.sh@354 -- # echo 1 00:14:57.641 03:09:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:57.641 03:09:59 -- scripts/common.sh@365 -- # decimal 2 00:14:57.641 03:09:59 -- scripts/common.sh@352 -- # local d=2 00:14:57.641 03:09:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:57.641 03:09:59 -- scripts/common.sh@354 -- # echo 2 00:14:57.641 03:09:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:57.641 03:09:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:57.641 03:09:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:57.641 03:09:59 -- scripts/common.sh@367 -- # return 0 00:14:57.641 03:09:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:57.641 03:09:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:57.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.641 --rc genhtml_branch_coverage=1 00:14:57.641 --rc genhtml_function_coverage=1 00:14:57.641 --rc genhtml_legend=1 00:14:57.641 --rc geninfo_all_blocks=1 00:14:57.641 --rc geninfo_unexecuted_blocks=1 00:14:57.641 00:14:57.641 ' 00:14:57.641 03:09:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:57.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.641 --rc genhtml_branch_coverage=1 00:14:57.641 --rc genhtml_function_coverage=1 00:14:57.641 --rc genhtml_legend=1 00:14:57.641 --rc geninfo_all_blocks=1 00:14:57.641 --rc geninfo_unexecuted_blocks=1 00:14:57.641 00:14:57.641 ' 00:14:57.641 03:09:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:57.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.641 --rc genhtml_branch_coverage=1 00:14:57.641 --rc genhtml_function_coverage=1 00:14:57.641 --rc genhtml_legend=1 00:14:57.641 --rc geninfo_all_blocks=1 00:14:57.641 --rc geninfo_unexecuted_blocks=1 00:14:57.641 00:14:57.641 ' 00:14:57.641 03:09:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:57.641 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:57.641 --rc genhtml_branch_coverage=1 00:14:57.641 --rc genhtml_function_coverage=1 00:14:57.641 --rc genhtml_legend=1 00:14:57.641 --rc geninfo_all_blocks=1 00:14:57.641 --rc geninfo_unexecuted_blocks=1 00:14:57.641 00:14:57.641 ' 00:14:57.641 03:09:59 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:57.641 03:09:59 -- nvmf/common.sh@7 -- # uname -s 00:14:57.641 03:09:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:57.641 03:09:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:57.641 03:09:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:57.641 03:09:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:57.641 03:09:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:57.641 03:09:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:57.641 03:09:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:57.641 03:09:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:57.641 03:09:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:57.641 03:09:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:57.641 03:09:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.641 03:09:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:57.641 03:09:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:57.641 03:09:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:57.641 03:09:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:57.641 03:09:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:57.641 03:09:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:57.641 03:09:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:57.641 03:09:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:57.641 03:09:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.641 03:09:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.641 03:09:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.641 03:09:59 -- paths/export.sh@5 -- # export PATH 00:14:57.641 03:09:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:57.641 03:09:59 -- nvmf/common.sh@46 -- # : 0 00:14:57.641 03:09:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:57.641 03:09:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:57.641 03:09:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:57.641 03:09:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:57.641 03:09:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:57.641 03:09:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:57.641 03:09:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:57.641 03:09:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:57.641 03:09:59 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:57.641 03:09:59 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:57.641 03:09:59 -- target/nvme_cli.sh@14 -- # devs=() 00:14:57.641 03:09:59 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:57.641 03:09:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:57.641 03:09:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:57.641 03:09:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:57.641 03:09:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:57.641 03:09:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:57.641 03:09:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:57.641 03:09:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:57.641 03:09:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:57.641 03:09:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:57.641 03:09:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:57.641 03:09:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:57.641 03:09:59 -- common/autotest_common.sh@10 -- # set +x 00:14:59.541 03:10:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:59.541 03:10:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:59.541 03:10:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:59.541 03:10:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:59.541 03:10:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:59.541 03:10:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:59.541 03:10:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:59.541 03:10:01 -- nvmf/common.sh@294 -- # net_devs=() 00:14:59.541 03:10:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:59.541 03:10:01 -- nvmf/common.sh@295 -- # e810=() 00:14:59.541 03:10:01 -- nvmf/common.sh@295 -- # local -ga e810 00:14:59.541 03:10:01 -- nvmf/common.sh@296 -- # x722=() 00:14:59.541 03:10:01 -- nvmf/common.sh@296 -- # local -ga x722 00:14:59.541 03:10:01 -- nvmf/common.sh@297 -- # mlx=() 00:14:59.541 03:10:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:59.541 03:10:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:59.541 03:10:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:59.541 03:10:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:59.541 03:10:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:59.541 03:10:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.541 03:10:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:59.541 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:59.541 03:10:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:59.541 03:10:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:59.541 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:59.541 03:10:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:59.541 03:10:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:59.541 03:10:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:59.542 03:10:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:59.542 03:10:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.542 03:10:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.542 03:10:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.542 03:10:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.542 03:10:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:59.542 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:59.542 03:10:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.542 03:10:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:59.542 03:10:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:59.542 03:10:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:59.542 03:10:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:59.542 03:10:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:59.542 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:59.542 03:10:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:59.542 03:10:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:59.542 03:10:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:59.542 03:10:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:59.542 03:10:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:59.542 03:10:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:59.542 03:10:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:59.542 03:10:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:59.542 03:10:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:59.542 03:10:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:59.542 03:10:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:59.542 03:10:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:59.542 03:10:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:59.542 03:10:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:59.542 03:10:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:59.542 03:10:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:59.542 03:10:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:59.542 03:10:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:59.542 03:10:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:59.542 03:10:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:59.542 03:10:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:59.542 03:10:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:59.542 03:10:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:59.542 03:10:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:59.542 03:10:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:59.542 03:10:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:59.542 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:59.542 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.186 ms 00:14:59.542 00:14:59.542 --- 10.0.0.2 ping statistics --- 00:14:59.542 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.542 rtt min/avg/max/mdev = 0.186/0.186/0.186/0.000 ms 00:14:59.542 03:10:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:59.542 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:59.542 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:14:59.542 00:14:59.542 --- 10.0.0.1 ping statistics --- 00:14:59.542 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:59.542 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:14:59.542 03:10:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:59.542 03:10:01 -- nvmf/common.sh@410 -- # return 0 00:14:59.542 03:10:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:59.542 03:10:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:59.542 03:10:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:59.542 03:10:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:59.542 03:10:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:59.542 03:10:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:59.542 03:10:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:59.542 03:10:01 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:59.542 03:10:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:59.542 03:10:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:59.542 03:10:01 -- common/autotest_common.sh@10 -- # set +x 00:14:59.542 03:10:01 -- nvmf/common.sh@469 -- # nvmfpid=2426690 00:14:59.542 03:10:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:59.542 03:10:01 -- nvmf/common.sh@470 -- # waitforlisten 2426690 00:14:59.542 03:10:01 -- common/autotest_common.sh@829 -- # '[' -z 2426690 ']' 00:14:59.542 03:10:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:59.542 03:10:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:59.542 03:10:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:59.542 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:59.542 03:10:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:59.542 03:10:01 -- common/autotest_common.sh@10 -- # set +x 00:14:59.542 [2024-11-27 03:10:02.035710] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:59.542 [2024-11-27 03:10:02.035795] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:59.542 EAL: No free 2048 kB hugepages reported on node 1 00:14:59.542 [2024-11-27 03:10:02.107311] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:59.801 [2024-11-27 03:10:02.199435] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:59.801 [2024-11-27 03:10:02.199588] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:59.801 [2024-11-27 03:10:02.199605] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:59.801 [2024-11-27 03:10:02.199617] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:59.801 [2024-11-27 03:10:02.199671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:59.801 [2024-11-27 03:10:02.199731] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:59.801 [2024-11-27 03:10:02.199797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:59.801 [2024-11-27 03:10:02.199799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:00.735 03:10:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:00.735 03:10:03 -- common/autotest_common.sh@862 -- # return 0 00:15:00.735 03:10:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:00.735 03:10:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:00.735 03:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:00.735 03:10:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:00.735 03:10:03 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:00.735 03:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.735 03:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:00.735 [2024-11-27 03:10:03.083359] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:00.735 03:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.735 03:10:03 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:00.735 03:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.735 03:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:00.735 Malloc0 00:15:00.735 03:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.735 03:10:03 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:00.735 03:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.735 03:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:00.735 Malloc1 00:15:00.735 03:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.735 03:10:03 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:00.735 03:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.735 03:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:00.735 03:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.735 03:10:03 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:00.735 03:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.735 03:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:00.735 03:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.735 03:10:03 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:00.735 03:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.735 03:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:00.735 03:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.735 03:10:03 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:00.735 03:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.735 03:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:00.735 [2024-11-27 03:10:03.165953] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:00.735 03:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.735 03:10:03 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:00.735 03:10:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:00.735 03:10:03 -- common/autotest_common.sh@10 -- # set +x 00:15:00.735 03:10:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:00.735 03:10:03 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:00.735 00:15:00.735 Discovery Log Number of Records 2, Generation counter 2 00:15:00.735 =====Discovery Log Entry 0====== 00:15:00.736 trtype: tcp 00:15:00.736 adrfam: ipv4 00:15:00.736 subtype: current discovery subsystem 00:15:00.736 treq: not required 00:15:00.736 portid: 0 00:15:00.736 trsvcid: 4420 00:15:00.736 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:00.736 traddr: 10.0.0.2 00:15:00.736 eflags: explicit discovery connections, duplicate discovery information 00:15:00.736 sectype: none 00:15:00.736 =====Discovery Log Entry 1====== 00:15:00.736 trtype: tcp 00:15:00.736 adrfam: ipv4 00:15:00.736 subtype: nvme subsystem 00:15:00.736 treq: not required 00:15:00.736 portid: 0 00:15:00.736 trsvcid: 4420 00:15:00.736 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:00.736 traddr: 10.0.0.2 00:15:00.736 eflags: none 00:15:00.736 sectype: none 00:15:00.736 03:10:03 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:00.736 03:10:03 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:00.736 03:10:03 -- nvmf/common.sh@510 -- # local dev _ 00:15:00.736 03:10:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:00.736 03:10:03 -- nvmf/common.sh@509 -- # nvme list 00:15:00.736 03:10:03 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:00.736 03:10:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:00.994 03:10:03 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:00.994 03:10:03 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:00.994 03:10:03 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:00.994 03:10:03 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:01.560 03:10:03 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:01.560 03:10:03 -- common/autotest_common.sh@1187 -- # local i=0 00:15:01.560 03:10:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:01.560 03:10:03 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:01.560 03:10:03 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:01.560 03:10:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:03.459 03:10:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:03.459 03:10:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:03.459 03:10:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:03.459 03:10:05 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:03.459 03:10:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:03.459 03:10:05 -- common/autotest_common.sh@1197 -- # return 0 00:15:03.459 03:10:05 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:03.459 03:10:05 -- nvmf/common.sh@510 -- # local dev _ 00:15:03.459 03:10:05 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.459 03:10:05 -- nvmf/common.sh@509 -- # nvme list 00:15:03.718 03:10:06 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:03.718 03:10:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.718 03:10:06 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:03.718 03:10:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.718 03:10:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:03.718 03:10:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:03.718 03:10:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.718 03:10:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:03.718 03:10:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:03.718 03:10:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.718 03:10:06 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:03.718 /dev/nvme0n2 ]] 00:15:03.718 03:10:06 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:03.718 03:10:06 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:03.718 03:10:06 -- nvmf/common.sh@510 -- # local dev _ 00:15:03.718 03:10:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.718 03:10:06 -- nvmf/common.sh@509 -- # nvme list 00:15:03.718 03:10:06 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:03.718 03:10:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.718 03:10:06 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:03.718 03:10:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.718 03:10:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:03.718 03:10:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:03.718 03:10:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.718 03:10:06 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:03.718 03:10:06 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:03.718 03:10:06 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:03.718 03:10:06 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:03.718 03:10:06 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:03.977 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:03.977 03:10:06 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:03.977 03:10:06 -- common/autotest_common.sh@1208 -- # local i=0 00:15:03.977 03:10:06 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:03.977 03:10:06 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:03.977 03:10:06 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:03.977 03:10:06 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:03.977 03:10:06 -- common/autotest_common.sh@1220 -- # return 0 00:15:03.977 03:10:06 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:03.977 03:10:06 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:03.977 03:10:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.977 03:10:06 -- common/autotest_common.sh@10 -- # set +x 00:15:03.977 03:10:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.977 03:10:06 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:03.977 03:10:06 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:03.977 03:10:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:03.977 03:10:06 -- nvmf/common.sh@116 -- # sync 00:15:03.977 03:10:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:03.977 03:10:06 -- nvmf/common.sh@119 -- # set +e 00:15:03.977 03:10:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:03.977 03:10:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:03.977 rmmod nvme_tcp 00:15:03.977 rmmod nvme_fabrics 00:15:03.977 rmmod nvme_keyring 00:15:04.235 03:10:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:04.235 03:10:06 -- nvmf/common.sh@123 -- # set -e 00:15:04.235 03:10:06 -- nvmf/common.sh@124 -- # return 0 00:15:04.235 03:10:06 -- nvmf/common.sh@477 -- # '[' -n 2426690 ']' 00:15:04.235 03:10:06 -- nvmf/common.sh@478 -- # killprocess 2426690 00:15:04.235 03:10:06 -- common/autotest_common.sh@936 -- # '[' -z 2426690 ']' 00:15:04.235 03:10:06 -- common/autotest_common.sh@940 -- # kill -0 2426690 00:15:04.235 03:10:06 -- common/autotest_common.sh@941 -- # uname 00:15:04.235 03:10:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:04.235 03:10:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2426690 00:15:04.235 03:10:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:04.235 03:10:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:04.235 03:10:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2426690' 00:15:04.235 killing process with pid 2426690 00:15:04.235 03:10:06 -- common/autotest_common.sh@955 -- # kill 2426690 00:15:04.235 03:10:06 -- common/autotest_common.sh@960 -- # wait 2426690 00:15:04.494 03:10:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:04.494 03:10:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:04.494 03:10:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:04.494 03:10:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:04.494 03:10:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:04.494 03:10:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:04.494 03:10:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:04.494 03:10:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:06.395 03:10:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:06.395 00:15:06.395 real 0m9.301s 00:15:06.395 user 0m19.635s 00:15:06.395 sys 0m2.311s 00:15:06.395 03:10:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:06.395 03:10:08 -- common/autotest_common.sh@10 -- # set +x 00:15:06.395 ************************************ 00:15:06.395 END TEST nvmf_nvme_cli 00:15:06.395 ************************************ 00:15:06.395 03:10:09 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:06.395 03:10:09 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:06.395 03:10:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:06.395 03:10:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:06.395 03:10:09 -- common/autotest_common.sh@10 -- # set +x 00:15:06.654 ************************************ 00:15:06.654 START TEST nvmf_vfio_user 00:15:06.654 ************************************ 00:15:06.654 03:10:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:06.654 * Looking for test storage... 00:15:06.654 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:06.654 03:10:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:06.654 03:10:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:06.654 03:10:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:06.654 03:10:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:06.654 03:10:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:06.654 03:10:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:06.654 03:10:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:06.654 03:10:09 -- scripts/common.sh@335 -- # IFS=.-: 00:15:06.654 03:10:09 -- scripts/common.sh@335 -- # read -ra ver1 00:15:06.654 03:10:09 -- scripts/common.sh@336 -- # IFS=.-: 00:15:06.654 03:10:09 -- scripts/common.sh@336 -- # read -ra ver2 00:15:06.654 03:10:09 -- scripts/common.sh@337 -- # local 'op=<' 00:15:06.654 03:10:09 -- scripts/common.sh@339 -- # ver1_l=2 00:15:06.654 03:10:09 -- scripts/common.sh@340 -- # ver2_l=1 00:15:06.654 03:10:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:06.654 03:10:09 -- scripts/common.sh@343 -- # case "$op" in 00:15:06.654 03:10:09 -- scripts/common.sh@344 -- # : 1 00:15:06.654 03:10:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:06.654 03:10:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:06.654 03:10:09 -- scripts/common.sh@364 -- # decimal 1 00:15:06.654 03:10:09 -- scripts/common.sh@352 -- # local d=1 00:15:06.654 03:10:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:06.654 03:10:09 -- scripts/common.sh@354 -- # echo 1 00:15:06.654 03:10:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:06.654 03:10:09 -- scripts/common.sh@365 -- # decimal 2 00:15:06.654 03:10:09 -- scripts/common.sh@352 -- # local d=2 00:15:06.654 03:10:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:06.654 03:10:09 -- scripts/common.sh@354 -- # echo 2 00:15:06.654 03:10:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:06.654 03:10:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:06.654 03:10:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:06.654 03:10:09 -- scripts/common.sh@367 -- # return 0 00:15:06.654 03:10:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:06.654 03:10:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:06.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.654 --rc genhtml_branch_coverage=1 00:15:06.654 --rc genhtml_function_coverage=1 00:15:06.654 --rc genhtml_legend=1 00:15:06.654 --rc geninfo_all_blocks=1 00:15:06.654 --rc geninfo_unexecuted_blocks=1 00:15:06.654 00:15:06.654 ' 00:15:06.654 03:10:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:06.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.654 --rc genhtml_branch_coverage=1 00:15:06.654 --rc genhtml_function_coverage=1 00:15:06.654 --rc genhtml_legend=1 00:15:06.654 --rc geninfo_all_blocks=1 00:15:06.654 --rc geninfo_unexecuted_blocks=1 00:15:06.654 00:15:06.654 ' 00:15:06.654 03:10:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:06.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.654 --rc genhtml_branch_coverage=1 00:15:06.654 --rc genhtml_function_coverage=1 00:15:06.654 --rc genhtml_legend=1 00:15:06.654 --rc geninfo_all_blocks=1 00:15:06.654 --rc geninfo_unexecuted_blocks=1 00:15:06.654 00:15:06.654 ' 00:15:06.654 03:10:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:06.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:06.654 --rc genhtml_branch_coverage=1 00:15:06.654 --rc genhtml_function_coverage=1 00:15:06.654 --rc genhtml_legend=1 00:15:06.654 --rc geninfo_all_blocks=1 00:15:06.654 --rc geninfo_unexecuted_blocks=1 00:15:06.654 00:15:06.654 ' 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:06.654 03:10:09 -- nvmf/common.sh@7 -- # uname -s 00:15:06.654 03:10:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:06.654 03:10:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:06.654 03:10:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:06.654 03:10:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:06.654 03:10:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:06.654 03:10:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:06.654 03:10:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:06.654 03:10:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:06.654 03:10:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:06.654 03:10:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:06.654 03:10:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:06.654 03:10:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:06.654 03:10:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:06.654 03:10:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:06.654 03:10:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:06.654 03:10:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:06.654 03:10:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:06.654 03:10:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:06.654 03:10:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:06.654 03:10:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.654 03:10:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.654 03:10:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.654 03:10:09 -- paths/export.sh@5 -- # export PATH 00:15:06.654 03:10:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:06.654 03:10:09 -- nvmf/common.sh@46 -- # : 0 00:15:06.654 03:10:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:06.654 03:10:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:06.654 03:10:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:06.654 03:10:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:06.654 03:10:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:06.654 03:10:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:06.654 03:10:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:06.654 03:10:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2427769 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2427769' 00:15:06.654 Process pid: 2427769 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:06.654 03:10:09 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2427769 00:15:06.654 03:10:09 -- common/autotest_common.sh@829 -- # '[' -z 2427769 ']' 00:15:06.654 03:10:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:06.654 03:10:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:06.654 03:10:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:06.654 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:06.654 03:10:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:06.654 03:10:09 -- common/autotest_common.sh@10 -- # set +x 00:15:06.655 [2024-11-27 03:10:09.229042] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:06.655 [2024-11-27 03:10:09.229138] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:06.655 EAL: No free 2048 kB hugepages reported on node 1 00:15:06.912 [2024-11-27 03:10:09.295788] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:06.912 [2024-11-27 03:10:09.385056] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:06.912 [2024-11-27 03:10:09.385204] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:06.912 [2024-11-27 03:10:09.385222] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:06.912 [2024-11-27 03:10:09.385235] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:06.912 [2024-11-27 03:10:09.385284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:06.912 [2024-11-27 03:10:09.385328] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:06.912 [2024-11-27 03:10:09.385398] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:06.912 [2024-11-27 03:10:09.385401] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:07.845 03:10:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:07.845 03:10:10 -- common/autotest_common.sh@862 -- # return 0 00:15:07.845 03:10:10 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:08.777 03:10:11 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:09.035 03:10:11 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:09.035 03:10:11 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:09.035 03:10:11 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:09.035 03:10:11 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:09.035 03:10:11 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:09.293 Malloc1 00:15:09.293 03:10:11 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:09.551 03:10:12 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:09.809 03:10:12 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:10.066 03:10:12 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:10.066 03:10:12 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:10.066 03:10:12 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:10.324 Malloc2 00:15:10.324 03:10:12 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:10.581 03:10:13 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:10.839 03:10:13 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:11.140 03:10:13 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:11.140 03:10:13 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:11.140 03:10:13 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:11.140 03:10:13 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:11.140 03:10:13 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:11.140 03:10:13 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:11.140 [2024-11-27 03:10:13.697628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:11.140 [2024-11-27 03:10:13.697664] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2428332 ] 00:15:11.140 EAL: No free 2048 kB hugepages reported on node 1 00:15:11.140 [2024-11-27 03:10:13.728488] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:11.432 [2024-11-27 03:10:13.737978] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:11.432 [2024-11-27 03:10:13.738010] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7fd300d01000 00:15:11.432 [2024-11-27 03:10:13.738976] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:11.432 [2024-11-27 03:10:13.739970] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:11.432 [2024-11-27 03:10:13.740992] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:11.432 [2024-11-27 03:10:13.741980] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:11.432 [2024-11-27 03:10:13.743533] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:11.432 [2024-11-27 03:10:13.743988] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:11.432 [2024-11-27 03:10:13.744990] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:11.432 [2024-11-27 03:10:13.745996] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:11.432 [2024-11-27 03:10:13.747001] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:11.432 [2024-11-27 03:10:13.747020] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7fd2ff1f5000 00:15:11.432 [2024-11-27 03:10:13.748149] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:11.432 [2024-11-27 03:10:13.763419] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:11.432 [2024-11-27 03:10:13.763455] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:11.432 [2024-11-27 03:10:13.768173] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:11.432 [2024-11-27 03:10:13.768226] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:11.432 [2024-11-27 03:10:13.768351] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:11.432 [2024-11-27 03:10:13.768385] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:11.432 [2024-11-27 03:10:13.768396] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:11.432 [2024-11-27 03:10:13.770534] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:11.432 [2024-11-27 03:10:13.770555] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:11.432 [2024-11-27 03:10:13.770568] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:11.432 [2024-11-27 03:10:13.771181] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:11.432 [2024-11-27 03:10:13.771198] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:11.432 [2024-11-27 03:10:13.771212] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:11.432 [2024-11-27 03:10:13.772170] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:11.432 [2024-11-27 03:10:13.772188] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:11.432 [2024-11-27 03:10:13.773175] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:11.432 [2024-11-27 03:10:13.773193] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:11.432 [2024-11-27 03:10:13.773201] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:11.432 [2024-11-27 03:10:13.773218] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:11.432 [2024-11-27 03:10:13.773328] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:11.432 [2024-11-27 03:10:13.773336] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:11.432 [2024-11-27 03:10:13.773344] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:11.432 [2024-11-27 03:10:13.774184] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:11.432 [2024-11-27 03:10:13.775187] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:11.432 [2024-11-27 03:10:13.776195] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:11.432 [2024-11-27 03:10:13.777238] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:11.432 [2024-11-27 03:10:13.778204] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:11.432 [2024-11-27 03:10:13.778221] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:11.432 [2024-11-27 03:10:13.778230] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:11.432 [2024-11-27 03:10:13.778253] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:11.432 [2024-11-27 03:10:13.778271] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:11.432 [2024-11-27 03:10:13.778293] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:11.432 [2024-11-27 03:10:13.778302] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:11.432 [2024-11-27 03:10:13.778321] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:11.432 [2024-11-27 03:10:13.778407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:11.432 [2024-11-27 03:10:13.778421] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:11.432 [2024-11-27 03:10:13.778429] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:11.432 [2024-11-27 03:10:13.778436] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:11.432 [2024-11-27 03:10:13.778443] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:11.432 [2024-11-27 03:10:13.778451] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:11.432 [2024-11-27 03:10:13.778457] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:11.432 [2024-11-27 03:10:13.778465] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:11.432 [2024-11-27 03:10:13.778480] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:11.432 [2024-11-27 03:10:13.778499] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:11.432 [2024-11-27 03:10:13.778573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:11.432 [2024-11-27 03:10:13.778597] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:11.432 [2024-11-27 03:10:13.778610] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:11.432 [2024-11-27 03:10:13.778622] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:11.432 [2024-11-27 03:10:13.778633] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:11.432 [2024-11-27 03:10:13.778641] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:11.432 [2024-11-27 03:10:13.778656] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:11.432 [2024-11-27 03:10:13.778671] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:11.432 [2024-11-27 03:10:13.778682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:11.432 [2024-11-27 03:10:13.778692] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:11.433 [2024-11-27 03:10:13.778700] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.778710] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.778724] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.778737] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.778748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.778810] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.778847] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.778860] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:11.433 [2024-11-27 03:10:13.778867] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:11.433 [2024-11-27 03:10:13.778876] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.778892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.778914] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:11.433 [2024-11-27 03:10:13.778929] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.778942] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.778957] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:11.433 [2024-11-27 03:10:13.778965] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:11.433 [2024-11-27 03:10:13.778974] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.778996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.779017] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.779031] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.779042] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:11.433 [2024-11-27 03:10:13.779050] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:11.433 [2024-11-27 03:10:13.779059] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.779074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.779087] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.779098] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.779111] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.779121] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.779129] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.779137] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:11.433 [2024-11-27 03:10:13.779144] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:11.433 [2024-11-27 03:10:13.779152] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:11.433 [2024-11-27 03:10:13.779178] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.779195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.779213] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.779224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.779238] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.779251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.779266] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.779277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.779297] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:11.433 [2024-11-27 03:10:13.779307] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:11.433 [2024-11-27 03:10:13.779312] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:11.433 [2024-11-27 03:10:13.779318] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:11.433 [2024-11-27 03:10:13.779327] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:11.433 [2024-11-27 03:10:13.779338] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:11.433 [2024-11-27 03:10:13.779345] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:11.433 [2024-11-27 03:10:13.779354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.779364] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:11.433 [2024-11-27 03:10:13.779371] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:11.433 [2024-11-27 03:10:13.779379] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.779390] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:11.433 [2024-11-27 03:10:13.779397] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:11.433 [2024-11-27 03:10:13.779405] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:11.433 [2024-11-27 03:10:13.779416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.779437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.779452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:11.433 [2024-11-27 03:10:13.779463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:11.433 ===================================================== 00:15:11.433 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:11.433 ===================================================== 00:15:11.433 Controller Capabilities/Features 00:15:11.433 ================================ 00:15:11.433 Vendor ID: 4e58 00:15:11.433 Subsystem Vendor ID: 4e58 00:15:11.433 Serial Number: SPDK1 00:15:11.433 Model Number: SPDK bdev Controller 00:15:11.433 Firmware Version: 24.01.1 00:15:11.433 Recommended Arb Burst: 6 00:15:11.433 IEEE OUI Identifier: 8d 6b 50 00:15:11.433 Multi-path I/O 00:15:11.433 May have multiple subsystem ports: Yes 00:15:11.433 May have multiple controllers: Yes 00:15:11.433 Associated with SR-IOV VF: No 00:15:11.433 Max Data Transfer Size: 131072 00:15:11.433 Max Number of Namespaces: 32 00:15:11.433 Max Number of I/O Queues: 127 00:15:11.433 NVMe Specification Version (VS): 1.3 00:15:11.433 NVMe Specification Version (Identify): 1.3 00:15:11.433 Maximum Queue Entries: 256 00:15:11.433 Contiguous Queues Required: Yes 00:15:11.433 Arbitration Mechanisms Supported 00:15:11.433 Weighted Round Robin: Not Supported 00:15:11.433 Vendor Specific: Not Supported 00:15:11.433 Reset Timeout: 15000 ms 00:15:11.433 Doorbell Stride: 4 bytes 00:15:11.433 NVM Subsystem Reset: Not Supported 00:15:11.433 Command Sets Supported 00:15:11.433 NVM Command Set: Supported 00:15:11.433 Boot Partition: Not Supported 00:15:11.433 Memory Page Size Minimum: 4096 bytes 00:15:11.433 Memory Page Size Maximum: 4096 bytes 00:15:11.433 Persistent Memory Region: Not Supported 00:15:11.433 Optional Asynchronous Events Supported 00:15:11.433 Namespace Attribute Notices: Supported 00:15:11.433 Firmware Activation Notices: Not Supported 00:15:11.433 ANA Change Notices: Not Supported 00:15:11.433 PLE Aggregate Log Change Notices: Not Supported 00:15:11.433 LBA Status Info Alert Notices: Not Supported 00:15:11.433 EGE Aggregate Log Change Notices: Not Supported 00:15:11.433 Normal NVM Subsystem Shutdown event: Not Supported 00:15:11.433 Zone Descriptor Change Notices: Not Supported 00:15:11.433 Discovery Log Change Notices: Not Supported 00:15:11.433 Controller Attributes 00:15:11.433 128-bit Host Identifier: Supported 00:15:11.433 Non-Operational Permissive Mode: Not Supported 00:15:11.433 NVM Sets: Not Supported 00:15:11.433 Read Recovery Levels: Not Supported 00:15:11.433 Endurance Groups: Not Supported 00:15:11.433 Predictable Latency Mode: Not Supported 00:15:11.433 Traffic Based Keep ALive: Not Supported 00:15:11.433 Namespace Granularity: Not Supported 00:15:11.433 SQ Associations: Not Supported 00:15:11.433 UUID List: Not Supported 00:15:11.434 Multi-Domain Subsystem: Not Supported 00:15:11.434 Fixed Capacity Management: Not Supported 00:15:11.434 Variable Capacity Management: Not Supported 00:15:11.434 Delete Endurance Group: Not Supported 00:15:11.434 Delete NVM Set: Not Supported 00:15:11.434 Extended LBA Formats Supported: Not Supported 00:15:11.434 Flexible Data Placement Supported: Not Supported 00:15:11.434 00:15:11.434 Controller Memory Buffer Support 00:15:11.434 ================================ 00:15:11.434 Supported: No 00:15:11.434 00:15:11.434 Persistent Memory Region Support 00:15:11.434 ================================ 00:15:11.434 Supported: No 00:15:11.434 00:15:11.434 Admin Command Set Attributes 00:15:11.434 ============================ 00:15:11.434 Security Send/Receive: Not Supported 00:15:11.434 Format NVM: Not Supported 00:15:11.434 Firmware Activate/Download: Not Supported 00:15:11.434 Namespace Management: Not Supported 00:15:11.434 Device Self-Test: Not Supported 00:15:11.434 Directives: Not Supported 00:15:11.434 NVMe-MI: Not Supported 00:15:11.434 Virtualization Management: Not Supported 00:15:11.434 Doorbell Buffer Config: Not Supported 00:15:11.434 Get LBA Status Capability: Not Supported 00:15:11.434 Command & Feature Lockdown Capability: Not Supported 00:15:11.434 Abort Command Limit: 4 00:15:11.434 Async Event Request Limit: 4 00:15:11.434 Number of Firmware Slots: N/A 00:15:11.434 Firmware Slot 1 Read-Only: N/A 00:15:11.434 Firmware Activation Without Reset: N/A 00:15:11.434 Multiple Update Detection Support: N/A 00:15:11.434 Firmware Update Granularity: No Information Provided 00:15:11.434 Per-Namespace SMART Log: No 00:15:11.434 Asymmetric Namespace Access Log Page: Not Supported 00:15:11.434 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:11.434 Command Effects Log Page: Supported 00:15:11.434 Get Log Page Extended Data: Supported 00:15:11.434 Telemetry Log Pages: Not Supported 00:15:11.434 Persistent Event Log Pages: Not Supported 00:15:11.434 Supported Log Pages Log Page: May Support 00:15:11.434 Commands Supported & Effects Log Page: Not Supported 00:15:11.434 Feature Identifiers & Effects Log Page:May Support 00:15:11.434 NVMe-MI Commands & Effects Log Page: May Support 00:15:11.434 Data Area 4 for Telemetry Log: Not Supported 00:15:11.434 Error Log Page Entries Supported: 128 00:15:11.434 Keep Alive: Supported 00:15:11.434 Keep Alive Granularity: 10000 ms 00:15:11.434 00:15:11.434 NVM Command Set Attributes 00:15:11.434 ========================== 00:15:11.434 Submission Queue Entry Size 00:15:11.434 Max: 64 00:15:11.434 Min: 64 00:15:11.434 Completion Queue Entry Size 00:15:11.434 Max: 16 00:15:11.434 Min: 16 00:15:11.434 Number of Namespaces: 32 00:15:11.434 Compare Command: Supported 00:15:11.434 Write Uncorrectable Command: Not Supported 00:15:11.434 Dataset Management Command: Supported 00:15:11.434 Write Zeroes Command: Supported 00:15:11.434 Set Features Save Field: Not Supported 00:15:11.434 Reservations: Not Supported 00:15:11.434 Timestamp: Not Supported 00:15:11.434 Copy: Supported 00:15:11.434 Volatile Write Cache: Present 00:15:11.434 Atomic Write Unit (Normal): 1 00:15:11.434 Atomic Write Unit (PFail): 1 00:15:11.434 Atomic Compare & Write Unit: 1 00:15:11.434 Fused Compare & Write: Supported 00:15:11.434 Scatter-Gather List 00:15:11.434 SGL Command Set: Supported (Dword aligned) 00:15:11.434 SGL Keyed: Not Supported 00:15:11.434 SGL Bit Bucket Descriptor: Not Supported 00:15:11.434 SGL Metadata Pointer: Not Supported 00:15:11.434 Oversized SGL: Not Supported 00:15:11.434 SGL Metadata Address: Not Supported 00:15:11.434 SGL Offset: Not Supported 00:15:11.434 Transport SGL Data Block: Not Supported 00:15:11.434 Replay Protected Memory Block: Not Supported 00:15:11.434 00:15:11.434 Firmware Slot Information 00:15:11.434 ========================= 00:15:11.434 Active slot: 1 00:15:11.434 Slot 1 Firmware Revision: 24.01.1 00:15:11.434 00:15:11.434 00:15:11.434 Commands Supported and Effects 00:15:11.434 ============================== 00:15:11.434 Admin Commands 00:15:11.434 -------------- 00:15:11.434 Get Log Page (02h): Supported 00:15:11.434 Identify (06h): Supported 00:15:11.434 Abort (08h): Supported 00:15:11.434 Set Features (09h): Supported 00:15:11.434 Get Features (0Ah): Supported 00:15:11.434 Asynchronous Event Request (0Ch): Supported 00:15:11.434 Keep Alive (18h): Supported 00:15:11.434 I/O Commands 00:15:11.434 ------------ 00:15:11.434 Flush (00h): Supported LBA-Change 00:15:11.434 Write (01h): Supported LBA-Change 00:15:11.434 Read (02h): Supported 00:15:11.434 Compare (05h): Supported 00:15:11.434 Write Zeroes (08h): Supported LBA-Change 00:15:11.434 Dataset Management (09h): Supported LBA-Change 00:15:11.434 Copy (19h): Supported LBA-Change 00:15:11.434 Unknown (79h): Supported LBA-Change 00:15:11.434 Unknown (7Ah): Supported 00:15:11.434 00:15:11.434 Error Log 00:15:11.434 ========= 00:15:11.434 00:15:11.434 Arbitration 00:15:11.434 =========== 00:15:11.434 Arbitration Burst: 1 00:15:11.434 00:15:11.434 Power Management 00:15:11.434 ================ 00:15:11.434 Number of Power States: 1 00:15:11.434 Current Power State: Power State #0 00:15:11.434 Power State #0: 00:15:11.434 Max Power: 0.00 W 00:15:11.434 Non-Operational State: Operational 00:15:11.434 Entry Latency: Not Reported 00:15:11.434 Exit Latency: Not Reported 00:15:11.434 Relative Read Throughput: 0 00:15:11.434 Relative Read Latency: 0 00:15:11.434 Relative Write Throughput: 0 00:15:11.434 Relative Write Latency: 0 00:15:11.434 Idle Power: Not Reported 00:15:11.434 Active Power: Not Reported 00:15:11.434 Non-Operational Permissive Mode: Not Supported 00:15:11.434 00:15:11.434 Health Information 00:15:11.434 ================== 00:15:11.434 Critical Warnings: 00:15:11.434 Available Spare Space: OK 00:15:11.434 Temperature: OK 00:15:11.434 Device Reliability: OK 00:15:11.434 Read Only: No 00:15:11.434 Volatile Memory Backup: OK 00:15:11.434 Current Temperature: 0 Kelvin[2024-11-27 03:10:13.779636] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:11.434 [2024-11-27 03:10:13.779653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:11.434 [2024-11-27 03:10:13.779691] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:11.434 [2024-11-27 03:10:13.779708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:11.434 [2024-11-27 03:10:13.779719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:11.434 [2024-11-27 03:10:13.779728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:11.434 [2024-11-27 03:10:13.779738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:11.434 [2024-11-27 03:10:13.782536] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:11.434 [2024-11-27 03:10:13.782568] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:11.434 [2024-11-27 03:10:13.783295] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:11.434 [2024-11-27 03:10:13.783308] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:11.434 [2024-11-27 03:10:13.784258] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:11.434 [2024-11-27 03:10:13.784280] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:11.434 [2024-11-27 03:10:13.784349] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:11.434 [2024-11-27 03:10:13.786299] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:11.434 (-273 Celsius) 00:15:11.434 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:11.434 Available Spare: 0% 00:15:11.434 Available Spare Threshold: 0% 00:15:11.434 Life Percentage Used: 0% 00:15:11.434 Data Units Read: 0 00:15:11.434 Data Units Written: 0 00:15:11.434 Host Read Commands: 0 00:15:11.434 Host Write Commands: 0 00:15:11.434 Controller Busy Time: 0 minutes 00:15:11.434 Power Cycles: 0 00:15:11.434 Power On Hours: 0 hours 00:15:11.434 Unsafe Shutdowns: 0 00:15:11.434 Unrecoverable Media Errors: 0 00:15:11.434 Lifetime Error Log Entries: 0 00:15:11.434 Warning Temperature Time: 0 minutes 00:15:11.434 Critical Temperature Time: 0 minutes 00:15:11.434 00:15:11.434 Number of Queues 00:15:11.434 ================ 00:15:11.434 Number of I/O Submission Queues: 127 00:15:11.434 Number of I/O Completion Queues: 127 00:15:11.434 00:15:11.434 Active Namespaces 00:15:11.434 ================= 00:15:11.434 Namespace ID:1 00:15:11.434 Error Recovery Timeout: Unlimited 00:15:11.434 Command Set Identifier: NVM (00h) 00:15:11.434 Deallocate: Supported 00:15:11.434 Deallocated/Unwritten Error: Not Supported 00:15:11.435 Deallocated Read Value: Unknown 00:15:11.435 Deallocate in Write Zeroes: Not Supported 00:15:11.435 Deallocated Guard Field: 0xFFFF 00:15:11.435 Flush: Supported 00:15:11.435 Reservation: Supported 00:15:11.435 Namespace Sharing Capabilities: Multiple Controllers 00:15:11.435 Size (in LBAs): 131072 (0GiB) 00:15:11.435 Capacity (in LBAs): 131072 (0GiB) 00:15:11.435 Utilization (in LBAs): 131072 (0GiB) 00:15:11.435 NGUID: FF17EB7922814DDEA356890AFAFDB547 00:15:11.435 UUID: ff17eb79-2281-4dde-a356-890afafdb547 00:15:11.435 Thin Provisioning: Not Supported 00:15:11.435 Per-NS Atomic Units: Yes 00:15:11.435 Atomic Boundary Size (Normal): 0 00:15:11.435 Atomic Boundary Size (PFail): 0 00:15:11.435 Atomic Boundary Offset: 0 00:15:11.435 Maximum Single Source Range Length: 65535 00:15:11.435 Maximum Copy Length: 65535 00:15:11.435 Maximum Source Range Count: 1 00:15:11.435 NGUID/EUI64 Never Reused: No 00:15:11.435 Namespace Write Protected: No 00:15:11.435 Number of LBA Formats: 1 00:15:11.435 Current LBA Format: LBA Format #00 00:15:11.435 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:11.435 00:15:11.435 03:10:13 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:11.435 EAL: No free 2048 kB hugepages reported on node 1 00:15:16.700 Initializing NVMe Controllers 00:15:16.700 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:16.700 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:16.700 Initialization complete. Launching workers. 00:15:16.700 ======================================================== 00:15:16.700 Latency(us) 00:15:16.700 Device Information : IOPS MiB/s Average min max 00:15:16.700 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 37251.63 145.51 3435.54 1140.81 9685.67 00:15:16.700 ======================================================== 00:15:16.700 Total : 37251.63 145.51 3435.54 1140.81 9685.67 00:15:16.700 00:15:16.700 03:10:19 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:16.700 EAL: No free 2048 kB hugepages reported on node 1 00:15:21.965 Initializing NVMe Controllers 00:15:21.965 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:21.965 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:21.965 Initialization complete. Launching workers. 00:15:21.965 ======================================================== 00:15:21.965 Latency(us) 00:15:21.965 Device Information : IOPS MiB/s Average min max 00:15:21.965 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 16042.58 62.67 7978.10 6939.15 8979.33 00:15:21.965 ======================================================== 00:15:21.965 Total : 16042.58 62.67 7978.10 6939.15 8979.33 00:15:21.965 00:15:21.965 03:10:24 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:21.965 EAL: No free 2048 kB hugepages reported on node 1 00:15:27.228 Initializing NVMe Controllers 00:15:27.228 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:27.228 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:27.228 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:27.228 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:27.228 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:27.228 Initialization complete. Launching workers. 00:15:27.228 Starting thread on core 2 00:15:27.228 Starting thread on core 3 00:15:27.228 Starting thread on core 1 00:15:27.228 03:10:29 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:27.228 EAL: No free 2048 kB hugepages reported on node 1 00:15:30.512 Initializing NVMe Controllers 00:15:30.512 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:30.512 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:30.512 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:30.512 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:30.512 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:30.512 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:30.512 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:30.512 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:30.512 Initialization complete. Launching workers. 00:15:30.512 Starting thread on core 1 with urgent priority queue 00:15:30.512 Starting thread on core 2 with urgent priority queue 00:15:30.512 Starting thread on core 3 with urgent priority queue 00:15:30.512 Starting thread on core 0 with urgent priority queue 00:15:30.512 SPDK bdev Controller (SPDK1 ) core 0: 3826.67 IO/s 26.13 secs/100000 ios 00:15:30.512 SPDK bdev Controller (SPDK1 ) core 1: 3557.67 IO/s 28.11 secs/100000 ios 00:15:30.512 SPDK bdev Controller (SPDK1 ) core 2: 4091.67 IO/s 24.44 secs/100000 ios 00:15:30.512 SPDK bdev Controller (SPDK1 ) core 3: 4286.33 IO/s 23.33 secs/100000 ios 00:15:30.512 ======================================================== 00:15:30.512 00:15:30.512 03:10:32 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:30.512 EAL: No free 2048 kB hugepages reported on node 1 00:15:30.769 Initializing NVMe Controllers 00:15:30.769 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:30.769 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:30.769 Namespace ID: 1 size: 0GB 00:15:30.769 Initialization complete. 00:15:30.769 INFO: using host memory buffer for IO 00:15:30.769 Hello world! 00:15:30.770 03:10:33 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:30.770 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.143 Initializing NVMe Controllers 00:15:32.143 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:32.143 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:32.143 Initialization complete. Launching workers. 00:15:32.143 submit (in ns) avg, min, max = 8220.7, 3450.0, 6993752.2 00:15:32.143 complete (in ns) avg, min, max = 25162.8, 2035.6, 4035207.8 00:15:32.143 00:15:32.143 Submit histogram 00:15:32.143 ================ 00:15:32.143 Range in us Cumulative Count 00:15:32.143 3.437 - 3.461: 0.0727% ( 10) 00:15:32.143 3.461 - 3.484: 0.5885% ( 71) 00:15:32.143 3.484 - 3.508: 1.7293% ( 157) 00:15:32.143 3.508 - 3.532: 5.0570% ( 458) 00:15:32.143 3.532 - 3.556: 10.5936% ( 762) 00:15:32.143 3.556 - 3.579: 20.0683% ( 1304) 00:15:32.143 3.579 - 3.603: 29.3686% ( 1280) 00:15:32.143 3.603 - 3.627: 39.3955% ( 1380) 00:15:32.143 3.627 - 3.650: 47.1409% ( 1066) 00:15:32.143 3.650 - 3.674: 53.0553% ( 814) 00:15:32.143 3.674 - 3.698: 56.8917% ( 528) 00:15:32.143 3.698 - 3.721: 60.9315% ( 556) 00:15:32.143 3.721 - 3.745: 64.2157% ( 452) 00:15:32.143 3.745 - 3.769: 67.5725% ( 462) 00:15:32.143 3.769 - 3.793: 71.0892% ( 484) 00:15:32.143 3.793 - 3.816: 74.7366% ( 502) 00:15:32.143 3.816 - 3.840: 78.9217% ( 576) 00:15:32.143 3.840 - 3.864: 82.7727% ( 530) 00:15:32.143 3.864 - 3.887: 85.3956% ( 361) 00:15:32.143 3.887 - 3.911: 87.0450% ( 227) 00:15:32.143 3.911 - 3.935: 88.5490% ( 207) 00:15:32.143 3.935 - 3.959: 89.8641% ( 181) 00:15:32.143 3.959 - 3.982: 90.9177% ( 145) 00:15:32.143 3.982 - 4.006: 91.7024% ( 108) 00:15:32.143 4.006 - 4.030: 92.6179% ( 126) 00:15:32.143 4.030 - 4.053: 93.4971% ( 121) 00:15:32.143 4.053 - 4.077: 94.3617% ( 119) 00:15:32.143 4.077 - 4.101: 95.0520% ( 95) 00:15:32.143 4.101 - 4.124: 95.4516% ( 55) 00:15:32.143 4.124 - 4.148: 95.7349% ( 39) 00:15:32.143 4.148 - 4.172: 95.9239% ( 26) 00:15:32.143 4.172 - 4.196: 96.0982% ( 24) 00:15:32.143 4.196 - 4.219: 96.2726% ( 24) 00:15:32.143 4.219 - 4.243: 96.3598% ( 12) 00:15:32.143 4.243 - 4.267: 96.5124% ( 21) 00:15:32.143 4.267 - 4.290: 96.6068% ( 13) 00:15:32.143 4.290 - 4.314: 96.6940% ( 12) 00:15:32.144 4.314 - 4.338: 96.7812% ( 12) 00:15:32.144 4.338 - 4.361: 96.8248% ( 6) 00:15:32.144 4.361 - 4.385: 96.8321% ( 1) 00:15:32.144 4.385 - 4.409: 96.8684% ( 5) 00:15:32.144 4.409 - 4.433: 96.9338% ( 9) 00:15:32.144 4.433 - 4.456: 96.9556% ( 3) 00:15:32.144 4.456 - 4.480: 96.9629% ( 1) 00:15:32.144 4.480 - 4.504: 96.9774% ( 2) 00:15:32.144 4.504 - 4.527: 97.0065% ( 4) 00:15:32.144 4.527 - 4.551: 97.0210% ( 2) 00:15:32.144 4.551 - 4.575: 97.0719% ( 7) 00:15:32.144 4.575 - 4.599: 97.1300% ( 8) 00:15:32.144 4.599 - 4.622: 97.1445% ( 2) 00:15:32.144 4.622 - 4.646: 97.1808% ( 5) 00:15:32.144 4.646 - 4.670: 97.2317% ( 7) 00:15:32.144 4.670 - 4.693: 97.2680% ( 5) 00:15:32.144 4.693 - 4.717: 97.3044% ( 5) 00:15:32.144 4.717 - 4.741: 97.3334% ( 4) 00:15:32.144 4.741 - 4.764: 97.3698% ( 5) 00:15:32.144 4.764 - 4.788: 97.4206% ( 7) 00:15:32.144 4.788 - 4.812: 97.4787% ( 8) 00:15:32.144 4.812 - 4.836: 97.4933% ( 2) 00:15:32.144 4.836 - 4.859: 97.5223% ( 4) 00:15:32.144 4.859 - 4.883: 97.5514% ( 4) 00:15:32.144 4.883 - 4.907: 97.5805% ( 4) 00:15:32.144 4.907 - 4.930: 97.6023% ( 3) 00:15:32.144 4.930 - 4.954: 97.6604% ( 8) 00:15:32.144 4.954 - 4.978: 97.6967% ( 5) 00:15:32.144 5.001 - 5.025: 97.7258% ( 4) 00:15:32.144 5.025 - 5.049: 97.7403% ( 2) 00:15:32.144 5.049 - 5.073: 97.7476% ( 1) 00:15:32.144 5.073 - 5.096: 97.7694% ( 3) 00:15:32.144 5.120 - 5.144: 97.7766% ( 1) 00:15:32.144 5.144 - 5.167: 97.7839% ( 1) 00:15:32.144 5.167 - 5.191: 97.7912% ( 1) 00:15:32.144 5.191 - 5.215: 97.7984% ( 1) 00:15:32.144 5.215 - 5.239: 97.8057% ( 1) 00:15:32.144 5.239 - 5.262: 97.8275% ( 3) 00:15:32.144 5.262 - 5.286: 97.8348% ( 1) 00:15:32.144 5.286 - 5.310: 97.8420% ( 1) 00:15:32.144 5.310 - 5.333: 97.8566% ( 2) 00:15:32.144 5.452 - 5.476: 97.8638% ( 1) 00:15:32.144 5.665 - 5.689: 97.8711% ( 1) 00:15:32.144 5.784 - 5.807: 97.8784% ( 1) 00:15:32.144 5.807 - 5.831: 97.8929% ( 2) 00:15:32.144 5.973 - 5.997: 97.9002% ( 1) 00:15:32.144 6.021 - 6.044: 97.9074% ( 1) 00:15:32.144 6.044 - 6.068: 97.9147% ( 1) 00:15:32.144 6.163 - 6.210: 97.9220% ( 1) 00:15:32.144 6.400 - 6.447: 97.9292% ( 1) 00:15:32.144 6.495 - 6.542: 97.9365% ( 1) 00:15:32.144 6.542 - 6.590: 97.9438% ( 1) 00:15:32.144 6.590 - 6.637: 97.9510% ( 1) 00:15:32.144 6.779 - 6.827: 97.9656% ( 2) 00:15:32.144 6.874 - 6.921: 97.9874% ( 3) 00:15:32.144 6.921 - 6.969: 98.0019% ( 2) 00:15:32.144 6.969 - 7.016: 98.0092% ( 1) 00:15:32.144 7.064 - 7.111: 98.0237% ( 2) 00:15:32.144 7.159 - 7.206: 98.0310% ( 1) 00:15:32.144 7.253 - 7.301: 98.0455% ( 2) 00:15:32.144 7.301 - 7.348: 98.0528% ( 1) 00:15:32.144 7.396 - 7.443: 98.0673% ( 2) 00:15:32.144 7.443 - 7.490: 98.1109% ( 6) 00:15:32.144 7.490 - 7.538: 98.1254% ( 2) 00:15:32.144 7.538 - 7.585: 98.1399% ( 2) 00:15:32.144 7.633 - 7.680: 98.1545% ( 2) 00:15:32.144 7.680 - 7.727: 98.1617% ( 1) 00:15:32.144 7.822 - 7.870: 98.1690% ( 1) 00:15:32.144 7.870 - 7.917: 98.1835% ( 2) 00:15:32.144 7.917 - 7.964: 98.1981% ( 2) 00:15:32.144 7.964 - 8.012: 98.2126% ( 2) 00:15:32.144 8.059 - 8.107: 98.2271% ( 2) 00:15:32.144 8.107 - 8.154: 98.2489% ( 3) 00:15:32.144 8.154 - 8.201: 98.2562% ( 1) 00:15:32.144 8.439 - 8.486: 98.2635% ( 1) 00:15:32.144 8.533 - 8.581: 98.2707% ( 1) 00:15:32.144 8.581 - 8.628: 98.2853% ( 2) 00:15:32.144 8.723 - 8.770: 98.2925% ( 1) 00:15:32.144 8.770 - 8.818: 98.2998% ( 1) 00:15:32.144 8.818 - 8.865: 98.3071% ( 1) 00:15:32.144 8.960 - 9.007: 98.3143% ( 1) 00:15:32.144 9.055 - 9.102: 98.3289% ( 2) 00:15:32.144 9.292 - 9.339: 98.3361% ( 1) 00:15:32.144 9.529 - 9.576: 98.3507% ( 2) 00:15:32.144 9.576 - 9.624: 98.3724% ( 3) 00:15:32.144 9.766 - 9.813: 98.3797% ( 1) 00:15:32.144 9.861 - 9.908: 98.3870% ( 1) 00:15:32.144 9.956 - 10.003: 98.3942% ( 1) 00:15:32.144 10.003 - 10.050: 98.4088% ( 2) 00:15:32.144 10.050 - 10.098: 98.4160% ( 1) 00:15:32.144 10.145 - 10.193: 98.4233% ( 1) 00:15:32.144 10.240 - 10.287: 98.4306% ( 1) 00:15:32.144 10.287 - 10.335: 98.4451% ( 2) 00:15:32.144 10.382 - 10.430: 98.4596% ( 2) 00:15:32.144 10.430 - 10.477: 98.4742% ( 2) 00:15:32.144 10.524 - 10.572: 98.4814% ( 1) 00:15:32.144 10.619 - 10.667: 98.4887% ( 1) 00:15:32.144 10.667 - 10.714: 98.5105% ( 3) 00:15:32.144 10.714 - 10.761: 98.5323% ( 3) 00:15:32.144 10.904 - 10.951: 98.5396% ( 1) 00:15:32.144 10.999 - 11.046: 98.5541% ( 2) 00:15:32.144 11.046 - 11.093: 98.5614% ( 1) 00:15:32.144 11.093 - 11.141: 98.5686% ( 1) 00:15:32.144 11.141 - 11.188: 98.5832% ( 2) 00:15:32.144 11.425 - 11.473: 98.5904% ( 1) 00:15:32.144 11.567 - 11.615: 98.6050% ( 2) 00:15:32.144 11.662 - 11.710: 98.6122% ( 1) 00:15:32.144 11.994 - 12.041: 98.6195% ( 1) 00:15:32.144 12.089 - 12.136: 98.6268% ( 1) 00:15:32.144 12.231 - 12.326: 98.6558% ( 4) 00:15:32.144 12.421 - 12.516: 98.6921% ( 5) 00:15:32.144 12.516 - 12.610: 98.7067% ( 2) 00:15:32.144 12.610 - 12.705: 98.7139% ( 1) 00:15:32.144 12.705 - 12.800: 98.7212% ( 1) 00:15:32.144 12.800 - 12.895: 98.7285% ( 1) 00:15:32.144 13.179 - 13.274: 98.7357% ( 1) 00:15:32.144 13.274 - 13.369: 98.7503% ( 2) 00:15:32.144 13.464 - 13.559: 98.7575% ( 1) 00:15:32.144 13.559 - 13.653: 98.7648% ( 1) 00:15:32.144 13.653 - 13.748: 98.7721% ( 1) 00:15:32.144 13.748 - 13.843: 98.7793% ( 1) 00:15:32.144 13.843 - 13.938: 98.7866% ( 1) 00:15:32.144 14.033 - 14.127: 98.8011% ( 2) 00:15:32.144 14.127 - 14.222: 98.8084% ( 1) 00:15:32.144 14.222 - 14.317: 98.8157% ( 1) 00:15:32.144 14.507 - 14.601: 98.8375% ( 3) 00:15:32.144 14.791 - 14.886: 98.8447% ( 1) 00:15:32.144 15.170 - 15.265: 98.8520% ( 1) 00:15:32.144 15.360 - 15.455: 98.8593% ( 1) 00:15:32.144 17.161 - 17.256: 98.8665% ( 1) 00:15:32.144 17.256 - 17.351: 98.8883% ( 3) 00:15:32.144 17.351 - 17.446: 98.9029% ( 2) 00:15:32.144 17.446 - 17.541: 98.9247% ( 3) 00:15:32.144 17.541 - 17.636: 98.9537% ( 4) 00:15:32.144 17.636 - 17.730: 99.0264% ( 10) 00:15:32.144 17.730 - 17.825: 99.1063% ( 11) 00:15:32.144 17.825 - 17.920: 99.1499% ( 6) 00:15:32.144 17.920 - 18.015: 99.1862% ( 5) 00:15:32.144 18.015 - 18.110: 99.2444% ( 8) 00:15:32.144 18.110 - 18.204: 99.2952% ( 7) 00:15:32.144 18.204 - 18.299: 99.3824% ( 12) 00:15:32.144 18.299 - 18.394: 99.4333% ( 7) 00:15:32.144 18.394 - 18.489: 99.4769% ( 6) 00:15:32.144 18.489 - 18.584: 99.5205% ( 6) 00:15:32.144 18.584 - 18.679: 99.5786% ( 8) 00:15:32.144 18.679 - 18.773: 99.6222% ( 6) 00:15:32.144 18.773 - 18.868: 99.6294% ( 1) 00:15:32.144 18.868 - 18.963: 99.6512% ( 3) 00:15:32.144 18.963 - 19.058: 99.6658% ( 2) 00:15:32.144 19.058 - 19.153: 99.6803% ( 2) 00:15:32.144 19.153 - 19.247: 99.7239% ( 6) 00:15:32.144 19.247 - 19.342: 99.7312% ( 1) 00:15:32.144 19.342 - 19.437: 99.7457% ( 2) 00:15:32.144 19.437 - 19.532: 99.7602% ( 2) 00:15:32.144 19.532 - 19.627: 99.7675% ( 1) 00:15:32.144 19.627 - 19.721: 99.7748% ( 1) 00:15:32.144 19.721 - 19.816: 99.7820% ( 1) 00:15:32.144 19.816 - 19.911: 99.7893% ( 1) 00:15:32.144 20.006 - 20.101: 99.7966% ( 1) 00:15:32.144 21.239 - 21.333: 99.8038% ( 1) 00:15:32.144 21.618 - 21.713: 99.8111% ( 1) 00:15:32.144 21.902 - 21.997: 99.8184% ( 1) 00:15:32.144 23.799 - 23.893: 99.8256% ( 1) 00:15:32.144 24.083 - 24.178: 99.8329% ( 1) 00:15:32.144 25.221 - 25.410: 99.8402% ( 1) 00:15:32.144 25.410 - 25.600: 99.8474% ( 1) 00:15:32.144 25.979 - 26.169: 99.8547% ( 1) 00:15:32.144 26.359 - 26.548: 99.8619% ( 1) 00:15:32.144 26.548 - 26.738: 99.8692% ( 1) 00:15:32.144 27.876 - 28.065: 99.8765% ( 1) 00:15:32.144 28.255 - 28.444: 99.8837% ( 1) 00:15:32.144 28.444 - 28.634: 99.8910% ( 1) 00:15:32.144 29.582 - 29.772: 99.8983% ( 1) 00:15:32.144 3980.705 - 4004.978: 99.9709% ( 10) 00:15:32.144 4004.978 - 4029.250: 99.9927% ( 3) 00:15:32.144 6990.507 - 7039.052: 100.0000% ( 1) 00:15:32.144 00:15:32.144 Complete histogram 00:15:32.144 ================== 00:15:32.144 Range in us Cumulative Count 00:15:32.144 2.027 - 2.039: 0.1090% ( 15) 00:15:32.144 2.039 - 2.050: 8.2685% ( 1123) 00:15:32.144 2.050 - 2.062: 14.3646% ( 839) 00:15:32.144 2.062 - 2.074: 17.6124% ( 447) 00:15:32.144 2.074 - 2.086: 48.7830% ( 4290) 00:15:32.144 2.086 - 2.098: 60.6772% ( 1637) 00:15:32.144 2.098 - 2.110: 63.3147% ( 363) 00:15:32.144 2.110 - 2.121: 66.9040% ( 494) 00:15:32.144 2.121 - 2.133: 67.8195% ( 126) 00:15:32.144 2.133 - 2.145: 71.3507% ( 486) 00:15:32.144 2.145 - 2.157: 80.1642% ( 1213) 00:15:32.144 2.157 - 2.169: 82.8598% ( 371) 00:15:32.144 2.169 - 2.181: 84.3493% ( 205) 00:15:32.144 2.181 - 2.193: 86.2094% ( 256) 00:15:32.144 2.193 - 2.204: 86.8706% ( 91) 00:15:32.144 2.204 - 2.216: 88.9268% ( 283) 00:15:32.144 2.216 - 2.228: 92.8431% ( 539) 00:15:32.145 2.228 - 2.240: 93.9548% ( 153) 00:15:32.145 2.240 - 2.252: 94.5724% ( 85) 00:15:32.145 2.252 - 2.264: 94.8630% ( 40) 00:15:32.145 2.264 - 2.276: 95.0229% ( 22) 00:15:32.145 2.276 - 2.287: 95.4806% ( 63) 00:15:32.145 2.287 - 2.299: 95.6478% ( 23) 00:15:32.145 2.299 - 2.311: 95.6986% ( 7) 00:15:32.145 2.311 - 2.323: 95.8003% ( 14) 00:15:32.145 2.323 - 2.335: 96.0110% ( 29) 00:15:32.145 2.335 - 2.347: 96.1927% ( 25) 00:15:32.145 2.347 - 2.359: 96.3961% ( 28) 00:15:32.145 2.359 - 2.370: 96.7594% ( 50) 00:15:32.145 2.370 - 2.382: 97.0791% ( 44) 00:15:32.145 2.382 - 2.394: 97.2535% ( 24) 00:15:32.145 2.394 - 2.406: 97.4569% ( 28) 00:15:32.145 2.406 - 2.418: 97.6095% ( 21) 00:15:32.145 2.418 - 2.430: 97.7548% ( 20) 00:15:32.145 2.430 - 2.441: 97.9074% ( 21) 00:15:32.145 2.441 - 2.453: 98.0092% ( 14) 00:15:32.145 2.453 - 2.465: 98.0818% ( 10) 00:15:32.145 2.465 - 2.477: 98.1399% ( 8) 00:15:32.145 2.477 - 2.489: 98.1763% ( 5) 00:15:32.145 2.489 - 2.501: 98.2199% ( 6) 00:15:32.145 2.501 - 2.513: 98.2417% ( 3) 00:15:32.145 2.513 - 2.524: 98.2562% ( 2) 00:15:32.145 2.524 - 2.536: 98.2853% ( 4) 00:15:32.145 2.536 - 2.548: 98.2925% ( 1) 00:15:32.145 2.548 - 2.560: 98.3143% ( 3) 00:15:32.145 2.560 - 2.572: 98.3361% ( 3) 00:15:32.145 2.572 - 2.584: 98.3507% ( 2) 00:15:32.145 2.584 - 2.596: 98.3652% ( 2) 00:15:32.145 2.631 - 2.643: 98.3724% ( 1) 00:15:32.145 2.655 - 2.667: 98.3797% ( 1) 00:15:32.145 2.679 - 2.690: 98.3942% ( 2) 00:15:32.145 2.714 - 2.726: 98.4088% ( 2) 00:15:32.145 2.761 - 2.773: 98.4160% ( 1) 00:15:32.145 2.773 - 2.785: 98.4233% ( 1) 00:15:32.145 2.785 - 2.797: 98.4378% ( 2) 00:15:32.145 2.868 - 2.880: 98.4451% ( 1) 00:15:32.145 2.904 - 2.916: 98.4524% ( 1) 00:15:32.145 2.963 - 2.975: 98.4596% ( 1) 00:15:32.145 2.987 - 2.999: 98.4669% ( 1) 00:15:32.145 3.081 - 3.105: 98.4742% ( 1) 00:15:32.145 3.105 - 3.129: 98.4814% ( 1) 00:15:32.145 3.129 - 3.153: 98.4887% ( 1) 00:15:32.145 3.153 - 3.176: 98.4960% ( 1) 00:15:32.145 3.224 - 3.247: 98.5032% ( 1) 00:15:32.145 3.413 - 3.437: 98.5105% ( 1) 00:15:32.145 3.437 - 3.461: 98.5178% ( 1) 00:15:32.145 3.461 - 3.484: 98.5250% ( 1) 00:15:32.145 3.508 - 3.532: 98.5323% ( 1) 00:15:32.145 3.556 - 3.579: 98.5468% ( 2) 00:15:32.145 3.579 - 3.603: 98.5686% ( 3) 00:15:32.145 3.603 - 3.627: 98.5832% ( 2) 00:15:32.145 3.650 - 3.674: 98.5904% ( 1) 00:15:32.145 3.674 - 3.698: 98.5977% ( 1) 00:15:32.145 3.721 - 3.745: 98.6050% ( 1) 00:15:32.145 4.290 - 4.314: 98.6122% ( 1) 00:15:32.145 4.409 - 4.433: 98.6195% ( 1) 00:15:32.145 5.096 - 5.120: 98.6268% ( 1) 00:15:32.145 5.191 - 5.215: 98.6340% ( 1) 00:15:32.145 5.215 - 5.239: 98.6413% ( 1) 00:15:32.145 5.239 - 5.262: 98.6486% ( 1) 00:15:32.145 5.381 - 5.404: 98.6558% ( 1) 00:15:32.145 5.594 - 5.618: 98.6631% ( 1) 00:15:32.145 5.641 - 5.665: 98.6703% ( 1) 00:15:32.145 5.689 - 5.713: 98.6776% ( 1) 00:15:32.145 5.784 - 5.807: 98.6849% ( 1) 00:15:32.145 5.831 - 5.855: 98.6921% ( 1) 00:15:32.145 5.997 - 6.021: 98.6994% ( 1) 00:15:32.145 6.021 - 6.044: 98.7067% ( 1) 00:15:32.145 6.044 - 6.068: 98.7139% ( 1) 00:15:32.145 6.068 - 6.116: 98.7212% ( 1) 00:15:32.145 6.163 - 6.210: 98.7285% ( 1) 00:15:32.145 6.305 - 6.353: 98.7430% ( 2) 00:15:32.145 6.400 - 6.447: 98.7503% ( 1) 00:15:32.145 6.732 - 6.779: 98.7648% ( 2) 00:15:32.145 7.538 - 7.585: 98.7721% ( 1) 00:15:32.145 8.913 - 8.960: 98.7793% ( 1) 00:15:32.145 15.455 - 15.550: 98.7866% ( 1) 00:15:32.145 15.550 - 15.644: 98.7939% ( 1) 00:15:32.145 15.644 - 15.739: 98.8302% ( 5) 00:15:32.145 15.739 - 15.834: 98.8520% ( 3) 00:15:32.145 15.834 - 15.929: 98.8665% ( 2) 00:15:32.145 15.929 - 16.024: 98.8811% ( 2) 00:15:32.145 16.024 - 16.119: 98.9319% ( 7) 00:15:32.145 16.119 - 16.213: 98.9392% ( 1) 00:15:32.145 16.213 - 16.308: 98.9828% ( 6) 00:15:32.145 16.308 - 16.403: 99.0118% ( 4) 00:15:32.145 16.403 - 16.498: 99.0482% ( 5) 00:15:32.145 16.498 - 16.593: 99.1063% ( 8) 00:15:32.145 16.593 - 16.687: 99.1572% ( 7) 00:15:32.145 16.687 - 16.782: 99.1717% ( 2) 00:15:32.145 16.782 - 16.877: 99.2298% ( 8) 00:15:32.145 16.877 - 16.972: 99.2444% ( 2) 00:15:32.145 16.972 - 17.067: 99.2661% ( 3) 00:15:32.145 17.067 - 17.161: 99.2879% ( 3) 00:15:32.145 17.161 - 17.256: 99.2952% ( 1) 00:15:32.145 17.446 - 17.541: 99.3025% ( 1) 00:15:32.145 17.541 - 17.636: 99.3170% ( 2) 00:15:32.145 17.636 - 17.730: 99.3243% ( 1) 00:15:32.145 17.730 - 17.825: 99.3315% ( 1) 00:15:32.145 17.825 - 17.920: 99.3388% ( 1) 00:15:32.145 18.015 - 18.110: 99.3461% ( 1) 00:15:32.145 18.110 - 18.204: 99.3533% ( 1) 00:15:32.145 18.204 - 18.299: 99.3606% ( 1) 00:15:32.145 18.299 - 18.394: 99.3679% ( 1) 00:15:32.145 18.489 - 18.584: 99.3751% ( 1) 00:15:32.145 18.584 - 18.679: 99.3824% ( 1) 00:15:32.145 18.868 - 18.963: 99.3969% ( 2) 00:15:32.145 19.058 - 19.153: 99.4042% ( 1) 00:15:32.145 22.471 - 22.566: 99.4115% ( 1) 00:15:32.145 29.203 - 29.393: 99.4187% ( 1) 00:15:32.145 152.462 - 153.221: 99.4260% ( 1) 00:15:32.145 3665.161 - 3689.434: 99.4333% ( 1) 00:15:32.145 3980.705 - 4004.978: 99.9201% ( 67) 00:15:32.145 4004.978 - 4029.250: 99.9927% ( 10) 00:15:32.145 4029.250 - 4053.523: 100.0000% ( 1) 00:15:32.145 00:15:32.145 03:10:34 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:32.145 03:10:34 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:32.145 03:10:34 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:32.145 03:10:34 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:32.145 03:10:34 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:32.403 [2024-11-27 03:10:34.909974] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:32.403 [ 00:15:32.403 { 00:15:32.403 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:32.403 "subtype": "Discovery", 00:15:32.403 "listen_addresses": [], 00:15:32.403 "allow_any_host": true, 00:15:32.403 "hosts": [] 00:15:32.403 }, 00:15:32.403 { 00:15:32.403 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:32.403 "subtype": "NVMe", 00:15:32.403 "listen_addresses": [ 00:15:32.403 { 00:15:32.403 "transport": "VFIOUSER", 00:15:32.403 "trtype": "VFIOUSER", 00:15:32.403 "adrfam": "IPv4", 00:15:32.403 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:32.403 "trsvcid": "0" 00:15:32.403 } 00:15:32.403 ], 00:15:32.403 "allow_any_host": true, 00:15:32.403 "hosts": [], 00:15:32.403 "serial_number": "SPDK1", 00:15:32.403 "model_number": "SPDK bdev Controller", 00:15:32.403 "max_namespaces": 32, 00:15:32.403 "min_cntlid": 1, 00:15:32.403 "max_cntlid": 65519, 00:15:32.403 "namespaces": [ 00:15:32.403 { 00:15:32.403 "nsid": 1, 00:15:32.403 "bdev_name": "Malloc1", 00:15:32.403 "name": "Malloc1", 00:15:32.403 "nguid": "FF17EB7922814DDEA356890AFAFDB547", 00:15:32.403 "uuid": "ff17eb79-2281-4dde-a356-890afafdb547" 00:15:32.403 } 00:15:32.403 ] 00:15:32.403 }, 00:15:32.403 { 00:15:32.403 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:32.403 "subtype": "NVMe", 00:15:32.403 "listen_addresses": [ 00:15:32.403 { 00:15:32.403 "transport": "VFIOUSER", 00:15:32.403 "trtype": "VFIOUSER", 00:15:32.403 "adrfam": "IPv4", 00:15:32.403 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:32.403 "trsvcid": "0" 00:15:32.403 } 00:15:32.403 ], 00:15:32.403 "allow_any_host": true, 00:15:32.403 "hosts": [], 00:15:32.403 "serial_number": "SPDK2", 00:15:32.403 "model_number": "SPDK bdev Controller", 00:15:32.403 "max_namespaces": 32, 00:15:32.403 "min_cntlid": 1, 00:15:32.403 "max_cntlid": 65519, 00:15:32.403 "namespaces": [ 00:15:32.403 { 00:15:32.403 "nsid": 1, 00:15:32.403 "bdev_name": "Malloc2", 00:15:32.403 "name": "Malloc2", 00:15:32.403 "nguid": "6E2EE201A4C642D0AEA60B34F97E1D27", 00:15:32.403 "uuid": "6e2ee201-a4c6-42d0-aea6-0b34f97e1d27" 00:15:32.403 } 00:15:32.403 ] 00:15:32.403 } 00:15:32.403 ] 00:15:32.403 03:10:34 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:32.403 03:10:34 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2430806 00:15:32.403 03:10:34 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:32.403 03:10:34 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:32.403 03:10:34 -- common/autotest_common.sh@1254 -- # local i=0 00:15:32.403 03:10:34 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:32.403 03:10:34 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:32.403 03:10:34 -- common/autotest_common.sh@1265 -- # return 0 00:15:32.403 03:10:34 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:32.403 03:10:34 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:32.403 EAL: No free 2048 kB hugepages reported on node 1 00:15:32.661 Malloc3 00:15:32.661 03:10:35 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:32.918 03:10:35 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:32.918 Asynchronous Event Request test 00:15:32.918 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:32.918 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:32.918 Registering asynchronous event callbacks... 00:15:32.918 Starting namespace attribute notice tests for all controllers... 00:15:32.918 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:32.918 aer_cb - Changed Namespace 00:15:32.918 Cleaning up... 00:15:33.175 [ 00:15:33.175 { 00:15:33.175 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:33.175 "subtype": "Discovery", 00:15:33.175 "listen_addresses": [], 00:15:33.175 "allow_any_host": true, 00:15:33.175 "hosts": [] 00:15:33.175 }, 00:15:33.175 { 00:15:33.175 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:33.175 "subtype": "NVMe", 00:15:33.175 "listen_addresses": [ 00:15:33.175 { 00:15:33.175 "transport": "VFIOUSER", 00:15:33.175 "trtype": "VFIOUSER", 00:15:33.175 "adrfam": "IPv4", 00:15:33.175 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:33.175 "trsvcid": "0" 00:15:33.175 } 00:15:33.175 ], 00:15:33.175 "allow_any_host": true, 00:15:33.175 "hosts": [], 00:15:33.175 "serial_number": "SPDK1", 00:15:33.175 "model_number": "SPDK bdev Controller", 00:15:33.175 "max_namespaces": 32, 00:15:33.175 "min_cntlid": 1, 00:15:33.175 "max_cntlid": 65519, 00:15:33.175 "namespaces": [ 00:15:33.175 { 00:15:33.175 "nsid": 1, 00:15:33.175 "bdev_name": "Malloc1", 00:15:33.175 "name": "Malloc1", 00:15:33.175 "nguid": "FF17EB7922814DDEA356890AFAFDB547", 00:15:33.175 "uuid": "ff17eb79-2281-4dde-a356-890afafdb547" 00:15:33.175 }, 00:15:33.175 { 00:15:33.175 "nsid": 2, 00:15:33.175 "bdev_name": "Malloc3", 00:15:33.175 "name": "Malloc3", 00:15:33.175 "nguid": "225A846DED764A959D65496C15BD67F0", 00:15:33.175 "uuid": "225a846d-ed76-4a95-9d65-496c15bd67f0" 00:15:33.175 } 00:15:33.175 ] 00:15:33.175 }, 00:15:33.175 { 00:15:33.175 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:33.175 "subtype": "NVMe", 00:15:33.175 "listen_addresses": [ 00:15:33.175 { 00:15:33.176 "transport": "VFIOUSER", 00:15:33.176 "trtype": "VFIOUSER", 00:15:33.176 "adrfam": "IPv4", 00:15:33.176 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:33.176 "trsvcid": "0" 00:15:33.176 } 00:15:33.176 ], 00:15:33.176 "allow_any_host": true, 00:15:33.176 "hosts": [], 00:15:33.176 "serial_number": "SPDK2", 00:15:33.176 "model_number": "SPDK bdev Controller", 00:15:33.176 "max_namespaces": 32, 00:15:33.176 "min_cntlid": 1, 00:15:33.176 "max_cntlid": 65519, 00:15:33.176 "namespaces": [ 00:15:33.176 { 00:15:33.176 "nsid": 1, 00:15:33.176 "bdev_name": "Malloc2", 00:15:33.176 "name": "Malloc2", 00:15:33.176 "nguid": "6E2EE201A4C642D0AEA60B34F97E1D27", 00:15:33.176 "uuid": "6e2ee201-a4c6-42d0-aea6-0b34f97e1d27" 00:15:33.176 } 00:15:33.176 ] 00:15:33.176 } 00:15:33.176 ] 00:15:33.176 03:10:35 -- target/nvmf_vfio_user.sh@44 -- # wait 2430806 00:15:33.176 03:10:35 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:33.176 03:10:35 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:33.176 03:10:35 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:33.176 03:10:35 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:33.176 [2024-11-27 03:10:35.746432] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.176 [2024-11-27 03:10:35.746476] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2430943 ] 00:15:33.176 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.176 [2024-11-27 03:10:35.781641] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:33.176 [2024-11-27 03:10:35.783957] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:33.176 [2024-11-27 03:10:35.783994] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f8d3b15e000 00:15:33.176 [2024-11-27 03:10:35.784960] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.176 [2024-11-27 03:10:35.785969] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.176 [2024-11-27 03:10:35.786972] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.176 [2024-11-27 03:10:35.787978] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:33.176 [2024-11-27 03:10:35.788986] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:33.176 [2024-11-27 03:10:35.789996] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.176 [2024-11-27 03:10:35.791001] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:33.176 [2024-11-27 03:10:35.792012] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:33.176 [2024-11-27 03:10:35.793037] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:33.176 [2024-11-27 03:10:35.793060] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f8d39e56000 00:15:33.435 [2024-11-27 03:10:35.794244] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:33.435 [2024-11-27 03:10:35.808241] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:33.435 [2024-11-27 03:10:35.808273] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:33.435 [2024-11-27 03:10:35.813386] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:33.435 [2024-11-27 03:10:35.813438] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:33.435 [2024-11-27 03:10:35.813547] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:33.435 [2024-11-27 03:10:35.813575] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:33.435 [2024-11-27 03:10:35.813586] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:33.435 [2024-11-27 03:10:35.814387] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:33.435 [2024-11-27 03:10:35.814407] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:33.435 [2024-11-27 03:10:35.814419] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:33.435 [2024-11-27 03:10:35.815396] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:33.435 [2024-11-27 03:10:35.815415] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:33.435 [2024-11-27 03:10:35.815429] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:33.435 [2024-11-27 03:10:35.816400] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:33.435 [2024-11-27 03:10:35.816424] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:33.435 [2024-11-27 03:10:35.817410] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:33.435 [2024-11-27 03:10:35.817428] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:33.435 [2024-11-27 03:10:35.817438] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:33.435 [2024-11-27 03:10:35.817449] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:33.435 [2024-11-27 03:10:35.817558] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:33.435 [2024-11-27 03:10:35.817584] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:33.435 [2024-11-27 03:10:35.817593] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:33.435 [2024-11-27 03:10:35.818416] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:33.435 [2024-11-27 03:10:35.819426] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:33.435 [2024-11-27 03:10:35.820433] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:33.435 [2024-11-27 03:10:35.821462] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:33.435 [2024-11-27 03:10:35.822436] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:33.435 [2024-11-27 03:10:35.822455] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:33.435 [2024-11-27 03:10:35.822463] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:33.435 [2024-11-27 03:10:35.822487] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:33.435 [2024-11-27 03:10:35.822500] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:33.435 [2024-11-27 03:10:35.822538] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:33.435 [2024-11-27 03:10:35.822549] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:33.435 [2024-11-27 03:10:35.822568] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:33.435 [2024-11-27 03:10:35.830538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:33.435 [2024-11-27 03:10:35.830561] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:33.435 [2024-11-27 03:10:35.830570] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:33.435 [2024-11-27 03:10:35.830592] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:33.435 [2024-11-27 03:10:35.830600] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:33.435 [2024-11-27 03:10:35.830612] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:33.435 [2024-11-27 03:10:35.830621] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:33.435 [2024-11-27 03:10:35.830629] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:33.435 [2024-11-27 03:10:35.830647] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:33.435 [2024-11-27 03:10:35.830664] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:33.435 [2024-11-27 03:10:35.838536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:33.435 [2024-11-27 03:10:35.838566] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:33.435 [2024-11-27 03:10:35.838597] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:33.435 [2024-11-27 03:10:35.838609] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:33.436 [2024-11-27 03:10:35.838621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:33.436 [2024-11-27 03:10:35.838629] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.838645] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.838660] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.846551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.846570] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:33.436 [2024-11-27 03:10:35.846579] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.846590] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.846604] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.846618] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.854539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.854625] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.854641] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.854654] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:33.436 [2024-11-27 03:10:35.854662] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:33.436 [2024-11-27 03:10:35.854672] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.862537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.862563] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:33.436 [2024-11-27 03:10:35.862579] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.862592] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.862604] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:33.436 [2024-11-27 03:10:35.862612] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:33.436 [2024-11-27 03:10:35.862621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.870535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.870561] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.870577] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.870590] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:33.436 [2024-11-27 03:10:35.870597] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:33.436 [2024-11-27 03:10:35.870607] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.878537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.878558] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.878570] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.878583] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.878594] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.878602] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.878610] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:33.436 [2024-11-27 03:10:35.878617] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:33.436 [2024-11-27 03:10:35.878625] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:33.436 [2024-11-27 03:10:35.878649] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.886539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.886565] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.894549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.894574] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.902548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.902575] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.910535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.910561] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:33.436 [2024-11-27 03:10:35.910572] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:33.436 [2024-11-27 03:10:35.910578] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:33.436 [2024-11-27 03:10:35.910584] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:33.436 [2024-11-27 03:10:35.910593] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:33.436 [2024-11-27 03:10:35.910604] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:33.436 [2024-11-27 03:10:35.910612] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:33.436 [2024-11-27 03:10:35.910621] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.910631] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:33.436 [2024-11-27 03:10:35.910639] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:33.436 [2024-11-27 03:10:35.910647] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.910658] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:33.436 [2024-11-27 03:10:35.910666] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:33.436 [2024-11-27 03:10:35.910674] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:33.436 [2024-11-27 03:10:35.918549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.918580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.918596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:33.436 [2024-11-27 03:10:35.918608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:33.436 ===================================================== 00:15:33.436 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:33.436 ===================================================== 00:15:33.436 Controller Capabilities/Features 00:15:33.436 ================================ 00:15:33.436 Vendor ID: 4e58 00:15:33.436 Subsystem Vendor ID: 4e58 00:15:33.436 Serial Number: SPDK2 00:15:33.436 Model Number: SPDK bdev Controller 00:15:33.436 Firmware Version: 24.01.1 00:15:33.436 Recommended Arb Burst: 6 00:15:33.436 IEEE OUI Identifier: 8d 6b 50 00:15:33.436 Multi-path I/O 00:15:33.436 May have multiple subsystem ports: Yes 00:15:33.436 May have multiple controllers: Yes 00:15:33.436 Associated with SR-IOV VF: No 00:15:33.436 Max Data Transfer Size: 131072 00:15:33.436 Max Number of Namespaces: 32 00:15:33.436 Max Number of I/O Queues: 127 00:15:33.436 NVMe Specification Version (VS): 1.3 00:15:33.436 NVMe Specification Version (Identify): 1.3 00:15:33.436 Maximum Queue Entries: 256 00:15:33.436 Contiguous Queues Required: Yes 00:15:33.436 Arbitration Mechanisms Supported 00:15:33.436 Weighted Round Robin: Not Supported 00:15:33.437 Vendor Specific: Not Supported 00:15:33.437 Reset Timeout: 15000 ms 00:15:33.437 Doorbell Stride: 4 bytes 00:15:33.437 NVM Subsystem Reset: Not Supported 00:15:33.437 Command Sets Supported 00:15:33.437 NVM Command Set: Supported 00:15:33.437 Boot Partition: Not Supported 00:15:33.437 Memory Page Size Minimum: 4096 bytes 00:15:33.437 Memory Page Size Maximum: 4096 bytes 00:15:33.437 Persistent Memory Region: Not Supported 00:15:33.437 Optional Asynchronous Events Supported 00:15:33.437 Namespace Attribute Notices: Supported 00:15:33.437 Firmware Activation Notices: Not Supported 00:15:33.437 ANA Change Notices: Not Supported 00:15:33.437 PLE Aggregate Log Change Notices: Not Supported 00:15:33.437 LBA Status Info Alert Notices: Not Supported 00:15:33.437 EGE Aggregate Log Change Notices: Not Supported 00:15:33.437 Normal NVM Subsystem Shutdown event: Not Supported 00:15:33.437 Zone Descriptor Change Notices: Not Supported 00:15:33.437 Discovery Log Change Notices: Not Supported 00:15:33.437 Controller Attributes 00:15:33.437 128-bit Host Identifier: Supported 00:15:33.437 Non-Operational Permissive Mode: Not Supported 00:15:33.437 NVM Sets: Not Supported 00:15:33.437 Read Recovery Levels: Not Supported 00:15:33.437 Endurance Groups: Not Supported 00:15:33.437 Predictable Latency Mode: Not Supported 00:15:33.437 Traffic Based Keep ALive: Not Supported 00:15:33.437 Namespace Granularity: Not Supported 00:15:33.437 SQ Associations: Not Supported 00:15:33.437 UUID List: Not Supported 00:15:33.437 Multi-Domain Subsystem: Not Supported 00:15:33.437 Fixed Capacity Management: Not Supported 00:15:33.437 Variable Capacity Management: Not Supported 00:15:33.437 Delete Endurance Group: Not Supported 00:15:33.437 Delete NVM Set: Not Supported 00:15:33.437 Extended LBA Formats Supported: Not Supported 00:15:33.437 Flexible Data Placement Supported: Not Supported 00:15:33.437 00:15:33.437 Controller Memory Buffer Support 00:15:33.437 ================================ 00:15:33.437 Supported: No 00:15:33.437 00:15:33.437 Persistent Memory Region Support 00:15:33.437 ================================ 00:15:33.437 Supported: No 00:15:33.437 00:15:33.437 Admin Command Set Attributes 00:15:33.437 ============================ 00:15:33.437 Security Send/Receive: Not Supported 00:15:33.437 Format NVM: Not Supported 00:15:33.437 Firmware Activate/Download: Not Supported 00:15:33.437 Namespace Management: Not Supported 00:15:33.437 Device Self-Test: Not Supported 00:15:33.437 Directives: Not Supported 00:15:33.437 NVMe-MI: Not Supported 00:15:33.437 Virtualization Management: Not Supported 00:15:33.437 Doorbell Buffer Config: Not Supported 00:15:33.437 Get LBA Status Capability: Not Supported 00:15:33.437 Command & Feature Lockdown Capability: Not Supported 00:15:33.437 Abort Command Limit: 4 00:15:33.437 Async Event Request Limit: 4 00:15:33.437 Number of Firmware Slots: N/A 00:15:33.437 Firmware Slot 1 Read-Only: N/A 00:15:33.437 Firmware Activation Without Reset: N/A 00:15:33.437 Multiple Update Detection Support: N/A 00:15:33.437 Firmware Update Granularity: No Information Provided 00:15:33.437 Per-Namespace SMART Log: No 00:15:33.437 Asymmetric Namespace Access Log Page: Not Supported 00:15:33.437 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:33.437 Command Effects Log Page: Supported 00:15:33.437 Get Log Page Extended Data: Supported 00:15:33.437 Telemetry Log Pages: Not Supported 00:15:33.437 Persistent Event Log Pages: Not Supported 00:15:33.437 Supported Log Pages Log Page: May Support 00:15:33.437 Commands Supported & Effects Log Page: Not Supported 00:15:33.437 Feature Identifiers & Effects Log Page:May Support 00:15:33.437 NVMe-MI Commands & Effects Log Page: May Support 00:15:33.437 Data Area 4 for Telemetry Log: Not Supported 00:15:33.437 Error Log Page Entries Supported: 128 00:15:33.437 Keep Alive: Supported 00:15:33.437 Keep Alive Granularity: 10000 ms 00:15:33.437 00:15:33.437 NVM Command Set Attributes 00:15:33.437 ========================== 00:15:33.437 Submission Queue Entry Size 00:15:33.437 Max: 64 00:15:33.437 Min: 64 00:15:33.437 Completion Queue Entry Size 00:15:33.437 Max: 16 00:15:33.437 Min: 16 00:15:33.437 Number of Namespaces: 32 00:15:33.437 Compare Command: Supported 00:15:33.437 Write Uncorrectable Command: Not Supported 00:15:33.437 Dataset Management Command: Supported 00:15:33.437 Write Zeroes Command: Supported 00:15:33.437 Set Features Save Field: Not Supported 00:15:33.437 Reservations: Not Supported 00:15:33.437 Timestamp: Not Supported 00:15:33.437 Copy: Supported 00:15:33.437 Volatile Write Cache: Present 00:15:33.437 Atomic Write Unit (Normal): 1 00:15:33.437 Atomic Write Unit (PFail): 1 00:15:33.437 Atomic Compare & Write Unit: 1 00:15:33.437 Fused Compare & Write: Supported 00:15:33.437 Scatter-Gather List 00:15:33.437 SGL Command Set: Supported (Dword aligned) 00:15:33.437 SGL Keyed: Not Supported 00:15:33.437 SGL Bit Bucket Descriptor: Not Supported 00:15:33.437 SGL Metadata Pointer: Not Supported 00:15:33.437 Oversized SGL: Not Supported 00:15:33.437 SGL Metadata Address: Not Supported 00:15:33.437 SGL Offset: Not Supported 00:15:33.437 Transport SGL Data Block: Not Supported 00:15:33.437 Replay Protected Memory Block: Not Supported 00:15:33.437 00:15:33.437 Firmware Slot Information 00:15:33.437 ========================= 00:15:33.437 Active slot: 1 00:15:33.437 Slot 1 Firmware Revision: 24.01.1 00:15:33.437 00:15:33.437 00:15:33.437 Commands Supported and Effects 00:15:33.437 ============================== 00:15:33.437 Admin Commands 00:15:33.437 -------------- 00:15:33.437 Get Log Page (02h): Supported 00:15:33.437 Identify (06h): Supported 00:15:33.437 Abort (08h): Supported 00:15:33.437 Set Features (09h): Supported 00:15:33.437 Get Features (0Ah): Supported 00:15:33.437 Asynchronous Event Request (0Ch): Supported 00:15:33.437 Keep Alive (18h): Supported 00:15:33.437 I/O Commands 00:15:33.437 ------------ 00:15:33.437 Flush (00h): Supported LBA-Change 00:15:33.437 Write (01h): Supported LBA-Change 00:15:33.437 Read (02h): Supported 00:15:33.437 Compare (05h): Supported 00:15:33.437 Write Zeroes (08h): Supported LBA-Change 00:15:33.437 Dataset Management (09h): Supported LBA-Change 00:15:33.437 Copy (19h): Supported LBA-Change 00:15:33.437 Unknown (79h): Supported LBA-Change 00:15:33.437 Unknown (7Ah): Supported 00:15:33.437 00:15:33.437 Error Log 00:15:33.437 ========= 00:15:33.437 00:15:33.437 Arbitration 00:15:33.437 =========== 00:15:33.437 Arbitration Burst: 1 00:15:33.437 00:15:33.437 Power Management 00:15:33.437 ================ 00:15:33.437 Number of Power States: 1 00:15:33.437 Current Power State: Power State #0 00:15:33.437 Power State #0: 00:15:33.437 Max Power: 0.00 W 00:15:33.437 Non-Operational State: Operational 00:15:33.437 Entry Latency: Not Reported 00:15:33.437 Exit Latency: Not Reported 00:15:33.437 Relative Read Throughput: 0 00:15:33.437 Relative Read Latency: 0 00:15:33.437 Relative Write Throughput: 0 00:15:33.437 Relative Write Latency: 0 00:15:33.437 Idle Power: Not Reported 00:15:33.437 Active Power: Not Reported 00:15:33.437 Non-Operational Permissive Mode: Not Supported 00:15:33.437 00:15:33.437 Health Information 00:15:33.437 ================== 00:15:33.437 Critical Warnings: 00:15:33.437 Available Spare Space: OK 00:15:33.437 Temperature: OK 00:15:33.437 Device Reliability: OK 00:15:33.437 Read Only: No 00:15:33.437 Volatile Memory Backup: OK 00:15:33.437 Current Temperature: 0 Kelvin[2024-11-27 03:10:35.918732] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:33.437 [2024-11-27 03:10:35.926552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:33.437 [2024-11-27 03:10:35.926597] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:33.437 [2024-11-27 03:10:35.926615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:33.437 [2024-11-27 03:10:35.926625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:33.437 [2024-11-27 03:10:35.926639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:33.437 [2024-11-27 03:10:35.926650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:33.437 [2024-11-27 03:10:35.926734] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:33.437 [2024-11-27 03:10:35.926755] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:33.437 [2024-11-27 03:10:35.927782] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:33.438 [2024-11-27 03:10:35.927798] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:33.438 [2024-11-27 03:10:35.928754] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:33.438 [2024-11-27 03:10:35.928779] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:33.438 [2024-11-27 03:10:35.928846] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:33.438 [2024-11-27 03:10:35.930041] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:33.438 (-273 Celsius) 00:15:33.438 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:33.438 Available Spare: 0% 00:15:33.438 Available Spare Threshold: 0% 00:15:33.438 Life Percentage Used: 0% 00:15:33.438 Data Units Read: 0 00:15:33.438 Data Units Written: 0 00:15:33.438 Host Read Commands: 0 00:15:33.438 Host Write Commands: 0 00:15:33.438 Controller Busy Time: 0 minutes 00:15:33.438 Power Cycles: 0 00:15:33.438 Power On Hours: 0 hours 00:15:33.438 Unsafe Shutdowns: 0 00:15:33.438 Unrecoverable Media Errors: 0 00:15:33.438 Lifetime Error Log Entries: 0 00:15:33.438 Warning Temperature Time: 0 minutes 00:15:33.438 Critical Temperature Time: 0 minutes 00:15:33.438 00:15:33.438 Number of Queues 00:15:33.438 ================ 00:15:33.438 Number of I/O Submission Queues: 127 00:15:33.438 Number of I/O Completion Queues: 127 00:15:33.438 00:15:33.438 Active Namespaces 00:15:33.438 ================= 00:15:33.438 Namespace ID:1 00:15:33.438 Error Recovery Timeout: Unlimited 00:15:33.438 Command Set Identifier: NVM (00h) 00:15:33.438 Deallocate: Supported 00:15:33.438 Deallocated/Unwritten Error: Not Supported 00:15:33.438 Deallocated Read Value: Unknown 00:15:33.438 Deallocate in Write Zeroes: Not Supported 00:15:33.438 Deallocated Guard Field: 0xFFFF 00:15:33.438 Flush: Supported 00:15:33.438 Reservation: Supported 00:15:33.438 Namespace Sharing Capabilities: Multiple Controllers 00:15:33.438 Size (in LBAs): 131072 (0GiB) 00:15:33.438 Capacity (in LBAs): 131072 (0GiB) 00:15:33.438 Utilization (in LBAs): 131072 (0GiB) 00:15:33.438 NGUID: 6E2EE201A4C642D0AEA60B34F97E1D27 00:15:33.438 UUID: 6e2ee201-a4c6-42d0-aea6-0b34f97e1d27 00:15:33.438 Thin Provisioning: Not Supported 00:15:33.438 Per-NS Atomic Units: Yes 00:15:33.438 Atomic Boundary Size (Normal): 0 00:15:33.438 Atomic Boundary Size (PFail): 0 00:15:33.438 Atomic Boundary Offset: 0 00:15:33.438 Maximum Single Source Range Length: 65535 00:15:33.438 Maximum Copy Length: 65535 00:15:33.438 Maximum Source Range Count: 1 00:15:33.438 NGUID/EUI64 Never Reused: No 00:15:33.438 Namespace Write Protected: No 00:15:33.438 Number of LBA Formats: 1 00:15:33.438 Current LBA Format: LBA Format #00 00:15:33.438 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:33.438 00:15:33.438 03:10:35 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:33.438 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.702 Initializing NVMe Controllers 00:15:38.702 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:38.702 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:38.702 Initialization complete. Launching workers. 00:15:38.702 ======================================================== 00:15:38.702 Latency(us) 00:15:38.702 Device Information : IOPS MiB/s Average min max 00:15:38.702 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 37041.21 144.69 3455.32 1135.83 7560.82 00:15:38.702 ======================================================== 00:15:38.702 Total : 37041.21 144.69 3455.32 1135.83 7560.82 00:15:38.702 00:15:38.702 03:10:41 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:38.960 EAL: No free 2048 kB hugepages reported on node 1 00:15:44.224 Initializing NVMe Controllers 00:15:44.224 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:44.224 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:44.224 Initialization complete. Launching workers. 00:15:44.224 ======================================================== 00:15:44.224 Latency(us) 00:15:44.224 Device Information : IOPS MiB/s Average min max 00:15:44.224 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36023.30 140.72 3552.55 1151.14 9676.61 00:15:44.224 ======================================================== 00:15:44.224 Total : 36023.30 140.72 3552.55 1151.14 9676.61 00:15:44.224 00:15:44.224 03:10:46 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:44.224 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.487 Initializing NVMe Controllers 00:15:49.487 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:49.487 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:49.487 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:15:49.487 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:15:49.487 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:15:49.487 Initialization complete. Launching workers. 00:15:49.487 Starting thread on core 2 00:15:49.487 Starting thread on core 3 00:15:49.487 Starting thread on core 1 00:15:49.487 03:10:51 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:15:49.487 EAL: No free 2048 kB hugepages reported on node 1 00:15:52.770 Initializing NVMe Controllers 00:15:52.770 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:52.770 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:52.770 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:15:52.770 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:15:52.770 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:15:52.770 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:15:52.770 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:52.770 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:52.770 Initialization complete. Launching workers. 00:15:52.770 Starting thread on core 1 with urgent priority queue 00:15:52.770 Starting thread on core 2 with urgent priority queue 00:15:52.770 Starting thread on core 3 with urgent priority queue 00:15:52.770 Starting thread on core 0 with urgent priority queue 00:15:52.770 SPDK bdev Controller (SPDK2 ) core 0: 6060.33 IO/s 16.50 secs/100000 ios 00:15:52.770 SPDK bdev Controller (SPDK2 ) core 1: 6161.67 IO/s 16.23 secs/100000 ios 00:15:52.770 SPDK bdev Controller (SPDK2 ) core 2: 5740.00 IO/s 17.42 secs/100000 ios 00:15:52.770 SPDK bdev Controller (SPDK2 ) core 3: 6253.67 IO/s 15.99 secs/100000 ios 00:15:52.770 ======================================================== 00:15:52.770 00:15:52.770 03:10:55 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:52.770 EAL: No free 2048 kB hugepages reported on node 1 00:15:53.027 Initializing NVMe Controllers 00:15:53.027 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:53.027 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:53.027 Namespace ID: 1 size: 0GB 00:15:53.027 Initialization complete. 00:15:53.027 INFO: using host memory buffer for IO 00:15:53.027 Hello world! 00:15:53.028 03:10:55 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:15:53.285 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.656 Initializing NVMe Controllers 00:15:54.656 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:54.656 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:54.656 Initialization complete. Launching workers. 00:15:54.656 submit (in ns) avg, min, max = 6488.4, 3462.2, 4014745.6 00:15:54.656 complete (in ns) avg, min, max = 26081.7, 2031.1, 4032978.9 00:15:54.656 00:15:54.656 Submit histogram 00:15:54.656 ================ 00:15:54.656 Range in us Cumulative Count 00:15:54.656 3.461 - 3.484: 0.2113% ( 29) 00:15:54.656 3.484 - 3.508: 1.2534% ( 143) 00:15:54.656 3.508 - 3.532: 3.2136% ( 269) 00:15:54.656 3.532 - 3.556: 7.6732% ( 612) 00:15:54.656 3.556 - 3.579: 14.8583% ( 986) 00:15:54.656 3.579 - 3.603: 23.7047% ( 1214) 00:15:54.656 3.603 - 3.627: 33.0904% ( 1288) 00:15:54.656 3.627 - 3.650: 42.0316% ( 1227) 00:15:54.656 3.650 - 3.674: 48.8013% ( 929) 00:15:54.656 3.674 - 3.698: 54.1062% ( 728) 00:15:54.656 3.698 - 3.721: 58.5878% ( 615) 00:15:54.656 3.721 - 3.745: 61.4151% ( 388) 00:15:54.656 3.745 - 3.769: 64.9931% ( 491) 00:15:54.656 3.769 - 3.793: 68.5054% ( 482) 00:15:54.656 3.793 - 3.816: 72.4404% ( 540) 00:15:54.656 3.816 - 3.840: 76.9948% ( 625) 00:15:54.656 3.840 - 3.864: 81.0100% ( 551) 00:15:54.656 3.864 - 3.887: 84.4640% ( 474) 00:15:54.656 3.887 - 3.911: 86.7959% ( 320) 00:15:54.656 3.911 - 3.935: 88.6687% ( 257) 00:15:54.656 3.935 - 3.959: 90.0896% ( 195) 00:15:54.656 3.959 - 3.982: 91.3430% ( 172) 00:15:54.656 3.982 - 4.006: 92.3340% ( 136) 00:15:54.656 4.006 - 4.030: 93.1429% ( 111) 00:15:54.657 4.030 - 4.053: 93.9882% ( 116) 00:15:54.657 4.053 - 4.077: 94.7388% ( 103) 00:15:54.657 4.077 - 4.101: 95.3217% ( 80) 00:15:54.657 4.101 - 4.124: 95.7589% ( 60) 00:15:54.657 4.124 - 4.148: 95.9848% ( 31) 00:15:54.657 4.148 - 4.172: 96.1816% ( 27) 00:15:54.657 4.172 - 4.196: 96.3565% ( 24) 00:15:54.657 4.196 - 4.219: 96.4658% ( 15) 00:15:54.657 4.219 - 4.243: 96.6188% ( 21) 00:15:54.657 4.243 - 4.267: 96.6844% ( 9) 00:15:54.657 4.267 - 4.290: 96.8229% ( 19) 00:15:54.657 4.290 - 4.314: 96.9030% ( 11) 00:15:54.657 4.314 - 4.338: 96.9613% ( 8) 00:15:54.657 4.338 - 4.361: 97.0123% ( 7) 00:15:54.657 4.361 - 4.385: 97.0633% ( 7) 00:15:54.657 4.385 - 4.409: 97.1070% ( 6) 00:15:54.657 4.409 - 4.433: 97.1216% ( 2) 00:15:54.657 4.433 - 4.456: 97.1362% ( 2) 00:15:54.657 4.456 - 4.480: 97.1508% ( 2) 00:15:54.657 4.480 - 4.504: 97.1653% ( 2) 00:15:54.657 4.504 - 4.527: 97.1799% ( 2) 00:15:54.657 4.527 - 4.551: 97.1872% ( 1) 00:15:54.657 4.551 - 4.575: 97.1945% ( 1) 00:15:54.657 4.575 - 4.599: 97.2091% ( 2) 00:15:54.657 4.599 - 4.622: 97.2382% ( 4) 00:15:54.657 4.622 - 4.646: 97.2674% ( 4) 00:15:54.657 4.646 - 4.670: 97.2892% ( 3) 00:15:54.657 4.670 - 4.693: 97.3184% ( 4) 00:15:54.657 4.693 - 4.717: 97.3257% ( 1) 00:15:54.657 4.717 - 4.741: 97.3475% ( 3) 00:15:54.657 4.741 - 4.764: 97.3840% ( 5) 00:15:54.657 4.764 - 4.788: 97.4204% ( 5) 00:15:54.657 4.788 - 4.812: 97.4568% ( 5) 00:15:54.657 4.812 - 4.836: 97.4860% ( 4) 00:15:54.657 4.836 - 4.859: 97.5516% ( 9) 00:15:54.657 4.859 - 4.883: 97.6026% ( 7) 00:15:54.657 4.883 - 4.907: 97.6463% ( 6) 00:15:54.657 4.907 - 4.930: 97.6900% ( 6) 00:15:54.657 4.930 - 4.954: 97.7264% ( 5) 00:15:54.657 4.954 - 4.978: 97.7775% ( 7) 00:15:54.657 4.978 - 5.001: 97.7920% ( 2) 00:15:54.657 5.001 - 5.025: 97.8285% ( 5) 00:15:54.657 5.025 - 5.049: 97.8576% ( 4) 00:15:54.657 5.049 - 5.073: 97.8722% ( 2) 00:15:54.657 5.073 - 5.096: 97.9086% ( 5) 00:15:54.657 5.096 - 5.120: 97.9232% ( 2) 00:15:54.657 5.120 - 5.144: 97.9451% ( 3) 00:15:54.657 5.191 - 5.215: 97.9523% ( 1) 00:15:54.657 5.215 - 5.239: 97.9669% ( 2) 00:15:54.657 5.239 - 5.262: 97.9742% ( 1) 00:15:54.657 5.262 - 5.286: 97.9961% ( 3) 00:15:54.657 5.310 - 5.333: 98.0106% ( 2) 00:15:54.657 5.452 - 5.476: 98.0179% ( 1) 00:15:54.657 5.476 - 5.499: 98.0325% ( 2) 00:15:54.657 5.523 - 5.547: 98.0398% ( 1) 00:15:54.657 5.665 - 5.689: 98.0471% ( 1) 00:15:54.657 5.736 - 5.760: 98.0544% ( 1) 00:15:54.657 5.831 - 5.855: 98.0616% ( 1) 00:15:54.657 5.879 - 5.902: 98.0689% ( 1) 00:15:54.657 6.044 - 6.068: 98.0835% ( 2) 00:15:54.657 6.163 - 6.210: 98.0908% ( 1) 00:15:54.657 6.400 - 6.447: 98.0981% ( 1) 00:15:54.657 6.590 - 6.637: 98.1054% ( 1) 00:15:54.657 6.637 - 6.684: 98.1127% ( 1) 00:15:54.657 6.684 - 6.732: 98.1199% ( 1) 00:15:54.657 6.732 - 6.779: 98.1272% ( 1) 00:15:54.657 6.779 - 6.827: 98.1418% ( 2) 00:15:54.657 6.921 - 6.969: 98.1564% ( 2) 00:15:54.657 6.969 - 7.016: 98.1637% ( 1) 00:15:54.657 7.111 - 7.159: 98.1855% ( 3) 00:15:54.657 7.159 - 7.206: 98.2074% ( 3) 00:15:54.657 7.301 - 7.348: 98.2147% ( 1) 00:15:54.657 7.348 - 7.396: 98.2293% ( 2) 00:15:54.657 7.396 - 7.443: 98.2657% ( 5) 00:15:54.657 7.538 - 7.585: 98.2803% ( 2) 00:15:54.657 7.585 - 7.633: 98.2948% ( 2) 00:15:54.657 7.633 - 7.680: 98.3094% ( 2) 00:15:54.657 7.727 - 7.775: 98.3167% ( 1) 00:15:54.657 7.775 - 7.822: 98.3313% ( 2) 00:15:54.657 7.822 - 7.870: 98.3458% ( 2) 00:15:54.657 7.870 - 7.917: 98.3604% ( 2) 00:15:54.657 7.917 - 7.964: 98.3750% ( 2) 00:15:54.657 8.012 - 8.059: 98.3823% ( 1) 00:15:54.657 8.059 - 8.107: 98.3896% ( 1) 00:15:54.657 8.107 - 8.154: 98.4041% ( 2) 00:15:54.657 8.154 - 8.201: 98.4187% ( 2) 00:15:54.657 8.201 - 8.249: 98.4260% ( 1) 00:15:54.657 8.296 - 8.344: 98.4333% ( 1) 00:15:54.657 8.391 - 8.439: 98.4479% ( 2) 00:15:54.657 8.439 - 8.486: 98.4551% ( 1) 00:15:54.657 8.486 - 8.533: 98.4770% ( 3) 00:15:54.657 8.533 - 8.581: 98.5062% ( 4) 00:15:54.657 8.581 - 8.628: 98.5353% ( 4) 00:15:54.657 8.676 - 8.723: 98.5426% ( 1) 00:15:54.657 8.818 - 8.865: 98.5499% ( 1) 00:15:54.657 8.865 - 8.913: 98.5572% ( 1) 00:15:54.657 8.913 - 8.960: 98.5645% ( 1) 00:15:54.657 8.960 - 9.007: 98.5863% ( 3) 00:15:54.657 9.150 - 9.197: 98.5936% ( 1) 00:15:54.657 9.434 - 9.481: 98.6009% ( 1) 00:15:54.657 9.624 - 9.671: 98.6082% ( 1) 00:15:54.657 9.861 - 9.908: 98.6228% ( 2) 00:15:54.657 10.335 - 10.382: 98.6300% ( 1) 00:15:54.657 10.430 - 10.477: 98.6446% ( 2) 00:15:54.657 10.477 - 10.524: 98.6519% ( 1) 00:15:54.657 10.809 - 10.856: 98.6592% ( 1) 00:15:54.657 10.951 - 10.999: 98.6738% ( 2) 00:15:54.657 11.046 - 11.093: 98.6883% ( 2) 00:15:54.657 11.141 - 11.188: 98.7029% ( 2) 00:15:54.657 11.425 - 11.473: 98.7102% ( 1) 00:15:54.657 11.520 - 11.567: 98.7175% ( 1) 00:15:54.657 11.899 - 11.947: 98.7248% ( 1) 00:15:54.657 11.947 - 11.994: 98.7321% ( 1) 00:15:54.657 12.136 - 12.231: 98.7539% ( 3) 00:15:54.657 12.231 - 12.326: 98.7612% ( 1) 00:15:54.657 12.326 - 12.421: 98.7685% ( 1) 00:15:54.657 12.610 - 12.705: 98.7758% ( 1) 00:15:54.657 12.705 - 12.800: 98.7831% ( 1) 00:15:54.657 12.800 - 12.895: 98.7904% ( 1) 00:15:54.657 12.990 - 13.084: 98.8049% ( 2) 00:15:54.657 13.179 - 13.274: 98.8195% ( 2) 00:15:54.657 13.653 - 13.748: 98.8268% ( 1) 00:15:54.657 13.748 - 13.843: 98.8341% ( 1) 00:15:54.657 13.938 - 14.033: 98.8486% ( 2) 00:15:54.657 14.033 - 14.127: 98.8559% ( 1) 00:15:54.657 14.317 - 14.412: 98.8632% ( 1) 00:15:54.657 14.507 - 14.601: 98.8778% ( 2) 00:15:54.657 14.696 - 14.791: 98.8851% ( 1) 00:15:54.657 16.972 - 17.067: 98.8997% ( 2) 00:15:54.657 17.161 - 17.256: 98.9142% ( 2) 00:15:54.657 17.256 - 17.351: 98.9361% ( 3) 00:15:54.657 17.351 - 17.446: 98.9580% ( 3) 00:15:54.657 17.446 - 17.541: 99.0017% ( 6) 00:15:54.657 17.541 - 17.636: 99.0163% ( 2) 00:15:54.657 17.636 - 17.730: 99.0527% ( 5) 00:15:54.657 17.730 - 17.825: 99.0891% ( 5) 00:15:54.657 17.825 - 17.920: 99.1256% ( 5) 00:15:54.658 17.920 - 18.015: 99.1766% ( 7) 00:15:54.658 18.015 - 18.110: 99.2494% ( 10) 00:15:54.658 18.110 - 18.204: 99.3077% ( 8) 00:15:54.658 18.204 - 18.299: 99.3806% ( 10) 00:15:54.658 18.299 - 18.394: 99.4243% ( 6) 00:15:54.658 18.394 - 18.489: 99.5191% ( 13) 00:15:54.658 18.489 - 18.584: 99.5919% ( 10) 00:15:54.658 18.584 - 18.679: 99.6648% ( 10) 00:15:54.658 18.679 - 18.773: 99.6939% ( 4) 00:15:54.658 18.773 - 18.868: 99.7158% ( 3) 00:15:54.658 18.868 - 18.963: 99.7377% ( 3) 00:15:54.658 18.963 - 19.058: 99.7595% ( 3) 00:15:54.658 19.058 - 19.153: 99.7741% ( 2) 00:15:54.658 19.153 - 19.247: 99.7887% ( 2) 00:15:54.658 19.247 - 19.342: 99.8033% ( 2) 00:15:54.658 19.342 - 19.437: 99.8105% ( 1) 00:15:54.658 19.627 - 19.721: 99.8397% ( 4) 00:15:54.658 19.721 - 19.816: 99.8470% ( 1) 00:15:54.658 19.816 - 19.911: 99.8543% ( 1) 00:15:54.658 20.196 - 20.290: 99.8688% ( 2) 00:15:54.658 20.290 - 20.385: 99.8761% ( 1) 00:15:54.658 20.480 - 20.575: 99.8834% ( 1) 00:15:54.658 20.575 - 20.670: 99.8907% ( 1) 00:15:54.658 20.954 - 21.049: 99.8980% ( 1) 00:15:54.658 21.997 - 22.092: 99.9053% ( 1) 00:15:54.658 22.187 - 22.281: 99.9126% ( 1) 00:15:54.658 22.756 - 22.850: 99.9198% ( 1) 00:15:54.658 22.850 - 22.945: 99.9271% ( 1) 00:15:54.658 26.548 - 26.738: 99.9344% ( 1) 00:15:54.658 3094.756 - 3106.892: 99.9417% ( 1) 00:15:54.658 3980.705 - 4004.978: 99.9854% ( 6) 00:15:54.658 4004.978 - 4029.250: 100.0000% ( 2) 00:15:54.658 00:15:54.658 Complete histogram 00:15:54.658 ================== 00:15:54.658 Range in us Cumulative Count 00:15:54.658 2.027 - 2.039: 0.4809% ( 66) 00:15:54.658 2.039 - 2.050: 10.9014% ( 1430) 00:15:54.658 2.050 - 2.062: 14.0567% ( 433) 00:15:54.658 2.062 - 2.074: 21.5186% ( 1024) 00:15:54.658 2.074 - 2.086: 53.5743% ( 4399) 00:15:54.658 2.086 - 2.098: 61.0144% ( 1021) 00:15:54.658 2.098 - 2.110: 63.4774% ( 338) 00:15:54.658 2.110 - 2.121: 66.1371% ( 365) 00:15:54.658 2.121 - 2.133: 66.7930% ( 90) 00:15:54.658 2.133 - 2.145: 72.0907% ( 727) 00:15:54.658 2.145 - 2.157: 80.1428% ( 1105) 00:15:54.658 2.157 - 2.169: 81.7824% ( 225) 00:15:54.658 2.169 - 2.181: 83.4366% ( 227) 00:15:54.658 2.181 - 2.193: 85.1563% ( 236) 00:15:54.658 2.193 - 2.204: 85.8850% ( 100) 00:15:54.658 2.204 - 2.216: 89.1569% ( 449) 00:15:54.658 2.216 - 2.228: 92.9461% ( 520) 00:15:54.658 2.228 - 2.240: 93.9372% ( 136) 00:15:54.658 2.240 - 2.252: 94.4181% ( 66) 00:15:54.658 2.252 - 2.264: 94.8262% ( 56) 00:15:54.658 2.264 - 2.276: 95.0375% ( 29) 00:15:54.658 2.276 - 2.287: 95.4748% ( 60) 00:15:54.658 2.287 - 2.299: 95.7152% ( 33) 00:15:54.658 2.299 - 2.311: 95.7735% ( 8) 00:15:54.658 2.311 - 2.323: 95.8755% ( 14) 00:15:54.658 2.323 - 2.335: 96.1233% ( 34) 00:15:54.658 2.335 - 2.347: 96.3346% ( 29) 00:15:54.658 2.347 - 2.359: 96.5387% ( 28) 00:15:54.658 2.359 - 2.370: 97.0852% ( 75) 00:15:54.658 2.370 - 2.382: 97.3038% ( 30) 00:15:54.658 2.382 - 2.394: 97.5005% ( 27) 00:15:54.658 2.394 - 2.406: 97.6973% ( 27) 00:15:54.658 2.406 - 2.418: 97.8430% ( 20) 00:15:54.658 2.418 - 2.430: 97.9742% ( 18) 00:15:54.658 2.430 - 2.441: 98.0835% ( 15) 00:15:54.658 2.441 - 2.453: 98.1418% ( 8) 00:15:54.658 2.453 - 2.465: 98.2001% ( 8) 00:15:54.658 2.465 - 2.477: 98.2293% ( 4) 00:15:54.658 2.477 - 2.489: 98.2657% ( 5) 00:15:54.658 2.489 - 2.501: 98.2875% ( 3) 00:15:54.658 2.501 - 2.513: 98.3021% ( 2) 00:15:54.658 2.513 - 2.524: 98.3167% ( 2) 00:15:54.658 2.524 - 2.536: 98.3386% ( 3) 00:15:54.658 2.572 - 2.584: 98.3531% ( 2) 00:15:54.658 2.584 - 2.596: 98.3604% ( 1) 00:15:54.658 2.596 - 2.607: 98.3750% ( 2) 00:15:54.658 2.631 - 2.643: 98.3823% ( 1) 00:15:54.658 2.667 - 2.679: 98.3896% ( 1) 00:15:54.658 2.690 - 2.702: 98.3969% ( 1) 00:15:54.658 2.761 - 2.773: 98.4041% ( 1) 00:15:54.658 3.022 - 3.034: 98.4114% ( 1) 00:15:54.658 3.176 - 3.200: 98.4187% ( 1) 00:15:54.658 3.319 - 3.342: 98.4260% ( 1) 00:15:54.658 3.366 - 3.390: 98.4333% ( 1) 00:15:54.658 3.413 - 3.437: 98.4479% ( 2) 00:15:54.658 3.437 - 3.461: 98.4551% ( 1) 00:15:54.658 3.461 - 3.484: 98.4624% ( 1) 00:15:54.658 3.532 - 3.556: 98.4697% ( 1) 00:15:54.658 3.556 - 3.579: 98.4770% ( 1) 00:15:54.658 3.579 - 3.603: 98.4843% ( 1) 00:15:54.658 3.603 - 3.627: 98.4989% ( 2) 00:15:54.658 3.627 - 3.650: 98.5062% ( 1) 00:15:54.658 3.650 - 3.674: 98.5134% ( 1) 00:15:54.658 3.698 - 3.721: 98.5207% ( 1) 00:15:54.658 3.721 - 3.745: 98.5426% ( 3) 00:15:54.658 3.745 - 3.769: 98.5499% ( 1) 00:15:54.658 3.769 - 3.793: 98.5572% ( 1) 00:15:54.658 3.840 - 3.864: 98.5645% ( 1) 00:15:54.658 3.864 - 3.887: 98.5790% ( 2) 00:15:54.658 3.887 - 3.911: 98.5863% ( 1) 00:15:54.658 3.911 - 3.935: 98.5936% ( 1) 00:15:54.658 4.243 - 4.267: 98.6009% ( 1) 00:15:54.658 5.191 - 5.215: 98.6082% ( 1) 00:15:54.658 5.381 - 5.404: 98.6155% ( 1) 00:15:54.658 5.404 - 5.428: 98.6228% ( 1) 00:15:54.658 5.476 - 5.499: 98.6300% ( 1) 00:15:54.658 5.499 - 5.523: 98.6373% ( 1) 00:15:54.658 5.570 - 5.594: 98.6446% ( 1) 00:15:54.658 5.641 - 5.665: 98.6519% ( 1) 00:15:54.658 5.689 - 5.713: 98.6592% ( 1) 00:15:54.658 5.736 - 5.760: 98.6665% ( 1) 00:15:54.658 5.855 - 5.879: 98.6738% ( 1) 00:15:54.658 5.950 - 5.973: 98.6883% ( 2) 00:15:54.658 5.997 - 6.021: 98.6956% ( 1) 00:15:54.658 6.068 - 6.116: 98.7029% ( 1) 00:15:54.658 6.210 - 6.258: 98.7102% ( 1) 00:15:54.658 6.258 - 6.305: 98.7248% ( 2) 00:15:54.658 6.305 - 6.353: 98.7321% ( 1) 00:15:54.658 6.353 - 6.400: 98.7393% ( 1) 00:15:54.658 6.400 - 6.447: 98.7466% ( 1) 00:15:54.658 6.447 - 6.495: 98.7539% ( 1) 00:15:54.658 6.495 - 6.542: 98.7612% ( 1) 00:15:54.658 6.542 - 6.590: 98.7685% ( 1) 00:15:54.658 6.637 - 6.684: 98.7831% ( 2) 00:15:54.658 6.969 - 7.016: 98.7904% ( 1) 00:15:54.658 7.348 - 7.396: 98.7976% ( 1) 00:15:54.658 7.490 - 7.538: 98.8049% ( 1) 00:15:54.658 7.538 - 7.585: 98.8122% ( 1) 00:15:54.658 11.473 - 11.520: 98.8195% ( 1) 00:15:54.658 14.507 - 14.601: 98.8268% ( 1) 00:15:54.658 15.550 - 15.644: 98.8341% ( 1) 00:15:54.658 15.739 - 15.834: 98.8559% ( 3) 00:15:54.658 15.834 - 15.929: 98.8632% ( 1) 00:15:54.658 15.929 - 16.024: 98.8778% ( 2) 00:15:54.658 16.024 - 16.119: 98.8997% ( 3) 00:15:54.658 16.119 - 16.213: 98.9361% ( 5) 00:15:54.658 16.213 - 16.308: 98.9652% ( 4) 00:15:54.658 16.308 - 16.403: 98.9944% ( 4) 00:15:54.658 16.403 - 16.498: 99.0308% ( 5) 00:15:54.658 16.498 - 16.593: 99.0600% ( 4) 00:15:54.658 16.593 - 16.687: 99.1110% ( 7) 00:15:54.658 16.687 - 16.782: 99.1766% ( 9) 00:15:54.658 16.782 - 16.877: 99.2349% ( 8) 00:15:54.658 16.877 - 16.972: 99.2494% ( 2) 00:15:54.659 16.972 - 17.067: 99.2640% ( 2) 00:15:54.659 17.067 - 17.161: 99.2786% ( 2) 00:15:54.659 17.161 - 17.256: 99.2932% ( 2) 00:15:54.659 17.256 - 17.351: 99.3150% ( 3) 00:15:54.659 17.351 - 17.446: 99.3223% ( 1) 00:15:54.659 17.636 - 17.730: 99.3442% ( 3) 00:15:54.659 17.825 - 17.920: 99.3515% ( 1) 00:15:54.659 17.920 - 18.015: 99.3587% ( 1) 00:15:54.659 18.110 - 18.204: 99.3660% ( 1) 00:15:54.659 18.204 - 18.299: 99.3806% ( 2) 00:15:54.659 18.584 - 18.679: 99.3879% ( 1) 00:15:54.659 21.523 - 21.618: 99.3952% ( 1) 00:15:54.659 35.840 - 36.030: 99.4025% ( 1) 00:15:54.659 3446.708 - 3470.981: 99.4098% ( 1) 00:15:54.659 3980.705 - 4004.978: 99.8543% ( 61) 00:15:54.659 4004.978 - 4029.250: 99.9927% ( 19) 00:15:54.659 4029.250 - 4053.523: 100.0000% ( 1) 00:15:54.659 00:15:54.659 03:10:56 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:15:54.659 03:10:56 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:54.659 03:10:56 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:15:54.659 03:10:56 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:15:54.659 03:10:56 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:54.659 [ 00:15:54.659 { 00:15:54.659 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:54.659 "subtype": "Discovery", 00:15:54.659 "listen_addresses": [], 00:15:54.659 "allow_any_host": true, 00:15:54.659 "hosts": [] 00:15:54.659 }, 00:15:54.659 { 00:15:54.659 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:54.659 "subtype": "NVMe", 00:15:54.659 "listen_addresses": [ 00:15:54.659 { 00:15:54.659 "transport": "VFIOUSER", 00:15:54.659 "trtype": "VFIOUSER", 00:15:54.659 "adrfam": "IPv4", 00:15:54.659 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:54.659 "trsvcid": "0" 00:15:54.659 } 00:15:54.659 ], 00:15:54.659 "allow_any_host": true, 00:15:54.659 "hosts": [], 00:15:54.659 "serial_number": "SPDK1", 00:15:54.659 "model_number": "SPDK bdev Controller", 00:15:54.659 "max_namespaces": 32, 00:15:54.659 "min_cntlid": 1, 00:15:54.659 "max_cntlid": 65519, 00:15:54.659 "namespaces": [ 00:15:54.659 { 00:15:54.659 "nsid": 1, 00:15:54.659 "bdev_name": "Malloc1", 00:15:54.659 "name": "Malloc1", 00:15:54.659 "nguid": "FF17EB7922814DDEA356890AFAFDB547", 00:15:54.659 "uuid": "ff17eb79-2281-4dde-a356-890afafdb547" 00:15:54.659 }, 00:15:54.659 { 00:15:54.659 "nsid": 2, 00:15:54.659 "bdev_name": "Malloc3", 00:15:54.659 "name": "Malloc3", 00:15:54.659 "nguid": "225A846DED764A959D65496C15BD67F0", 00:15:54.659 "uuid": "225a846d-ed76-4a95-9d65-496c15bd67f0" 00:15:54.659 } 00:15:54.659 ] 00:15:54.659 }, 00:15:54.659 { 00:15:54.659 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:54.659 "subtype": "NVMe", 00:15:54.659 "listen_addresses": [ 00:15:54.659 { 00:15:54.659 "transport": "VFIOUSER", 00:15:54.659 "trtype": "VFIOUSER", 00:15:54.659 "adrfam": "IPv4", 00:15:54.659 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:54.659 "trsvcid": "0" 00:15:54.659 } 00:15:54.659 ], 00:15:54.659 "allow_any_host": true, 00:15:54.659 "hosts": [], 00:15:54.659 "serial_number": "SPDK2", 00:15:54.659 "model_number": "SPDK bdev Controller", 00:15:54.659 "max_namespaces": 32, 00:15:54.659 "min_cntlid": 1, 00:15:54.659 "max_cntlid": 65519, 00:15:54.659 "namespaces": [ 00:15:54.659 { 00:15:54.659 "nsid": 1, 00:15:54.659 "bdev_name": "Malloc2", 00:15:54.659 "name": "Malloc2", 00:15:54.659 "nguid": "6E2EE201A4C642D0AEA60B34F97E1D27", 00:15:54.659 "uuid": "6e2ee201-a4c6-42d0-aea6-0b34f97e1d27" 00:15:54.659 } 00:15:54.659 ] 00:15:54.659 } 00:15:54.659 ] 00:15:54.659 03:10:57 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:54.659 03:10:57 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2433539 00:15:54.659 03:10:57 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:15:54.659 03:10:57 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:54.659 03:10:57 -- common/autotest_common.sh@1254 -- # local i=0 00:15:54.659 03:10:57 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:54.659 03:10:57 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:54.659 03:10:57 -- common/autotest_common.sh@1265 -- # return 0 00:15:54.659 03:10:57 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:54.659 03:10:57 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:15:54.917 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.917 Malloc4 00:15:55.176 03:10:57 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:15:55.434 03:10:57 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:55.434 Asynchronous Event Request test 00:15:55.434 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:15:55.434 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:15:55.434 Registering asynchronous event callbacks... 00:15:55.434 Starting namespace attribute notice tests for all controllers... 00:15:55.434 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:55.434 aer_cb - Changed Namespace 00:15:55.434 Cleaning up... 00:15:55.434 [ 00:15:55.434 { 00:15:55.434 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:55.434 "subtype": "Discovery", 00:15:55.434 "listen_addresses": [], 00:15:55.434 "allow_any_host": true, 00:15:55.434 "hosts": [] 00:15:55.434 }, 00:15:55.434 { 00:15:55.434 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:55.434 "subtype": "NVMe", 00:15:55.434 "listen_addresses": [ 00:15:55.434 { 00:15:55.434 "transport": "VFIOUSER", 00:15:55.434 "trtype": "VFIOUSER", 00:15:55.434 "adrfam": "IPv4", 00:15:55.434 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:55.434 "trsvcid": "0" 00:15:55.434 } 00:15:55.434 ], 00:15:55.434 "allow_any_host": true, 00:15:55.434 "hosts": [], 00:15:55.434 "serial_number": "SPDK1", 00:15:55.434 "model_number": "SPDK bdev Controller", 00:15:55.434 "max_namespaces": 32, 00:15:55.434 "min_cntlid": 1, 00:15:55.434 "max_cntlid": 65519, 00:15:55.434 "namespaces": [ 00:15:55.434 { 00:15:55.434 "nsid": 1, 00:15:55.434 "bdev_name": "Malloc1", 00:15:55.434 "name": "Malloc1", 00:15:55.434 "nguid": "FF17EB7922814DDEA356890AFAFDB547", 00:15:55.434 "uuid": "ff17eb79-2281-4dde-a356-890afafdb547" 00:15:55.434 }, 00:15:55.434 { 00:15:55.434 "nsid": 2, 00:15:55.434 "bdev_name": "Malloc3", 00:15:55.434 "name": "Malloc3", 00:15:55.434 "nguid": "225A846DED764A959D65496C15BD67F0", 00:15:55.434 "uuid": "225a846d-ed76-4a95-9d65-496c15bd67f0" 00:15:55.434 } 00:15:55.434 ] 00:15:55.434 }, 00:15:55.434 { 00:15:55.434 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:55.434 "subtype": "NVMe", 00:15:55.434 "listen_addresses": [ 00:15:55.434 { 00:15:55.434 "transport": "VFIOUSER", 00:15:55.434 "trtype": "VFIOUSER", 00:15:55.434 "adrfam": "IPv4", 00:15:55.434 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:55.434 "trsvcid": "0" 00:15:55.434 } 00:15:55.434 ], 00:15:55.435 "allow_any_host": true, 00:15:55.435 "hosts": [], 00:15:55.435 "serial_number": "SPDK2", 00:15:55.435 "model_number": "SPDK bdev Controller", 00:15:55.435 "max_namespaces": 32, 00:15:55.435 "min_cntlid": 1, 00:15:55.435 "max_cntlid": 65519, 00:15:55.435 "namespaces": [ 00:15:55.435 { 00:15:55.435 "nsid": 1, 00:15:55.435 "bdev_name": "Malloc2", 00:15:55.435 "name": "Malloc2", 00:15:55.435 "nguid": "6E2EE201A4C642D0AEA60B34F97E1D27", 00:15:55.435 "uuid": "6e2ee201-a4c6-42d0-aea6-0b34f97e1d27" 00:15:55.435 }, 00:15:55.435 { 00:15:55.435 "nsid": 2, 00:15:55.435 "bdev_name": "Malloc4", 00:15:55.435 "name": "Malloc4", 00:15:55.435 "nguid": "61A7182E96574887915B8F9EFFCEA4D7", 00:15:55.435 "uuid": "61a7182e-9657-4887-915b-8f9effcea4d7" 00:15:55.435 } 00:15:55.435 ] 00:15:55.435 } 00:15:55.435 ] 00:15:55.703 03:10:58 -- target/nvmf_vfio_user.sh@44 -- # wait 2433539 00:15:55.703 03:10:58 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:15:55.703 03:10:58 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2427769 00:15:55.703 03:10:58 -- common/autotest_common.sh@936 -- # '[' -z 2427769 ']' 00:15:55.703 03:10:58 -- common/autotest_common.sh@940 -- # kill -0 2427769 00:15:55.703 03:10:58 -- common/autotest_common.sh@941 -- # uname 00:15:55.703 03:10:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:55.703 03:10:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2427769 00:15:55.703 03:10:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:55.703 03:10:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:55.703 03:10:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2427769' 00:15:55.703 killing process with pid 2427769 00:15:55.703 03:10:58 -- common/autotest_common.sh@955 -- # kill 2427769 00:15:55.703 [2024-11-27 03:10:58.101050] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:15:55.703 03:10:58 -- common/autotest_common.sh@960 -- # wait 2427769 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2433685 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2433685' 00:15:55.994 Process pid: 2433685 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:55.994 03:10:58 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2433685 00:15:55.994 03:10:58 -- common/autotest_common.sh@829 -- # '[' -z 2433685 ']' 00:15:55.994 03:10:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:55.994 03:10:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:55.994 03:10:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:55.994 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:55.994 03:10:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:55.994 03:10:58 -- common/autotest_common.sh@10 -- # set +x 00:15:55.994 [2024-11-27 03:10:58.481385] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:15:55.994 [2024-11-27 03:10:58.482416] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:55.994 [2024-11-27 03:10:58.482487] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:55.994 EAL: No free 2048 kB hugepages reported on node 1 00:15:55.994 [2024-11-27 03:10:58.541627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:56.283 [2024-11-27 03:10:58.629471] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:56.283 [2024-11-27 03:10:58.629631] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:56.283 [2024-11-27 03:10:58.629649] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:56.283 [2024-11-27 03:10:58.629662] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:56.283 [2024-11-27 03:10:58.629713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:56.283 [2024-11-27 03:10:58.629772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:56.283 [2024-11-27 03:10:58.629838] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:56.283 [2024-11-27 03:10:58.629841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:56.283 [2024-11-27 03:10:58.717766] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:15:56.283 [2024-11-27 03:10:58.718032] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:15:56.283 [2024-11-27 03:10:58.718287] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:15:56.283 [2024-11-27 03:10:58.718996] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:15:56.283 [2024-11-27 03:10:58.719104] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:15:57.216 03:10:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:57.216 03:10:59 -- common/autotest_common.sh@862 -- # return 0 00:15:57.216 03:10:59 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:58.150 03:11:00 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:15:58.408 03:11:00 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:58.408 03:11:00 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:58.408 03:11:00 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:58.408 03:11:00 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:58.408 03:11:00 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:58.666 Malloc1 00:15:58.666 03:11:01 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:58.925 03:11:01 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:59.182 03:11:01 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:59.440 03:11:01 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:59.440 03:11:01 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:59.440 03:11:01 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:59.698 Malloc2 00:15:59.698 03:11:02 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:59.955 03:11:02 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:00.214 03:11:02 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:00.472 03:11:02 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:00.472 03:11:02 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2433685 00:16:00.472 03:11:02 -- common/autotest_common.sh@936 -- # '[' -z 2433685 ']' 00:16:00.472 03:11:02 -- common/autotest_common.sh@940 -- # kill -0 2433685 00:16:00.472 03:11:02 -- common/autotest_common.sh@941 -- # uname 00:16:00.472 03:11:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:00.472 03:11:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2433685 00:16:00.472 03:11:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:00.472 03:11:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:00.472 03:11:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2433685' 00:16:00.472 killing process with pid 2433685 00:16:00.472 03:11:03 -- common/autotest_common.sh@955 -- # kill 2433685 00:16:00.472 03:11:03 -- common/autotest_common.sh@960 -- # wait 2433685 00:16:00.731 03:11:03 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:00.731 03:11:03 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:00.731 00:16:00.731 real 0m54.270s 00:16:00.731 user 3m34.480s 00:16:00.731 sys 0m4.566s 00:16:00.731 03:11:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:00.731 03:11:03 -- common/autotest_common.sh@10 -- # set +x 00:16:00.731 ************************************ 00:16:00.731 END TEST nvmf_vfio_user 00:16:00.731 ************************************ 00:16:00.731 03:11:03 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:00.731 03:11:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:00.731 03:11:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:00.731 03:11:03 -- common/autotest_common.sh@10 -- # set +x 00:16:00.731 ************************************ 00:16:00.731 START TEST nvmf_vfio_user_nvme_compliance 00:16:00.731 ************************************ 00:16:00.731 03:11:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:00.990 * Looking for test storage... 00:16:00.990 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:00.990 03:11:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:00.990 03:11:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:00.990 03:11:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:00.990 03:11:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:00.990 03:11:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:00.990 03:11:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:00.990 03:11:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:00.990 03:11:03 -- scripts/common.sh@335 -- # IFS=.-: 00:16:00.990 03:11:03 -- scripts/common.sh@335 -- # read -ra ver1 00:16:00.991 03:11:03 -- scripts/common.sh@336 -- # IFS=.-: 00:16:00.991 03:11:03 -- scripts/common.sh@336 -- # read -ra ver2 00:16:00.991 03:11:03 -- scripts/common.sh@337 -- # local 'op=<' 00:16:00.991 03:11:03 -- scripts/common.sh@339 -- # ver1_l=2 00:16:00.991 03:11:03 -- scripts/common.sh@340 -- # ver2_l=1 00:16:00.991 03:11:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:00.991 03:11:03 -- scripts/common.sh@343 -- # case "$op" in 00:16:00.991 03:11:03 -- scripts/common.sh@344 -- # : 1 00:16:00.991 03:11:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:00.991 03:11:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:00.991 03:11:03 -- scripts/common.sh@364 -- # decimal 1 00:16:00.991 03:11:03 -- scripts/common.sh@352 -- # local d=1 00:16:00.991 03:11:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:00.991 03:11:03 -- scripts/common.sh@354 -- # echo 1 00:16:00.991 03:11:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:00.991 03:11:03 -- scripts/common.sh@365 -- # decimal 2 00:16:00.991 03:11:03 -- scripts/common.sh@352 -- # local d=2 00:16:00.991 03:11:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:00.991 03:11:03 -- scripts/common.sh@354 -- # echo 2 00:16:00.991 03:11:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:00.991 03:11:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:00.991 03:11:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:00.991 03:11:03 -- scripts/common.sh@367 -- # return 0 00:16:00.991 03:11:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:00.991 03:11:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:00.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.991 --rc genhtml_branch_coverage=1 00:16:00.991 --rc genhtml_function_coverage=1 00:16:00.991 --rc genhtml_legend=1 00:16:00.991 --rc geninfo_all_blocks=1 00:16:00.991 --rc geninfo_unexecuted_blocks=1 00:16:00.991 00:16:00.991 ' 00:16:00.991 03:11:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:00.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.991 --rc genhtml_branch_coverage=1 00:16:00.991 --rc genhtml_function_coverage=1 00:16:00.991 --rc genhtml_legend=1 00:16:00.991 --rc geninfo_all_blocks=1 00:16:00.991 --rc geninfo_unexecuted_blocks=1 00:16:00.991 00:16:00.991 ' 00:16:00.991 03:11:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:00.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.991 --rc genhtml_branch_coverage=1 00:16:00.991 --rc genhtml_function_coverage=1 00:16:00.991 --rc genhtml_legend=1 00:16:00.991 --rc geninfo_all_blocks=1 00:16:00.991 --rc geninfo_unexecuted_blocks=1 00:16:00.991 00:16:00.991 ' 00:16:00.991 03:11:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:00.991 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.991 --rc genhtml_branch_coverage=1 00:16:00.991 --rc genhtml_function_coverage=1 00:16:00.991 --rc genhtml_legend=1 00:16:00.991 --rc geninfo_all_blocks=1 00:16:00.991 --rc geninfo_unexecuted_blocks=1 00:16:00.991 00:16:00.991 ' 00:16:00.991 03:11:03 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:00.991 03:11:03 -- nvmf/common.sh@7 -- # uname -s 00:16:00.991 03:11:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:00.991 03:11:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:00.991 03:11:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:00.991 03:11:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:00.991 03:11:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:00.991 03:11:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:00.991 03:11:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:00.991 03:11:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:00.991 03:11:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:00.991 03:11:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:00.991 03:11:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.991 03:11:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.991 03:11:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:00.991 03:11:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:00.991 03:11:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:00.991 03:11:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:00.991 03:11:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:00.991 03:11:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:00.991 03:11:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:00.991 03:11:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.991 03:11:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.991 03:11:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.991 03:11:03 -- paths/export.sh@5 -- # export PATH 00:16:00.991 03:11:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.991 03:11:03 -- nvmf/common.sh@46 -- # : 0 00:16:00.991 03:11:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:00.991 03:11:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:00.991 03:11:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:00.991 03:11:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:00.991 03:11:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:00.991 03:11:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:00.991 03:11:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:00.991 03:11:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:00.991 03:11:03 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:00.991 03:11:03 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:00.991 03:11:03 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:00.991 03:11:03 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:00.991 03:11:03 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:00.991 03:11:03 -- compliance/compliance.sh@20 -- # nvmfpid=2434442 00:16:00.991 03:11:03 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:00.991 03:11:03 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2434442' 00:16:00.991 Process pid: 2434442 00:16:00.991 03:11:03 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:00.991 03:11:03 -- compliance/compliance.sh@24 -- # waitforlisten 2434442 00:16:00.991 03:11:03 -- common/autotest_common.sh@829 -- # '[' -z 2434442 ']' 00:16:00.991 03:11:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:00.991 03:11:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:00.991 03:11:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:00.991 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:00.991 03:11:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:00.991 03:11:03 -- common/autotest_common.sh@10 -- # set +x 00:16:00.991 [2024-11-27 03:11:03.500087] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:00.991 [2024-11-27 03:11:03.500174] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:00.991 EAL: No free 2048 kB hugepages reported on node 1 00:16:00.991 [2024-11-27 03:11:03.558611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:01.249 [2024-11-27 03:11:03.644382] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:01.249 [2024-11-27 03:11:03.644550] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:01.249 [2024-11-27 03:11:03.644571] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:01.249 [2024-11-27 03:11:03.644584] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:01.249 [2024-11-27 03:11:03.644648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:01.249 [2024-11-27 03:11:03.644706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:01.249 [2024-11-27 03:11:03.644709] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:02.183 03:11:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:02.183 03:11:04 -- common/autotest_common.sh@862 -- # return 0 00:16:02.183 03:11:04 -- compliance/compliance.sh@26 -- # sleep 1 00:16:03.117 03:11:05 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:03.117 03:11:05 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:03.117 03:11:05 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:03.117 03:11:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.117 03:11:05 -- common/autotest_common.sh@10 -- # set +x 00:16:03.117 03:11:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.117 03:11:05 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:03.117 03:11:05 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:03.117 03:11:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.117 03:11:05 -- common/autotest_common.sh@10 -- # set +x 00:16:03.117 malloc0 00:16:03.117 03:11:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.117 03:11:05 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:03.117 03:11:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.117 03:11:05 -- common/autotest_common.sh@10 -- # set +x 00:16:03.117 03:11:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.117 03:11:05 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:03.117 03:11:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.117 03:11:05 -- common/autotest_common.sh@10 -- # set +x 00:16:03.117 03:11:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.117 03:11:05 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:03.117 03:11:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:03.117 03:11:05 -- common/autotest_common.sh@10 -- # set +x 00:16:03.117 03:11:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:03.117 03:11:05 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:03.117 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.117 00:16:03.117 00:16:03.117 CUnit - A unit testing framework for C - Version 2.1-3 00:16:03.117 http://cunit.sourceforge.net/ 00:16:03.117 00:16:03.117 00:16:03.117 Suite: nvme_compliance 00:16:03.117 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-27 03:11:05.686478] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:03.117 [2024-11-27 03:11:05.686541] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:03.117 [2024-11-27 03:11:05.686556] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:03.117 passed 00:16:03.374 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:03.374 Test: admin_identify_ns ...[2024-11-27 03:11:05.923546] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:03.374 [2024-11-27 03:11:05.931543] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:03.374 passed 00:16:03.632 Test: admin_get_features_mandatory_features ...passed 00:16:03.632 Test: admin_get_features_optional_features ...passed 00:16:03.890 Test: admin_set_features_number_of_queues ...passed 00:16:03.890 Test: admin_get_log_page_mandatory_logs ...passed 00:16:04.148 Test: admin_get_log_page_with_lpo ...[2024-11-27 03:11:06.554542] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:04.148 passed 00:16:04.148 Test: fabric_property_get ...passed 00:16:04.148 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-27 03:11:06.741341] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:04.406 passed 00:16:04.406 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-27 03:11:06.909550] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:04.406 [2024-11-27 03:11:06.925547] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:04.406 passed 00:16:04.406 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-27 03:11:07.016641] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:04.664 passed 00:16:04.664 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-27 03:11:07.179539] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:04.664 [2024-11-27 03:11:07.203551] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:04.664 passed 00:16:04.921 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-27 03:11:07.293641] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:04.921 [2024-11-27 03:11:07.293703] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:04.921 passed 00:16:04.921 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-27 03:11:07.472539] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:04.921 [2024-11-27 03:11:07.480552] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:04.921 [2024-11-27 03:11:07.488534] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:04.921 [2024-11-27 03:11:07.496537] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:05.178 passed 00:16:05.178 Test: admin_create_io_sq_verify_pc ...[2024-11-27 03:11:07.626549] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:05.178 passed 00:16:06.547 Test: admin_create_io_qp_max_qps ...[2024-11-27 03:11:08.827541] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:06.809 passed 00:16:07.069 Test: admin_create_io_sq_shared_cq ...[2024-11-27 03:11:09.434535] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:07.069 passed 00:16:07.069 00:16:07.069 Run Summary: Type Total Ran Passed Failed Inactive 00:16:07.069 suites 1 1 n/a 0 0 00:16:07.069 tests 18 18 18 0 0 00:16:07.069 asserts 360 360 360 0 n/a 00:16:07.069 00:16:07.069 Elapsed time = 1.569 seconds 00:16:07.069 03:11:09 -- compliance/compliance.sh@42 -- # killprocess 2434442 00:16:07.069 03:11:09 -- common/autotest_common.sh@936 -- # '[' -z 2434442 ']' 00:16:07.069 03:11:09 -- common/autotest_common.sh@940 -- # kill -0 2434442 00:16:07.069 03:11:09 -- common/autotest_common.sh@941 -- # uname 00:16:07.069 03:11:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:07.069 03:11:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2434442 00:16:07.069 03:11:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:07.069 03:11:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:07.069 03:11:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2434442' 00:16:07.069 killing process with pid 2434442 00:16:07.069 03:11:09 -- common/autotest_common.sh@955 -- # kill 2434442 00:16:07.069 03:11:09 -- common/autotest_common.sh@960 -- # wait 2434442 00:16:07.327 03:11:09 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:07.327 03:11:09 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:07.327 00:16:07.327 real 0m6.511s 00:16:07.327 user 0m18.551s 00:16:07.327 sys 0m0.571s 00:16:07.327 03:11:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:07.327 03:11:09 -- common/autotest_common.sh@10 -- # set +x 00:16:07.327 ************************************ 00:16:07.327 END TEST nvmf_vfio_user_nvme_compliance 00:16:07.327 ************************************ 00:16:07.327 03:11:09 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:07.327 03:11:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:07.327 03:11:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:07.327 03:11:09 -- common/autotest_common.sh@10 -- # set +x 00:16:07.327 ************************************ 00:16:07.327 START TEST nvmf_vfio_user_fuzz 00:16:07.327 ************************************ 00:16:07.327 03:11:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:07.327 * Looking for test storage... 00:16:07.327 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:07.327 03:11:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:07.327 03:11:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:07.327 03:11:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:07.586 03:11:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:07.586 03:11:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:07.586 03:11:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:07.586 03:11:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:07.586 03:11:09 -- scripts/common.sh@335 -- # IFS=.-: 00:16:07.586 03:11:09 -- scripts/common.sh@335 -- # read -ra ver1 00:16:07.586 03:11:09 -- scripts/common.sh@336 -- # IFS=.-: 00:16:07.586 03:11:09 -- scripts/common.sh@336 -- # read -ra ver2 00:16:07.586 03:11:09 -- scripts/common.sh@337 -- # local 'op=<' 00:16:07.586 03:11:09 -- scripts/common.sh@339 -- # ver1_l=2 00:16:07.586 03:11:09 -- scripts/common.sh@340 -- # ver2_l=1 00:16:07.586 03:11:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:07.586 03:11:09 -- scripts/common.sh@343 -- # case "$op" in 00:16:07.586 03:11:09 -- scripts/common.sh@344 -- # : 1 00:16:07.586 03:11:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:07.586 03:11:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:07.586 03:11:09 -- scripts/common.sh@364 -- # decimal 1 00:16:07.586 03:11:09 -- scripts/common.sh@352 -- # local d=1 00:16:07.586 03:11:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:07.586 03:11:09 -- scripts/common.sh@354 -- # echo 1 00:16:07.586 03:11:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:07.586 03:11:09 -- scripts/common.sh@365 -- # decimal 2 00:16:07.586 03:11:09 -- scripts/common.sh@352 -- # local d=2 00:16:07.586 03:11:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:07.586 03:11:09 -- scripts/common.sh@354 -- # echo 2 00:16:07.586 03:11:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:07.586 03:11:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:07.586 03:11:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:07.586 03:11:09 -- scripts/common.sh@367 -- # return 0 00:16:07.586 03:11:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:07.586 03:11:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:07.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.586 --rc genhtml_branch_coverage=1 00:16:07.586 --rc genhtml_function_coverage=1 00:16:07.586 --rc genhtml_legend=1 00:16:07.586 --rc geninfo_all_blocks=1 00:16:07.586 --rc geninfo_unexecuted_blocks=1 00:16:07.586 00:16:07.586 ' 00:16:07.586 03:11:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:07.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.586 --rc genhtml_branch_coverage=1 00:16:07.586 --rc genhtml_function_coverage=1 00:16:07.586 --rc genhtml_legend=1 00:16:07.586 --rc geninfo_all_blocks=1 00:16:07.586 --rc geninfo_unexecuted_blocks=1 00:16:07.586 00:16:07.586 ' 00:16:07.586 03:11:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:07.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.586 --rc genhtml_branch_coverage=1 00:16:07.586 --rc genhtml_function_coverage=1 00:16:07.586 --rc genhtml_legend=1 00:16:07.586 --rc geninfo_all_blocks=1 00:16:07.586 --rc geninfo_unexecuted_blocks=1 00:16:07.586 00:16:07.586 ' 00:16:07.586 03:11:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:07.586 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:07.586 --rc genhtml_branch_coverage=1 00:16:07.586 --rc genhtml_function_coverage=1 00:16:07.586 --rc genhtml_legend=1 00:16:07.586 --rc geninfo_all_blocks=1 00:16:07.586 --rc geninfo_unexecuted_blocks=1 00:16:07.586 00:16:07.586 ' 00:16:07.586 03:11:09 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:07.586 03:11:09 -- nvmf/common.sh@7 -- # uname -s 00:16:07.586 03:11:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:07.586 03:11:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:07.586 03:11:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:07.586 03:11:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:07.586 03:11:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:07.586 03:11:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:07.586 03:11:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:07.586 03:11:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:07.586 03:11:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:07.586 03:11:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:07.586 03:11:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:07.586 03:11:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:07.586 03:11:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:07.586 03:11:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:07.586 03:11:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:07.586 03:11:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:07.586 03:11:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:07.586 03:11:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:07.586 03:11:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:07.586 03:11:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.586 03:11:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.586 03:11:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.586 03:11:10 -- paths/export.sh@5 -- # export PATH 00:16:07.586 03:11:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:07.586 03:11:10 -- nvmf/common.sh@46 -- # : 0 00:16:07.586 03:11:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:07.586 03:11:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:07.586 03:11:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:07.586 03:11:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:07.586 03:11:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:07.586 03:11:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:07.586 03:11:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:07.586 03:11:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2435198 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2435198' 00:16:07.586 Process pid: 2435198 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:07.586 03:11:10 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2435198 00:16:07.586 03:11:10 -- common/autotest_common.sh@829 -- # '[' -z 2435198 ']' 00:16:07.586 03:11:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:07.586 03:11:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:07.586 03:11:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:07.586 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:07.586 03:11:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:07.586 03:11:10 -- common/autotest_common.sh@10 -- # set +x 00:16:08.519 03:11:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:08.519 03:11:11 -- common/autotest_common.sh@862 -- # return 0 00:16:08.519 03:11:11 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:09.452 03:11:12 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:09.452 03:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.452 03:11:12 -- common/autotest_common.sh@10 -- # set +x 00:16:09.452 03:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.452 03:11:12 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:09.452 03:11:12 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:09.452 03:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.452 03:11:12 -- common/autotest_common.sh@10 -- # set +x 00:16:09.710 malloc0 00:16:09.710 03:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.711 03:11:12 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:09.711 03:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.711 03:11:12 -- common/autotest_common.sh@10 -- # set +x 00:16:09.711 03:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.711 03:11:12 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:09.711 03:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.711 03:11:12 -- common/autotest_common.sh@10 -- # set +x 00:16:09.711 03:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.711 03:11:12 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:09.711 03:11:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:09.711 03:11:12 -- common/autotest_common.sh@10 -- # set +x 00:16:09.711 03:11:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:09.711 03:11:12 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:09.711 03:11:12 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:41.768 Fuzzing completed. Shutting down the fuzz application 00:16:41.768 00:16:41.768 Dumping successful admin opcodes: 00:16:41.768 8, 9, 10, 24, 00:16:41.768 Dumping successful io opcodes: 00:16:41.768 0, 00:16:41.768 NS: 0x200003a1ef00 I/O qp, Total commands completed: 658640, total successful commands: 2562, random_seed: 2848192064 00:16:41.769 NS: 0x200003a1ef00 admin qp, Total commands completed: 164395, total successful commands: 1326, random_seed: 120886208 00:16:41.769 03:11:42 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:41.769 03:11:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:41.769 03:11:42 -- common/autotest_common.sh@10 -- # set +x 00:16:41.769 03:11:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:41.769 03:11:42 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2435198 00:16:41.769 03:11:42 -- common/autotest_common.sh@936 -- # '[' -z 2435198 ']' 00:16:41.769 03:11:42 -- common/autotest_common.sh@940 -- # kill -0 2435198 00:16:41.769 03:11:42 -- common/autotest_common.sh@941 -- # uname 00:16:41.769 03:11:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:41.769 03:11:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2435198 00:16:41.769 03:11:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:41.769 03:11:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:41.769 03:11:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2435198' 00:16:41.769 killing process with pid 2435198 00:16:41.769 03:11:42 -- common/autotest_common.sh@955 -- # kill 2435198 00:16:41.769 03:11:42 -- common/autotest_common.sh@960 -- # wait 2435198 00:16:41.769 03:11:42 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:41.769 03:11:42 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:41.769 00:16:41.769 real 0m33.086s 00:16:41.769 user 0m36.961s 00:16:41.769 sys 0m22.996s 00:16:41.769 03:11:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:41.769 03:11:42 -- common/autotest_common.sh@10 -- # set +x 00:16:41.769 ************************************ 00:16:41.769 END TEST nvmf_vfio_user_fuzz 00:16:41.769 ************************************ 00:16:41.769 03:11:42 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:41.769 03:11:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:41.769 03:11:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:41.769 03:11:42 -- common/autotest_common.sh@10 -- # set +x 00:16:41.769 ************************************ 00:16:41.769 START TEST nvmf_host_management 00:16:41.769 ************************************ 00:16:41.769 03:11:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:41.769 * Looking for test storage... 00:16:41.769 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:41.769 03:11:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:41.769 03:11:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:41.769 03:11:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:41.769 03:11:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:41.769 03:11:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:41.769 03:11:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:41.769 03:11:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:41.769 03:11:43 -- scripts/common.sh@335 -- # IFS=.-: 00:16:41.769 03:11:43 -- scripts/common.sh@335 -- # read -ra ver1 00:16:41.769 03:11:43 -- scripts/common.sh@336 -- # IFS=.-: 00:16:41.769 03:11:43 -- scripts/common.sh@336 -- # read -ra ver2 00:16:41.769 03:11:43 -- scripts/common.sh@337 -- # local 'op=<' 00:16:41.769 03:11:43 -- scripts/common.sh@339 -- # ver1_l=2 00:16:41.769 03:11:43 -- scripts/common.sh@340 -- # ver2_l=1 00:16:41.769 03:11:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:41.769 03:11:43 -- scripts/common.sh@343 -- # case "$op" in 00:16:41.769 03:11:43 -- scripts/common.sh@344 -- # : 1 00:16:41.769 03:11:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:41.769 03:11:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:41.769 03:11:43 -- scripts/common.sh@364 -- # decimal 1 00:16:41.769 03:11:43 -- scripts/common.sh@352 -- # local d=1 00:16:41.769 03:11:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:41.769 03:11:43 -- scripts/common.sh@354 -- # echo 1 00:16:41.769 03:11:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:41.769 03:11:43 -- scripts/common.sh@365 -- # decimal 2 00:16:41.769 03:11:43 -- scripts/common.sh@352 -- # local d=2 00:16:41.769 03:11:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:41.769 03:11:43 -- scripts/common.sh@354 -- # echo 2 00:16:41.769 03:11:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:41.769 03:11:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:41.769 03:11:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:41.769 03:11:43 -- scripts/common.sh@367 -- # return 0 00:16:41.769 03:11:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:41.769 03:11:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:41.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.769 --rc genhtml_branch_coverage=1 00:16:41.769 --rc genhtml_function_coverage=1 00:16:41.769 --rc genhtml_legend=1 00:16:41.769 --rc geninfo_all_blocks=1 00:16:41.769 --rc geninfo_unexecuted_blocks=1 00:16:41.769 00:16:41.769 ' 00:16:41.769 03:11:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:41.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.769 --rc genhtml_branch_coverage=1 00:16:41.769 --rc genhtml_function_coverage=1 00:16:41.769 --rc genhtml_legend=1 00:16:41.769 --rc geninfo_all_blocks=1 00:16:41.769 --rc geninfo_unexecuted_blocks=1 00:16:41.769 00:16:41.769 ' 00:16:41.769 03:11:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:41.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.769 --rc genhtml_branch_coverage=1 00:16:41.769 --rc genhtml_function_coverage=1 00:16:41.769 --rc genhtml_legend=1 00:16:41.769 --rc geninfo_all_blocks=1 00:16:41.769 --rc geninfo_unexecuted_blocks=1 00:16:41.769 00:16:41.769 ' 00:16:41.769 03:11:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:41.769 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.769 --rc genhtml_branch_coverage=1 00:16:41.769 --rc genhtml_function_coverage=1 00:16:41.769 --rc genhtml_legend=1 00:16:41.769 --rc geninfo_all_blocks=1 00:16:41.769 --rc geninfo_unexecuted_blocks=1 00:16:41.769 00:16:41.769 ' 00:16:41.769 03:11:43 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:41.769 03:11:43 -- nvmf/common.sh@7 -- # uname -s 00:16:41.769 03:11:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:41.769 03:11:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:41.769 03:11:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:41.769 03:11:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:41.769 03:11:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:41.769 03:11:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:41.769 03:11:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:41.769 03:11:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:41.769 03:11:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:41.769 03:11:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:41.769 03:11:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.769 03:11:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.769 03:11:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:41.769 03:11:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:41.769 03:11:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:41.769 03:11:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:41.769 03:11:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:41.769 03:11:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:41.769 03:11:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:41.769 03:11:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.769 03:11:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.769 03:11:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.769 03:11:43 -- paths/export.sh@5 -- # export PATH 00:16:41.769 03:11:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.770 03:11:43 -- nvmf/common.sh@46 -- # : 0 00:16:41.770 03:11:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:41.770 03:11:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:41.770 03:11:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:41.770 03:11:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:41.770 03:11:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:41.770 03:11:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:41.770 03:11:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:41.770 03:11:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:41.770 03:11:43 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:41.770 03:11:43 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:41.770 03:11:43 -- target/host_management.sh@104 -- # nvmftestinit 00:16:41.770 03:11:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:41.770 03:11:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:41.770 03:11:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:41.770 03:11:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:41.770 03:11:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:41.770 03:11:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:41.770 03:11:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:41.770 03:11:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.770 03:11:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:41.770 03:11:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:41.770 03:11:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:41.770 03:11:43 -- common/autotest_common.sh@10 -- # set +x 00:16:42.705 03:11:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:42.705 03:11:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:42.705 03:11:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:42.705 03:11:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:42.705 03:11:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:42.705 03:11:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:42.705 03:11:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:42.705 03:11:45 -- nvmf/common.sh@294 -- # net_devs=() 00:16:42.705 03:11:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:42.705 03:11:45 -- nvmf/common.sh@295 -- # e810=() 00:16:42.705 03:11:45 -- nvmf/common.sh@295 -- # local -ga e810 00:16:42.705 03:11:45 -- nvmf/common.sh@296 -- # x722=() 00:16:42.705 03:11:45 -- nvmf/common.sh@296 -- # local -ga x722 00:16:42.705 03:11:45 -- nvmf/common.sh@297 -- # mlx=() 00:16:42.705 03:11:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:42.705 03:11:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:42.705 03:11:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:42.705 03:11:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:42.705 03:11:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:42.705 03:11:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.705 03:11:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:42.705 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:42.705 03:11:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:42.705 03:11:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:42.705 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:42.705 03:11:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:42.705 03:11:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.705 03:11:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.705 03:11:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.705 03:11:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.705 03:11:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:42.705 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:42.705 03:11:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.705 03:11:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:42.705 03:11:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:42.705 03:11:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:42.705 03:11:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:42.705 03:11:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:42.705 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:42.705 03:11:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:42.705 03:11:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:42.705 03:11:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:42.705 03:11:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:42.705 03:11:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:42.705 03:11:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:42.705 03:11:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:42.705 03:11:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:42.705 03:11:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:42.705 03:11:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:42.705 03:11:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:42.705 03:11:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:42.705 03:11:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:42.705 03:11:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:42.705 03:11:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:42.705 03:11:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:42.705 03:11:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:42.705 03:11:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:42.705 03:11:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:42.705 03:11:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:42.705 03:11:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:42.705 03:11:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:42.705 03:11:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:42.705 03:11:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:42.705 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:42.705 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.348 ms 00:16:42.705 00:16:42.705 --- 10.0.0.2 ping statistics --- 00:16:42.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:42.705 rtt min/avg/max/mdev = 0.348/0.348/0.348/0.000 ms 00:16:42.705 03:11:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:42.705 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:42.705 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.088 ms 00:16:42.705 00:16:42.705 --- 10.0.0.1 ping statistics --- 00:16:42.705 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:42.705 rtt min/avg/max/mdev = 0.088/0.088/0.088/0.000 ms 00:16:42.705 03:11:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:42.705 03:11:45 -- nvmf/common.sh@410 -- # return 0 00:16:42.705 03:11:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:42.705 03:11:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:42.705 03:11:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:42.705 03:11:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:42.705 03:11:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:42.705 03:11:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:42.705 03:11:45 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:16:42.705 03:11:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:16:42.705 03:11:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:42.705 03:11:45 -- common/autotest_common.sh@10 -- # set +x 00:16:42.705 ************************************ 00:16:42.705 START TEST nvmf_host_management 00:16:42.705 ************************************ 00:16:42.705 03:11:45 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:16:42.705 03:11:45 -- target/host_management.sh@69 -- # starttarget 00:16:42.705 03:11:45 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:16:42.705 03:11:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:42.705 03:11:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:42.705 03:11:45 -- common/autotest_common.sh@10 -- # set +x 00:16:42.705 03:11:45 -- nvmf/common.sh@469 -- # nvmfpid=2440786 00:16:42.705 03:11:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:16:42.705 03:11:45 -- nvmf/common.sh@470 -- # waitforlisten 2440786 00:16:42.705 03:11:45 -- common/autotest_common.sh@829 -- # '[' -z 2440786 ']' 00:16:42.705 03:11:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:42.706 03:11:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:42.706 03:11:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:42.706 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:42.706 03:11:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:42.706 03:11:45 -- common/autotest_common.sh@10 -- # set +x 00:16:42.706 [2024-11-27 03:11:45.267823] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:42.706 [2024-11-27 03:11:45.267914] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:42.706 EAL: No free 2048 kB hugepages reported on node 1 00:16:42.964 [2024-11-27 03:11:45.337118] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:42.964 [2024-11-27 03:11:45.426700] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:42.964 [2024-11-27 03:11:45.426865] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:42.964 [2024-11-27 03:11:45.426881] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:42.964 [2024-11-27 03:11:45.426893] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:42.964 [2024-11-27 03:11:45.427002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:42.964 [2024-11-27 03:11:45.427065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:42.964 [2024-11-27 03:11:45.427104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:42.964 [2024-11-27 03:11:45.427107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:43.897 03:11:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:43.897 03:11:46 -- common/autotest_common.sh@862 -- # return 0 00:16:43.897 03:11:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:43.897 03:11:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:43.897 03:11:46 -- common/autotest_common.sh@10 -- # set +x 00:16:43.897 03:11:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:43.897 03:11:46 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:43.898 03:11:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:43.898 03:11:46 -- common/autotest_common.sh@10 -- # set +x 00:16:43.898 [2024-11-27 03:11:46.264186] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:43.898 03:11:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:43.898 03:11:46 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:16:43.898 03:11:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:43.898 03:11:46 -- common/autotest_common.sh@10 -- # set +x 00:16:43.898 03:11:46 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:43.898 03:11:46 -- target/host_management.sh@23 -- # cat 00:16:43.898 03:11:46 -- target/host_management.sh@30 -- # rpc_cmd 00:16:43.898 03:11:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:43.898 03:11:46 -- common/autotest_common.sh@10 -- # set +x 00:16:43.898 Malloc0 00:16:43.898 [2024-11-27 03:11:46.325197] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:43.898 03:11:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:43.898 03:11:46 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:16:43.898 03:11:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:43.898 03:11:46 -- common/autotest_common.sh@10 -- # set +x 00:16:43.898 03:11:46 -- target/host_management.sh@73 -- # perfpid=2440965 00:16:43.898 03:11:46 -- target/host_management.sh@74 -- # waitforlisten 2440965 /var/tmp/bdevperf.sock 00:16:43.898 03:11:46 -- common/autotest_common.sh@829 -- # '[' -z 2440965 ']' 00:16:43.898 03:11:46 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:16:43.898 03:11:46 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:16:43.898 03:11:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:43.898 03:11:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:43.898 03:11:46 -- nvmf/common.sh@520 -- # config=() 00:16:43.898 03:11:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:43.898 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:43.898 03:11:46 -- nvmf/common.sh@520 -- # local subsystem config 00:16:43.898 03:11:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:43.898 03:11:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:43.898 03:11:46 -- common/autotest_common.sh@10 -- # set +x 00:16:43.898 03:11:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:43.898 { 00:16:43.898 "params": { 00:16:43.898 "name": "Nvme$subsystem", 00:16:43.898 "trtype": "$TEST_TRANSPORT", 00:16:43.898 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:43.898 "adrfam": "ipv4", 00:16:43.898 "trsvcid": "$NVMF_PORT", 00:16:43.898 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:43.898 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:43.898 "hdgst": ${hdgst:-false}, 00:16:43.898 "ddgst": ${ddgst:-false} 00:16:43.898 }, 00:16:43.898 "method": "bdev_nvme_attach_controller" 00:16:43.898 } 00:16:43.898 EOF 00:16:43.898 )") 00:16:43.898 03:11:46 -- nvmf/common.sh@542 -- # cat 00:16:43.898 03:11:46 -- nvmf/common.sh@544 -- # jq . 00:16:43.898 03:11:46 -- nvmf/common.sh@545 -- # IFS=, 00:16:43.898 03:11:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:43.898 "params": { 00:16:43.898 "name": "Nvme0", 00:16:43.898 "trtype": "tcp", 00:16:43.898 "traddr": "10.0.0.2", 00:16:43.898 "adrfam": "ipv4", 00:16:43.898 "trsvcid": "4420", 00:16:43.898 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:43.898 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:43.898 "hdgst": false, 00:16:43.898 "ddgst": false 00:16:43.898 }, 00:16:43.898 "method": "bdev_nvme_attach_controller" 00:16:43.898 }' 00:16:43.898 [2024-11-27 03:11:46.403856] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:43.898 [2024-11-27 03:11:46.403926] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2440965 ] 00:16:43.898 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.898 [2024-11-27 03:11:46.470325] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:44.157 [2024-11-27 03:11:46.556262] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:44.415 Running I/O for 10 seconds... 00:16:44.983 03:11:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:44.983 03:11:47 -- common/autotest_common.sh@862 -- # return 0 00:16:44.983 03:11:47 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:16:44.983 03:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:44.983 03:11:47 -- common/autotest_common.sh@10 -- # set +x 00:16:44.983 03:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:44.983 03:11:47 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:44.983 03:11:47 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:16:44.983 03:11:47 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:16:44.983 03:11:47 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:16:44.983 03:11:47 -- target/host_management.sh@52 -- # local ret=1 00:16:44.983 03:11:47 -- target/host_management.sh@53 -- # local i 00:16:44.983 03:11:47 -- target/host_management.sh@54 -- # (( i = 10 )) 00:16:44.983 03:11:47 -- target/host_management.sh@54 -- # (( i != 0 )) 00:16:44.983 03:11:47 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:16:44.983 03:11:47 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:16:44.983 03:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:44.983 03:11:47 -- common/autotest_common.sh@10 -- # set +x 00:16:44.983 03:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:44.983 03:11:47 -- target/host_management.sh@55 -- # read_io_count=2233 00:16:44.983 03:11:47 -- target/host_management.sh@58 -- # '[' 2233 -ge 100 ']' 00:16:44.983 03:11:47 -- target/host_management.sh@59 -- # ret=0 00:16:44.983 03:11:47 -- target/host_management.sh@60 -- # break 00:16:44.983 03:11:47 -- target/host_management.sh@64 -- # return 0 00:16:44.983 03:11:47 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:44.983 03:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:44.983 03:11:47 -- common/autotest_common.sh@10 -- # set +x 00:16:44.983 [2024-11-27 03:11:47.441016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441088] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.441310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2478f40 is same with the state(5) to be set 00:16:44.983 [2024-11-27 03:11:47.443640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.443980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.443993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.444007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.444025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.444040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.444053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.444068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.444080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.444094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.444107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.444121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.444134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.983 [2024-11-27 03:11:47.444148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.983 [2024-11-27 03:11:47.444160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:45568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:45696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:45824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:45952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:46080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:46208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:46336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:46464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:46592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:46720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:46848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:46976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:47104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:47232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:47360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:47488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:47616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:47744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:47872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:48000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:48128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:48256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:48384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.444981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.444996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:48512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:48640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:48768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:48896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:49024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:49152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:49280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.984 [2024-11-27 03:11:47.445284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:49408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.984 [2024-11-27 03:11:47.445298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.985 [2024-11-27 03:11:47.445326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.985 [2024-11-27 03:11:47.445355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.985 [2024-11-27 03:11:47.445383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.985 [2024-11-27 03:11:47.445412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 03:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:44.985 [2024-11-27 03:11:47.445427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.985 [2024-11-27 03:11:47.445440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.985 [2024-11-27 03:11:47.445472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.985 [2024-11-27 03:11:47.445501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:16:44.985 [2024-11-27 03:11:47.445541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 03:11:47 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:16:44.985 [2024-11-27 03:11:47.445630] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xe98f30 was disconnected and freed. reset controller. 00:16:44.985 [2024-11-27 03:11:47.445700] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:16:44.985 03:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:44.985 [2024-11-27 03:11:47.445722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445738] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:16:44.985 [2024-11-27 03:11:47.445751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445765] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:16:44.985 [2024-11-27 03:11:47.445778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445792] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:16:44.985 [2024-11-27 03:11:47.445806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:16:44.985 [2024-11-27 03:11:47.445818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xe9b870 is same with the state(5) to be set 00:16:44.985 03:11:47 -- common/autotest_common.sh@10 -- # set +x 00:16:44.985 [2024-11-27 03:11:47.446931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:16:44.985 task offset: 42496 on job bdev=Nvme0n1 fails 00:16:44.985 00:16:44.985 Latency(us) 00:16:44.985 [2024-11-27T02:11:47.604Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:44.985 [2024-11-27T02:11:47.604Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:44.985 [2024-11-27T02:11:47.604Z] Job: Nvme0n1 ended in about 0.59 seconds with error 00:16:44.985 Verification LBA range: start 0x0 length 0x400 00:16:44.985 Nvme0n1 : 0.59 3996.50 249.78 107.88 0.00 15346.98 2572.89 21942.42 00:16:44.985 [2024-11-27T02:11:47.604Z] =================================================================================================================== 00:16:44.985 [2024-11-27T02:11:47.604Z] Total : 3996.50 249.78 107.88 0.00 15346.98 2572.89 21942.42 00:16:44.985 [2024-11-27 03:11:47.448853] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:16:44.985 [2024-11-27 03:11:47.448881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe9b870 (9): Bad file descriptor 00:16:44.985 03:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:44.985 03:11:47 -- target/host_management.sh@87 -- # sleep 1 00:16:44.985 [2024-11-27 03:11:47.469403] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:16:45.918 03:11:48 -- target/host_management.sh@91 -- # kill -9 2440965 00:16:45.919 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2440965) - No such process 00:16:45.919 03:11:48 -- target/host_management.sh@91 -- # true 00:16:45.919 03:11:48 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:16:45.919 03:11:48 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:16:45.919 03:11:48 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:16:45.919 03:11:48 -- nvmf/common.sh@520 -- # config=() 00:16:45.919 03:11:48 -- nvmf/common.sh@520 -- # local subsystem config 00:16:45.919 03:11:48 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:45.919 03:11:48 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:45.919 { 00:16:45.919 "params": { 00:16:45.919 "name": "Nvme$subsystem", 00:16:45.919 "trtype": "$TEST_TRANSPORT", 00:16:45.919 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:45.919 "adrfam": "ipv4", 00:16:45.919 "trsvcid": "$NVMF_PORT", 00:16:45.919 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:45.919 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:45.919 "hdgst": ${hdgst:-false}, 00:16:45.919 "ddgst": ${ddgst:-false} 00:16:45.919 }, 00:16:45.919 "method": "bdev_nvme_attach_controller" 00:16:45.919 } 00:16:45.919 EOF 00:16:45.919 )") 00:16:45.919 03:11:48 -- nvmf/common.sh@542 -- # cat 00:16:45.919 03:11:48 -- nvmf/common.sh@544 -- # jq . 00:16:45.919 03:11:48 -- nvmf/common.sh@545 -- # IFS=, 00:16:45.919 03:11:48 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:45.919 "params": { 00:16:45.919 "name": "Nvme0", 00:16:45.919 "trtype": "tcp", 00:16:45.919 "traddr": "10.0.0.2", 00:16:45.919 "adrfam": "ipv4", 00:16:45.919 "trsvcid": "4420", 00:16:45.919 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:16:45.919 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:16:45.919 "hdgst": false, 00:16:45.919 "ddgst": false 00:16:45.919 }, 00:16:45.919 "method": "bdev_nvme_attach_controller" 00:16:45.919 }' 00:16:45.919 [2024-11-27 03:11:48.501078] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:45.919 [2024-11-27 03:11:48.501153] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2441248 ] 00:16:45.919 EAL: No free 2048 kB hugepages reported on node 1 00:16:46.177 [2024-11-27 03:11:48.562207] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:46.177 [2024-11-27 03:11:48.648050] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:46.435 Running I/O for 1 seconds... 00:16:47.812 00:16:47.812 Latency(us) 00:16:47.812 [2024-11-27T02:11:50.431Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:47.812 [2024-11-27T02:11:50.431Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:16:47.812 Verification LBA range: start 0x0 length 0x400 00:16:47.812 Nvme0n1 : 1.05 3844.85 240.30 0.00 0.00 15761.55 2099.58 44079.03 00:16:47.812 [2024-11-27T02:11:50.431Z] =================================================================================================================== 00:16:47.812 [2024-11-27T02:11:50.431Z] Total : 3844.85 240.30 0.00 0.00 15761.55 2099.58 44079.03 00:16:47.812 03:11:50 -- target/host_management.sh@101 -- # stoptarget 00:16:47.812 03:11:50 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:16:47.812 03:11:50 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:16:47.812 03:11:50 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:16:47.812 03:11:50 -- target/host_management.sh@40 -- # nvmftestfini 00:16:47.812 03:11:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:47.812 03:11:50 -- nvmf/common.sh@116 -- # sync 00:16:47.812 03:11:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:47.812 03:11:50 -- nvmf/common.sh@119 -- # set +e 00:16:47.812 03:11:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:47.812 03:11:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:47.812 rmmod nvme_tcp 00:16:47.812 rmmod nvme_fabrics 00:16:47.812 rmmod nvme_keyring 00:16:47.812 03:11:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:47.812 03:11:50 -- nvmf/common.sh@123 -- # set -e 00:16:47.812 03:11:50 -- nvmf/common.sh@124 -- # return 0 00:16:47.812 03:11:50 -- nvmf/common.sh@477 -- # '[' -n 2440786 ']' 00:16:47.812 03:11:50 -- nvmf/common.sh@478 -- # killprocess 2440786 00:16:47.812 03:11:50 -- common/autotest_common.sh@936 -- # '[' -z 2440786 ']' 00:16:47.812 03:11:50 -- common/autotest_common.sh@940 -- # kill -0 2440786 00:16:47.812 03:11:50 -- common/autotest_common.sh@941 -- # uname 00:16:47.812 03:11:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:47.812 03:11:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2440786 00:16:47.812 03:11:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:47.812 03:11:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:47.812 03:11:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2440786' 00:16:47.812 killing process with pid 2440786 00:16:47.812 03:11:50 -- common/autotest_common.sh@955 -- # kill 2440786 00:16:47.812 03:11:50 -- common/autotest_common.sh@960 -- # wait 2440786 00:16:48.124 [2024-11-27 03:11:50.519274] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:16:48.124 03:11:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:48.124 03:11:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:48.124 03:11:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:48.124 03:11:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:48.124 03:11:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:48.124 03:11:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:48.124 03:11:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:48.124 03:11:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:50.055 03:11:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:50.055 00:16:50.055 real 0m7.368s 00:16:50.055 user 0m22.514s 00:16:50.055 sys 0m1.651s 00:16:50.055 03:11:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:50.055 03:11:52 -- common/autotest_common.sh@10 -- # set +x 00:16:50.055 ************************************ 00:16:50.055 END TEST nvmf_host_management 00:16:50.055 ************************************ 00:16:50.055 03:11:52 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:16:50.055 00:16:50.055 real 0m9.649s 00:16:50.055 user 0m23.350s 00:16:50.055 sys 0m3.116s 00:16:50.055 03:11:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:50.055 03:11:52 -- common/autotest_common.sh@10 -- # set +x 00:16:50.055 ************************************ 00:16:50.055 END TEST nvmf_host_management 00:16:50.055 ************************************ 00:16:50.055 03:11:52 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:50.055 03:11:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:50.055 03:11:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:50.055 03:11:52 -- common/autotest_common.sh@10 -- # set +x 00:16:50.055 ************************************ 00:16:50.055 START TEST nvmf_lvol 00:16:50.055 ************************************ 00:16:50.055 03:11:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:16:50.316 * Looking for test storage... 00:16:50.316 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:50.316 03:11:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:50.316 03:11:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:50.316 03:11:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:50.316 03:11:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:50.316 03:11:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:50.316 03:11:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:50.316 03:11:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:50.316 03:11:52 -- scripts/common.sh@335 -- # IFS=.-: 00:16:50.316 03:11:52 -- scripts/common.sh@335 -- # read -ra ver1 00:16:50.316 03:11:52 -- scripts/common.sh@336 -- # IFS=.-: 00:16:50.316 03:11:52 -- scripts/common.sh@336 -- # read -ra ver2 00:16:50.316 03:11:52 -- scripts/common.sh@337 -- # local 'op=<' 00:16:50.316 03:11:52 -- scripts/common.sh@339 -- # ver1_l=2 00:16:50.316 03:11:52 -- scripts/common.sh@340 -- # ver2_l=1 00:16:50.316 03:11:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:50.316 03:11:52 -- scripts/common.sh@343 -- # case "$op" in 00:16:50.316 03:11:52 -- scripts/common.sh@344 -- # : 1 00:16:50.316 03:11:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:50.316 03:11:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:50.316 03:11:52 -- scripts/common.sh@364 -- # decimal 1 00:16:50.316 03:11:52 -- scripts/common.sh@352 -- # local d=1 00:16:50.316 03:11:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:50.316 03:11:52 -- scripts/common.sh@354 -- # echo 1 00:16:50.316 03:11:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:50.316 03:11:52 -- scripts/common.sh@365 -- # decimal 2 00:16:50.316 03:11:52 -- scripts/common.sh@352 -- # local d=2 00:16:50.316 03:11:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:50.316 03:11:52 -- scripts/common.sh@354 -- # echo 2 00:16:50.316 03:11:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:50.316 03:11:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:50.316 03:11:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:50.316 03:11:52 -- scripts/common.sh@367 -- # return 0 00:16:50.316 03:11:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:50.316 03:11:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:50.316 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:50.316 --rc genhtml_branch_coverage=1 00:16:50.316 --rc genhtml_function_coverage=1 00:16:50.316 --rc genhtml_legend=1 00:16:50.316 --rc geninfo_all_blocks=1 00:16:50.316 --rc geninfo_unexecuted_blocks=1 00:16:50.316 00:16:50.316 ' 00:16:50.316 03:11:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:50.316 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:50.316 --rc genhtml_branch_coverage=1 00:16:50.316 --rc genhtml_function_coverage=1 00:16:50.316 --rc genhtml_legend=1 00:16:50.316 --rc geninfo_all_blocks=1 00:16:50.316 --rc geninfo_unexecuted_blocks=1 00:16:50.316 00:16:50.316 ' 00:16:50.316 03:11:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:50.316 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:50.316 --rc genhtml_branch_coverage=1 00:16:50.316 --rc genhtml_function_coverage=1 00:16:50.316 --rc genhtml_legend=1 00:16:50.316 --rc geninfo_all_blocks=1 00:16:50.316 --rc geninfo_unexecuted_blocks=1 00:16:50.316 00:16:50.316 ' 00:16:50.316 03:11:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:50.316 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:50.316 --rc genhtml_branch_coverage=1 00:16:50.316 --rc genhtml_function_coverage=1 00:16:50.316 --rc genhtml_legend=1 00:16:50.316 --rc geninfo_all_blocks=1 00:16:50.316 --rc geninfo_unexecuted_blocks=1 00:16:50.316 00:16:50.316 ' 00:16:50.316 03:11:52 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:50.316 03:11:52 -- nvmf/common.sh@7 -- # uname -s 00:16:50.316 03:11:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:50.316 03:11:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:50.316 03:11:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:50.316 03:11:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:50.316 03:11:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:50.316 03:11:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:50.316 03:11:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:50.316 03:11:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:50.316 03:11:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:50.316 03:11:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:50.316 03:11:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:50.316 03:11:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:50.316 03:11:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:50.316 03:11:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:50.316 03:11:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:50.316 03:11:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:50.316 03:11:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:50.316 03:11:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:50.316 03:11:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:50.316 03:11:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:50.316 03:11:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:50.316 03:11:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:50.316 03:11:52 -- paths/export.sh@5 -- # export PATH 00:16:50.316 03:11:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:50.316 03:11:52 -- nvmf/common.sh@46 -- # : 0 00:16:50.317 03:11:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:50.317 03:11:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:50.317 03:11:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:50.317 03:11:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:50.317 03:11:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:50.317 03:11:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:50.317 03:11:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:50.317 03:11:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:50.317 03:11:52 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:50.317 03:11:52 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:50.317 03:11:52 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:16:50.317 03:11:52 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:16:50.317 03:11:52 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:50.317 03:11:52 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:16:50.317 03:11:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:50.317 03:11:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:50.317 03:11:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:50.317 03:11:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:50.317 03:11:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:50.317 03:11:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:50.317 03:11:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:50.317 03:11:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:50.317 03:11:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:50.317 03:11:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:50.317 03:11:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:50.317 03:11:52 -- common/autotest_common.sh@10 -- # set +x 00:16:52.218 03:11:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:52.218 03:11:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:52.218 03:11:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:52.218 03:11:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:52.218 03:11:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:52.218 03:11:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:52.218 03:11:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:52.218 03:11:54 -- nvmf/common.sh@294 -- # net_devs=() 00:16:52.218 03:11:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:52.218 03:11:54 -- nvmf/common.sh@295 -- # e810=() 00:16:52.218 03:11:54 -- nvmf/common.sh@295 -- # local -ga e810 00:16:52.218 03:11:54 -- nvmf/common.sh@296 -- # x722=() 00:16:52.218 03:11:54 -- nvmf/common.sh@296 -- # local -ga x722 00:16:52.218 03:11:54 -- nvmf/common.sh@297 -- # mlx=() 00:16:52.218 03:11:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:52.218 03:11:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:52.218 03:11:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:52.219 03:11:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:52.219 03:11:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:52.219 03:11:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:52.219 03:11:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:52.219 03:11:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:52.219 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:52.219 03:11:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:52.219 03:11:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:52.219 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:52.219 03:11:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:52.219 03:11:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:52.219 03:11:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:52.219 03:11:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:52.219 03:11:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:52.219 03:11:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:52.219 03:11:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:52.219 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:52.219 03:11:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:52.219 03:11:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:52.219 03:11:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:52.219 03:11:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:52.219 03:11:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:52.219 03:11:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:52.219 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:52.219 03:11:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:52.219 03:11:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:52.477 03:11:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:52.477 03:11:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:52.477 03:11:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:52.477 03:11:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:52.477 03:11:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:52.477 03:11:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:52.477 03:11:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:52.477 03:11:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:52.477 03:11:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:52.477 03:11:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:52.477 03:11:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:52.477 03:11:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:52.477 03:11:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:52.477 03:11:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:52.477 03:11:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:52.477 03:11:54 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:52.477 03:11:54 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:52.478 03:11:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:52.478 03:11:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:52.478 03:11:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:52.478 03:11:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:52.478 03:11:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:52.478 03:11:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:52.478 03:11:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:52.478 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:52.478 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.289 ms 00:16:52.478 00:16:52.478 --- 10.0.0.2 ping statistics --- 00:16:52.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:52.478 rtt min/avg/max/mdev = 0.289/0.289/0.289/0.000 ms 00:16:52.478 03:11:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:52.478 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:52.478 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:16:52.478 00:16:52.478 --- 10.0.0.1 ping statistics --- 00:16:52.478 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:52.478 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:16:52.478 03:11:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:52.478 03:11:54 -- nvmf/common.sh@410 -- # return 0 00:16:52.478 03:11:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:52.478 03:11:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:52.478 03:11:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:52.478 03:11:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:52.478 03:11:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:52.478 03:11:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:52.478 03:11:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:52.478 03:11:54 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:16:52.478 03:11:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:52.478 03:11:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:52.478 03:11:54 -- common/autotest_common.sh@10 -- # set +x 00:16:52.478 03:11:54 -- nvmf/common.sh@469 -- # nvmfpid=2443486 00:16:52.478 03:11:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:52.478 03:11:54 -- nvmf/common.sh@470 -- # waitforlisten 2443486 00:16:52.478 03:11:54 -- common/autotest_common.sh@829 -- # '[' -z 2443486 ']' 00:16:52.478 03:11:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:52.478 03:11:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:52.478 03:11:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:52.478 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:52.478 03:11:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:52.478 03:11:54 -- common/autotest_common.sh@10 -- # set +x 00:16:52.478 [2024-11-27 03:11:55.041260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:52.478 [2024-11-27 03:11:55.041333] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:52.478 EAL: No free 2048 kB hugepages reported on node 1 00:16:52.736 [2024-11-27 03:11:55.108793] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:52.736 [2024-11-27 03:11:55.197318] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:52.736 [2024-11-27 03:11:55.197489] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:52.736 [2024-11-27 03:11:55.197507] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:52.736 [2024-11-27 03:11:55.197519] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:52.736 [2024-11-27 03:11:55.197616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:52.736 [2024-11-27 03:11:55.197669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:52.736 [2024-11-27 03:11:55.197672] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:53.669 03:11:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:53.669 03:11:56 -- common/autotest_common.sh@862 -- # return 0 00:16:53.669 03:11:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:53.669 03:11:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:53.669 03:11:56 -- common/autotest_common.sh@10 -- # set +x 00:16:53.669 03:11:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:53.669 03:11:56 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:53.927 [2024-11-27 03:11:56.320115] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:53.927 03:11:56 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:54.185 03:11:56 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:16:54.185 03:11:56 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:54.444 03:11:56 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:16:54.444 03:11:56 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:16:54.702 03:11:57 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:16:54.960 03:11:57 -- target/nvmf_lvol.sh@29 -- # lvs=b4eec6c5-6f65-4a49-9f51-8053f5742df3 00:16:54.960 03:11:57 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u b4eec6c5-6f65-4a49-9f51-8053f5742df3 lvol 20 00:16:55.218 03:11:57 -- target/nvmf_lvol.sh@32 -- # lvol=5ead1057-6c2e-46a9-ba90-2e87d109c002 00:16:55.218 03:11:57 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:16:55.477 03:11:57 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 5ead1057-6c2e-46a9-ba90-2e87d109c002 00:16:55.734 03:11:58 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:16:55.992 [2024-11-27 03:11:58.455780] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:55.992 03:11:58 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:56.250 03:11:58 -- target/nvmf_lvol.sh@42 -- # perf_pid=2443935 00:16:56.250 03:11:58 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:16:56.250 03:11:58 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:16:56.250 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.189 03:11:59 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 5ead1057-6c2e-46a9-ba90-2e87d109c002 MY_SNAPSHOT 00:16:57.447 03:11:59 -- target/nvmf_lvol.sh@47 -- # snapshot=cca1676f-2a10-44a8-a53d-635b95cd44a6 00:16:57.447 03:11:59 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 5ead1057-6c2e-46a9-ba90-2e87d109c002 30 00:16:57.705 03:12:00 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone cca1676f-2a10-44a8-a53d-635b95cd44a6 MY_CLONE 00:16:58.271 03:12:00 -- target/nvmf_lvol.sh@49 -- # clone=260c4b63-6789-4ffb-a7ff-659b1a78ca27 00:16:58.271 03:12:00 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 260c4b63-6789-4ffb-a7ff-659b1a78ca27 00:16:58.836 03:12:01 -- target/nvmf_lvol.sh@53 -- # wait 2443935 00:17:06.944 Initializing NVMe Controllers 00:17:06.944 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:06.944 Controller IO queue size 128, less than required. 00:17:06.944 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:06.944 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:06.944 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:06.944 Initialization complete. Launching workers. 00:17:06.944 ======================================================== 00:17:06.944 Latency(us) 00:17:06.944 Device Information : IOPS MiB/s Average min max 00:17:06.944 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10399.00 40.62 12314.32 499.05 89340.17 00:17:06.944 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10711.20 41.84 11952.79 1879.65 72407.36 00:17:06.944 ======================================================== 00:17:06.944 Total : 21110.20 82.46 12130.89 499.05 89340.17 00:17:06.944 00:17:06.944 03:12:09 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:06.944 03:12:09 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 5ead1057-6c2e-46a9-ba90-2e87d109c002 00:17:06.944 03:12:09 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u b4eec6c5-6f65-4a49-9f51-8053f5742df3 00:17:07.203 03:12:09 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:07.203 03:12:09 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:07.203 03:12:09 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:07.203 03:12:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:07.203 03:12:09 -- nvmf/common.sh@116 -- # sync 00:17:07.203 03:12:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:07.203 03:12:09 -- nvmf/common.sh@119 -- # set +e 00:17:07.203 03:12:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:07.203 03:12:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:07.203 rmmod nvme_tcp 00:17:07.461 rmmod nvme_fabrics 00:17:07.461 rmmod nvme_keyring 00:17:07.461 03:12:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:07.461 03:12:09 -- nvmf/common.sh@123 -- # set -e 00:17:07.461 03:12:09 -- nvmf/common.sh@124 -- # return 0 00:17:07.461 03:12:09 -- nvmf/common.sh@477 -- # '[' -n 2443486 ']' 00:17:07.461 03:12:09 -- nvmf/common.sh@478 -- # killprocess 2443486 00:17:07.461 03:12:09 -- common/autotest_common.sh@936 -- # '[' -z 2443486 ']' 00:17:07.461 03:12:09 -- common/autotest_common.sh@940 -- # kill -0 2443486 00:17:07.461 03:12:09 -- common/autotest_common.sh@941 -- # uname 00:17:07.461 03:12:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:07.461 03:12:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2443486 00:17:07.461 03:12:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:07.461 03:12:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:07.461 03:12:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2443486' 00:17:07.461 killing process with pid 2443486 00:17:07.461 03:12:09 -- common/autotest_common.sh@955 -- # kill 2443486 00:17:07.461 03:12:09 -- common/autotest_common.sh@960 -- # wait 2443486 00:17:07.720 03:12:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:07.720 03:12:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:07.720 03:12:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:07.720 03:12:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:07.720 03:12:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:07.720 03:12:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:07.720 03:12:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:07.720 03:12:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:09.623 03:12:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:09.623 00:17:09.623 real 0m19.584s 00:17:09.623 user 1m6.465s 00:17:09.623 sys 0m5.673s 00:17:09.623 03:12:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:09.623 03:12:12 -- common/autotest_common.sh@10 -- # set +x 00:17:09.623 ************************************ 00:17:09.623 END TEST nvmf_lvol 00:17:09.623 ************************************ 00:17:09.883 03:12:12 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:09.883 03:12:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:09.883 03:12:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:09.883 03:12:12 -- common/autotest_common.sh@10 -- # set +x 00:17:09.883 ************************************ 00:17:09.883 START TEST nvmf_lvs_grow 00:17:09.883 ************************************ 00:17:09.883 03:12:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:09.883 * Looking for test storage... 00:17:09.883 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:09.883 03:12:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:09.883 03:12:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:09.883 03:12:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:09.883 03:12:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:09.883 03:12:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:09.883 03:12:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:09.883 03:12:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:09.883 03:12:12 -- scripts/common.sh@335 -- # IFS=.-: 00:17:09.883 03:12:12 -- scripts/common.sh@335 -- # read -ra ver1 00:17:09.883 03:12:12 -- scripts/common.sh@336 -- # IFS=.-: 00:17:09.883 03:12:12 -- scripts/common.sh@336 -- # read -ra ver2 00:17:09.883 03:12:12 -- scripts/common.sh@337 -- # local 'op=<' 00:17:09.883 03:12:12 -- scripts/common.sh@339 -- # ver1_l=2 00:17:09.883 03:12:12 -- scripts/common.sh@340 -- # ver2_l=1 00:17:09.883 03:12:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:09.883 03:12:12 -- scripts/common.sh@343 -- # case "$op" in 00:17:09.883 03:12:12 -- scripts/common.sh@344 -- # : 1 00:17:09.883 03:12:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:09.883 03:12:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:09.883 03:12:12 -- scripts/common.sh@364 -- # decimal 1 00:17:09.883 03:12:12 -- scripts/common.sh@352 -- # local d=1 00:17:09.883 03:12:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:09.883 03:12:12 -- scripts/common.sh@354 -- # echo 1 00:17:09.883 03:12:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:09.883 03:12:12 -- scripts/common.sh@365 -- # decimal 2 00:17:09.883 03:12:12 -- scripts/common.sh@352 -- # local d=2 00:17:09.883 03:12:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:09.883 03:12:12 -- scripts/common.sh@354 -- # echo 2 00:17:09.883 03:12:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:09.883 03:12:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:09.883 03:12:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:09.883 03:12:12 -- scripts/common.sh@367 -- # return 0 00:17:09.883 03:12:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:09.883 03:12:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:09.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:09.883 --rc genhtml_branch_coverage=1 00:17:09.883 --rc genhtml_function_coverage=1 00:17:09.883 --rc genhtml_legend=1 00:17:09.883 --rc geninfo_all_blocks=1 00:17:09.883 --rc geninfo_unexecuted_blocks=1 00:17:09.883 00:17:09.883 ' 00:17:09.883 03:12:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:09.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:09.883 --rc genhtml_branch_coverage=1 00:17:09.883 --rc genhtml_function_coverage=1 00:17:09.883 --rc genhtml_legend=1 00:17:09.883 --rc geninfo_all_blocks=1 00:17:09.883 --rc geninfo_unexecuted_blocks=1 00:17:09.883 00:17:09.883 ' 00:17:09.883 03:12:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:09.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:09.883 --rc genhtml_branch_coverage=1 00:17:09.883 --rc genhtml_function_coverage=1 00:17:09.883 --rc genhtml_legend=1 00:17:09.883 --rc geninfo_all_blocks=1 00:17:09.883 --rc geninfo_unexecuted_blocks=1 00:17:09.883 00:17:09.883 ' 00:17:09.883 03:12:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:09.883 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:09.883 --rc genhtml_branch_coverage=1 00:17:09.883 --rc genhtml_function_coverage=1 00:17:09.883 --rc genhtml_legend=1 00:17:09.883 --rc geninfo_all_blocks=1 00:17:09.883 --rc geninfo_unexecuted_blocks=1 00:17:09.883 00:17:09.883 ' 00:17:09.883 03:12:12 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:09.883 03:12:12 -- nvmf/common.sh@7 -- # uname -s 00:17:09.883 03:12:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:09.883 03:12:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:09.883 03:12:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:09.883 03:12:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:09.883 03:12:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:09.883 03:12:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:09.883 03:12:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:09.883 03:12:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:09.883 03:12:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:09.883 03:12:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:09.883 03:12:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:09.883 03:12:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:09.883 03:12:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:09.883 03:12:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:09.883 03:12:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:09.883 03:12:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:09.883 03:12:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:09.883 03:12:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:09.883 03:12:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:09.883 03:12:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:09.883 03:12:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:09.883 03:12:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:09.883 03:12:12 -- paths/export.sh@5 -- # export PATH 00:17:09.883 03:12:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:09.883 03:12:12 -- nvmf/common.sh@46 -- # : 0 00:17:09.883 03:12:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:09.883 03:12:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:09.883 03:12:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:09.883 03:12:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:09.884 03:12:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:09.884 03:12:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:09.884 03:12:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:09.884 03:12:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:09.884 03:12:12 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:09.884 03:12:12 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:09.884 03:12:12 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:09.884 03:12:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:09.884 03:12:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:09.884 03:12:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:09.884 03:12:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:09.884 03:12:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:09.884 03:12:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:09.884 03:12:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:09.884 03:12:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:09.884 03:12:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:09.884 03:12:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:09.884 03:12:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:09.884 03:12:12 -- common/autotest_common.sh@10 -- # set +x 00:17:11.787 03:12:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:11.787 03:12:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:11.787 03:12:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:11.787 03:12:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:11.787 03:12:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:11.787 03:12:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:11.787 03:12:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:11.787 03:12:14 -- nvmf/common.sh@294 -- # net_devs=() 00:17:11.787 03:12:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:11.787 03:12:14 -- nvmf/common.sh@295 -- # e810=() 00:17:11.787 03:12:14 -- nvmf/common.sh@295 -- # local -ga e810 00:17:11.787 03:12:14 -- nvmf/common.sh@296 -- # x722=() 00:17:11.787 03:12:14 -- nvmf/common.sh@296 -- # local -ga x722 00:17:11.787 03:12:14 -- nvmf/common.sh@297 -- # mlx=() 00:17:11.787 03:12:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:11.787 03:12:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:11.787 03:12:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:11.787 03:12:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:11.787 03:12:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:11.787 03:12:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:11.787 03:12:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:11.788 03:12:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:11.788 03:12:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:11.788 03:12:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:11.788 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:11.788 03:12:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:11.788 03:12:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:11.788 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:11.788 03:12:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:11.788 03:12:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:11.788 03:12:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:11.788 03:12:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:11.788 03:12:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:11.788 03:12:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:11.788 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:11.788 03:12:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:11.788 03:12:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:11.788 03:12:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:11.788 03:12:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:11.788 03:12:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:11.788 03:12:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:11.788 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:11.788 03:12:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:11.788 03:12:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:11.788 03:12:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:11.788 03:12:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:11.788 03:12:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:11.788 03:12:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:11.788 03:12:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:11.788 03:12:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:11.788 03:12:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:11.788 03:12:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:11.788 03:12:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:11.788 03:12:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:11.788 03:12:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:11.788 03:12:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:11.788 03:12:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:11.788 03:12:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:11.788 03:12:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:11.788 03:12:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:12.046 03:12:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:12.046 03:12:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:12.046 03:12:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:12.046 03:12:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:12.046 03:12:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:12.046 03:12:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:12.046 03:12:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:12.046 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:12.046 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.273 ms 00:17:12.046 00:17:12.046 --- 10.0.0.2 ping statistics --- 00:17:12.046 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:12.046 rtt min/avg/max/mdev = 0.273/0.273/0.273/0.000 ms 00:17:12.046 03:12:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:12.046 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:12.046 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:17:12.046 00:17:12.046 --- 10.0.0.1 ping statistics --- 00:17:12.046 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:12.046 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:17:12.046 03:12:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:12.046 03:12:14 -- nvmf/common.sh@410 -- # return 0 00:17:12.046 03:12:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:12.046 03:12:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:12.046 03:12:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:12.046 03:12:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:12.046 03:12:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:12.046 03:12:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:12.046 03:12:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:12.046 03:12:14 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:12.046 03:12:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:12.046 03:12:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:12.046 03:12:14 -- common/autotest_common.sh@10 -- # set +x 00:17:12.046 03:12:14 -- nvmf/common.sh@469 -- # nvmfpid=2447870 00:17:12.046 03:12:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:12.046 03:12:14 -- nvmf/common.sh@470 -- # waitforlisten 2447870 00:17:12.046 03:12:14 -- common/autotest_common.sh@829 -- # '[' -z 2447870 ']' 00:17:12.046 03:12:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:12.046 03:12:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:12.046 03:12:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:12.046 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:12.046 03:12:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:12.046 03:12:14 -- common/autotest_common.sh@10 -- # set +x 00:17:12.046 [2024-11-27 03:12:14.564791] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:12.046 [2024-11-27 03:12:14.564874] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:12.046 EAL: No free 2048 kB hugepages reported on node 1 00:17:12.046 [2024-11-27 03:12:14.634796] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:12.304 [2024-11-27 03:12:14.725552] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:12.304 [2024-11-27 03:12:14.725732] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:12.304 [2024-11-27 03:12:14.725760] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:12.304 [2024-11-27 03:12:14.725772] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:12.304 [2024-11-27 03:12:14.725798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:13.235 03:12:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:13.235 03:12:15 -- common/autotest_common.sh@862 -- # return 0 00:17:13.235 03:12:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:13.235 03:12:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:13.235 03:12:15 -- common/autotest_common.sh@10 -- # set +x 00:17:13.235 03:12:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:13.235 03:12:15 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:13.235 [2024-11-27 03:12:15.835055] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:13.492 03:12:15 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:13.492 03:12:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:13.493 03:12:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:13.493 03:12:15 -- common/autotest_common.sh@10 -- # set +x 00:17:13.493 ************************************ 00:17:13.493 START TEST lvs_grow_clean 00:17:13.493 ************************************ 00:17:13.493 03:12:15 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:13.493 03:12:15 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:13.493 03:12:15 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:13.493 03:12:15 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:13.493 03:12:15 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:13.493 03:12:15 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:13.493 03:12:15 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:13.493 03:12:15 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:13.493 03:12:15 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:13.493 03:12:15 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:13.750 03:12:16 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:13.750 03:12:16 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:14.008 03:12:16 -- target/nvmf_lvs_grow.sh@28 -- # lvs=758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:14.008 03:12:16 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:14.008 03:12:16 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:14.265 03:12:16 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:14.265 03:12:16 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:14.265 03:12:16 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 758536e3-e50c-4a96-99d2-2aacf01cee67 lvol 150 00:17:14.522 03:12:16 -- target/nvmf_lvs_grow.sh@33 -- # lvol=947abd41-0a99-4cac-95a0-f9853574a78c 00:17:14.522 03:12:16 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:14.522 03:12:16 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:14.780 [2024-11-27 03:12:17.144835] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:14.780 [2024-11-27 03:12:17.144923] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:14.780 true 00:17:14.780 03:12:17 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:14.780 03:12:17 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:15.038 03:12:17 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:15.038 03:12:17 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:15.296 03:12:17 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 947abd41-0a99-4cac-95a0-f9853574a78c 00:17:15.554 03:12:17 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:15.554 [2024-11-27 03:12:18.160083] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:15.812 03:12:18 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:16.070 03:12:18 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2448444 00:17:16.070 03:12:18 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:16.070 03:12:18 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2448444 /var/tmp/bdevperf.sock 00:17:16.070 03:12:18 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:16.070 03:12:18 -- common/autotest_common.sh@829 -- # '[' -z 2448444 ']' 00:17:16.070 03:12:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:16.070 03:12:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:16.070 03:12:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:16.070 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:16.070 03:12:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:16.070 03:12:18 -- common/autotest_common.sh@10 -- # set +x 00:17:16.070 [2024-11-27 03:12:18.473592] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:16.070 [2024-11-27 03:12:18.473663] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2448444 ] 00:17:16.070 EAL: No free 2048 kB hugepages reported on node 1 00:17:16.070 [2024-11-27 03:12:18.537633] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:16.070 [2024-11-27 03:12:18.626779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:17.002 03:12:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:17.002 03:12:19 -- common/autotest_common.sh@862 -- # return 0 00:17:17.002 03:12:19 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:17.260 Nvme0n1 00:17:17.260 03:12:19 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:17.518 [ 00:17:17.518 { 00:17:17.518 "name": "Nvme0n1", 00:17:17.518 "aliases": [ 00:17:17.518 "947abd41-0a99-4cac-95a0-f9853574a78c" 00:17:17.518 ], 00:17:17.518 "product_name": "NVMe disk", 00:17:17.518 "block_size": 4096, 00:17:17.518 "num_blocks": 38912, 00:17:17.518 "uuid": "947abd41-0a99-4cac-95a0-f9853574a78c", 00:17:17.518 "assigned_rate_limits": { 00:17:17.518 "rw_ios_per_sec": 0, 00:17:17.518 "rw_mbytes_per_sec": 0, 00:17:17.518 "r_mbytes_per_sec": 0, 00:17:17.518 "w_mbytes_per_sec": 0 00:17:17.518 }, 00:17:17.518 "claimed": false, 00:17:17.518 "zoned": false, 00:17:17.518 "supported_io_types": { 00:17:17.518 "read": true, 00:17:17.518 "write": true, 00:17:17.518 "unmap": true, 00:17:17.518 "write_zeroes": true, 00:17:17.518 "flush": true, 00:17:17.518 "reset": true, 00:17:17.518 "compare": true, 00:17:17.518 "compare_and_write": true, 00:17:17.518 "abort": true, 00:17:17.518 "nvme_admin": true, 00:17:17.518 "nvme_io": true 00:17:17.518 }, 00:17:17.518 "driver_specific": { 00:17:17.518 "nvme": [ 00:17:17.518 { 00:17:17.518 "trid": { 00:17:17.518 "trtype": "TCP", 00:17:17.518 "adrfam": "IPv4", 00:17:17.518 "traddr": "10.0.0.2", 00:17:17.518 "trsvcid": "4420", 00:17:17.518 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:17.518 }, 00:17:17.518 "ctrlr_data": { 00:17:17.518 "cntlid": 1, 00:17:17.518 "vendor_id": "0x8086", 00:17:17.518 "model_number": "SPDK bdev Controller", 00:17:17.518 "serial_number": "SPDK0", 00:17:17.518 "firmware_revision": "24.01.1", 00:17:17.518 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:17.518 "oacs": { 00:17:17.518 "security": 0, 00:17:17.518 "format": 0, 00:17:17.518 "firmware": 0, 00:17:17.518 "ns_manage": 0 00:17:17.518 }, 00:17:17.518 "multi_ctrlr": true, 00:17:17.518 "ana_reporting": false 00:17:17.518 }, 00:17:17.518 "vs": { 00:17:17.518 "nvme_version": "1.3" 00:17:17.518 }, 00:17:17.518 "ns_data": { 00:17:17.518 "id": 1, 00:17:17.518 "can_share": true 00:17:17.518 } 00:17:17.518 } 00:17:17.518 ], 00:17:17.518 "mp_policy": "active_passive" 00:17:17.518 } 00:17:17.518 } 00:17:17.518 ] 00:17:17.518 03:12:20 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2448596 00:17:17.518 03:12:20 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:17.518 03:12:20 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:17.518 Running I/O for 10 seconds... 00:17:18.893 Latency(us) 00:17:18.894 [2024-11-27T02:12:21.513Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:18.894 [2024-11-27T02:12:21.513Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:18.894 Nvme0n1 : 1.00 14753.00 57.63 0.00 0.00 0.00 0.00 0.00 00:17:18.894 [2024-11-27T02:12:21.513Z] =================================================================================================================== 00:17:18.894 [2024-11-27T02:12:21.513Z] Total : 14753.00 57.63 0.00 0.00 0.00 0.00 0.00 00:17:18.894 00:17:19.517 03:12:22 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:19.801 [2024-11-27T02:12:22.420Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:19.801 Nvme0n1 : 2.00 15042.50 58.76 0.00 0.00 0.00 0.00 0.00 00:17:19.801 [2024-11-27T02:12:22.420Z] =================================================================================================================== 00:17:19.801 [2024-11-27T02:12:22.420Z] Total : 15042.50 58.76 0.00 0.00 0.00 0.00 0.00 00:17:19.801 00:17:19.801 true 00:17:19.801 03:12:22 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:19.801 03:12:22 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:20.059 03:12:22 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:20.059 03:12:22 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:20.059 03:12:22 -- target/nvmf_lvs_grow.sh@65 -- # wait 2448596 00:17:20.625 [2024-11-27T02:12:23.244Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:20.625 Nvme0n1 : 3.00 15116.00 59.05 0.00 0.00 0.00 0.00 0.00 00:17:20.625 [2024-11-27T02:12:23.244Z] =================================================================================================================== 00:17:20.625 [2024-11-27T02:12:23.244Z] Total : 15116.00 59.05 0.00 0.00 0.00 0.00 0.00 00:17:20.625 00:17:21.559 [2024-11-27T02:12:24.178Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:21.559 Nvme0n1 : 4.00 15126.00 59.09 0.00 0.00 0.00 0.00 0.00 00:17:21.559 [2024-11-27T02:12:24.178Z] =================================================================================================================== 00:17:21.559 [2024-11-27T02:12:24.178Z] Total : 15126.00 59.09 0.00 0.00 0.00 0.00 0.00 00:17:21.559 00:17:22.932 [2024-11-27T02:12:25.551Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:22.932 Nvme0n1 : 5.00 15122.20 59.07 0.00 0.00 0.00 0.00 0.00 00:17:22.932 [2024-11-27T02:12:25.551Z] =================================================================================================================== 00:17:22.932 [2024-11-27T02:12:25.551Z] Total : 15122.20 59.07 0.00 0.00 0.00 0.00 0.00 00:17:22.932 00:17:23.865 [2024-11-27T02:12:26.484Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:23.865 Nvme0n1 : 6.00 15060.83 58.83 0.00 0.00 0.00 0.00 0.00 00:17:23.865 [2024-11-27T02:12:26.484Z] =================================================================================================================== 00:17:23.865 [2024-11-27T02:12:26.484Z] Total : 15060.83 58.83 0.00 0.00 0.00 0.00 0.00 00:17:23.865 00:17:24.797 [2024-11-27T02:12:27.416Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:24.797 Nvme0n1 : 7.00 14932.14 58.33 0.00 0.00 0.00 0.00 0.00 00:17:24.797 [2024-11-27T02:12:27.416Z] =================================================================================================================== 00:17:24.797 [2024-11-27T02:12:27.416Z] Total : 14932.14 58.33 0.00 0.00 0.00 0.00 0.00 00:17:24.797 00:17:25.731 [2024-11-27T02:12:28.350Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:25.731 Nvme0n1 : 8.00 14842.62 57.98 0.00 0.00 0.00 0.00 0.00 00:17:25.731 [2024-11-27T02:12:28.350Z] =================================================================================================================== 00:17:25.731 [2024-11-27T02:12:28.350Z] Total : 14842.62 57.98 0.00 0.00 0.00 0.00 0.00 00:17:25.731 00:17:26.664 [2024-11-27T02:12:29.283Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:26.664 Nvme0n1 : 9.00 14768.56 57.69 0.00 0.00 0.00 0.00 0.00 00:17:26.664 [2024-11-27T02:12:29.283Z] =================================================================================================================== 00:17:26.664 [2024-11-27T02:12:29.283Z] Total : 14768.56 57.69 0.00 0.00 0.00 0.00 0.00 00:17:26.664 00:17:27.596 [2024-11-27T02:12:30.216Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:27.597 Nvme0n1 : 10.00 14709.30 57.46 0.00 0.00 0.00 0.00 0.00 00:17:27.597 [2024-11-27T02:12:30.216Z] =================================================================================================================== 00:17:27.597 [2024-11-27T02:12:30.216Z] Total : 14709.30 57.46 0.00 0.00 0.00 0.00 0.00 00:17:27.597 00:17:27.597 00:17:27.597 Latency(us) 00:17:27.597 [2024-11-27T02:12:30.216Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:27.597 [2024-11-27T02:12:30.216Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:27.597 Nvme0n1 : 10.01 14706.88 57.45 0.00 0.00 8695.45 2415.12 18350.08 00:17:27.597 [2024-11-27T02:12:30.216Z] =================================================================================================================== 00:17:27.597 [2024-11-27T02:12:30.216Z] Total : 14706.88 57.45 0.00 0.00 8695.45 2415.12 18350.08 00:17:27.597 0 00:17:27.597 03:12:30 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2448444 00:17:27.597 03:12:30 -- common/autotest_common.sh@936 -- # '[' -z 2448444 ']' 00:17:27.597 03:12:30 -- common/autotest_common.sh@940 -- # kill -0 2448444 00:17:27.597 03:12:30 -- common/autotest_common.sh@941 -- # uname 00:17:27.597 03:12:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:27.597 03:12:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2448444 00:17:27.597 03:12:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:27.597 03:12:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:27.597 03:12:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2448444' 00:17:27.597 killing process with pid 2448444 00:17:27.597 03:12:30 -- common/autotest_common.sh@955 -- # kill 2448444 00:17:27.597 Received shutdown signal, test time was about 10.000000 seconds 00:17:27.597 00:17:27.597 Latency(us) 00:17:27.597 [2024-11-27T02:12:30.216Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:27.597 [2024-11-27T02:12:30.216Z] =================================================================================================================== 00:17:27.597 [2024-11-27T02:12:30.216Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:27.597 03:12:30 -- common/autotest_common.sh@960 -- # wait 2448444 00:17:27.855 03:12:30 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:28.420 03:12:30 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:28.420 03:12:30 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:28.420 03:12:31 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:28.420 03:12:31 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:28.420 03:12:31 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:28.678 [2024-11-27 03:12:31.236287] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:28.678 03:12:31 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:28.678 03:12:31 -- common/autotest_common.sh@650 -- # local es=0 00:17:28.678 03:12:31 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:28.678 03:12:31 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.678 03:12:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:28.678 03:12:31 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.678 03:12:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:28.678 03:12:31 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.678 03:12:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:28.678 03:12:31 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.678 03:12:31 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:28.678 03:12:31 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:29.243 request: 00:17:29.243 { 00:17:29.243 "uuid": "758536e3-e50c-4a96-99d2-2aacf01cee67", 00:17:29.243 "method": "bdev_lvol_get_lvstores", 00:17:29.243 "req_id": 1 00:17:29.243 } 00:17:29.243 Got JSON-RPC error response 00:17:29.243 response: 00:17:29.243 { 00:17:29.243 "code": -19, 00:17:29.243 "message": "No such device" 00:17:29.243 } 00:17:29.243 03:12:31 -- common/autotest_common.sh@653 -- # es=1 00:17:29.243 03:12:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:29.243 03:12:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:29.243 03:12:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:29.243 03:12:31 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:29.243 aio_bdev 00:17:29.243 03:12:31 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 947abd41-0a99-4cac-95a0-f9853574a78c 00:17:29.243 03:12:31 -- common/autotest_common.sh@897 -- # local bdev_name=947abd41-0a99-4cac-95a0-f9853574a78c 00:17:29.243 03:12:31 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:29.243 03:12:31 -- common/autotest_common.sh@899 -- # local i 00:17:29.243 03:12:31 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:29.243 03:12:31 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:29.243 03:12:31 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:29.501 03:12:32 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 947abd41-0a99-4cac-95a0-f9853574a78c -t 2000 00:17:29.759 [ 00:17:29.759 { 00:17:29.759 "name": "947abd41-0a99-4cac-95a0-f9853574a78c", 00:17:29.759 "aliases": [ 00:17:29.759 "lvs/lvol" 00:17:29.759 ], 00:17:29.759 "product_name": "Logical Volume", 00:17:29.759 "block_size": 4096, 00:17:29.759 "num_blocks": 38912, 00:17:29.759 "uuid": "947abd41-0a99-4cac-95a0-f9853574a78c", 00:17:29.759 "assigned_rate_limits": { 00:17:29.759 "rw_ios_per_sec": 0, 00:17:29.759 "rw_mbytes_per_sec": 0, 00:17:29.759 "r_mbytes_per_sec": 0, 00:17:29.759 "w_mbytes_per_sec": 0 00:17:29.759 }, 00:17:29.759 "claimed": false, 00:17:29.759 "zoned": false, 00:17:29.759 "supported_io_types": { 00:17:29.759 "read": true, 00:17:29.759 "write": true, 00:17:29.759 "unmap": true, 00:17:29.759 "write_zeroes": true, 00:17:29.759 "flush": false, 00:17:29.759 "reset": true, 00:17:29.759 "compare": false, 00:17:29.759 "compare_and_write": false, 00:17:29.759 "abort": false, 00:17:29.759 "nvme_admin": false, 00:17:29.759 "nvme_io": false 00:17:29.759 }, 00:17:29.759 "driver_specific": { 00:17:29.759 "lvol": { 00:17:29.759 "lvol_store_uuid": "758536e3-e50c-4a96-99d2-2aacf01cee67", 00:17:29.759 "base_bdev": "aio_bdev", 00:17:29.759 "thin_provision": false, 00:17:29.759 "snapshot": false, 00:17:29.759 "clone": false, 00:17:29.759 "esnap_clone": false 00:17:29.759 } 00:17:29.759 } 00:17:29.759 } 00:17:29.759 ] 00:17:29.759 03:12:32 -- common/autotest_common.sh@905 -- # return 0 00:17:29.759 03:12:32 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:29.759 03:12:32 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:30.016 03:12:32 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:30.016 03:12:32 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:30.017 03:12:32 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:30.274 03:12:32 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:30.274 03:12:32 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 947abd41-0a99-4cac-95a0-f9853574a78c 00:17:30.840 03:12:33 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 758536e3-e50c-4a96-99d2-2aacf01cee67 00:17:30.840 03:12:33 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:31.098 03:12:33 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:31.098 00:17:31.098 real 0m17.845s 00:17:31.098 user 0m16.805s 00:17:31.098 sys 0m2.189s 00:17:31.098 03:12:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:31.098 03:12:33 -- common/autotest_common.sh@10 -- # set +x 00:17:31.098 ************************************ 00:17:31.098 END TEST lvs_grow_clean 00:17:31.098 ************************************ 00:17:31.356 03:12:33 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:31.357 03:12:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:31.357 03:12:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:31.357 03:12:33 -- common/autotest_common.sh@10 -- # set +x 00:17:31.357 ************************************ 00:17:31.357 START TEST lvs_grow_dirty 00:17:31.357 ************************************ 00:17:31.357 03:12:33 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:31.357 03:12:33 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:31.357 03:12:33 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:31.357 03:12:33 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:31.357 03:12:33 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:31.357 03:12:33 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:31.357 03:12:33 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:31.357 03:12:33 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:31.357 03:12:33 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:31.357 03:12:33 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:31.615 03:12:34 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:31.615 03:12:34 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:31.872 03:12:34 -- target/nvmf_lvs_grow.sh@28 -- # lvs=005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:31.872 03:12:34 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:31.872 03:12:34 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:32.130 03:12:34 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:32.130 03:12:34 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:32.130 03:12:34 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 005589e7-be3c-4c97-8644-fb5d242bbabf lvol 150 00:17:32.387 03:12:34 -- target/nvmf_lvs_grow.sh@33 -- # lvol=7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429 00:17:32.387 03:12:34 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:32.387 03:12:34 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:32.645 [2024-11-27 03:12:35.123138] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:32.645 [2024-11-27 03:12:35.123240] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:32.645 true 00:17:32.645 03:12:35 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:32.645 03:12:35 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:32.903 03:12:35 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:32.903 03:12:35 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:33.160 03:12:35 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429 00:17:33.418 03:12:35 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:33.675 03:12:36 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:33.933 03:12:36 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2450682 00:17:33.933 03:12:36 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:33.933 03:12:36 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:33.933 03:12:36 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2450682 /var/tmp/bdevperf.sock 00:17:33.933 03:12:36 -- common/autotest_common.sh@829 -- # '[' -z 2450682 ']' 00:17:33.933 03:12:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:33.933 03:12:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:33.933 03:12:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:33.933 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:33.933 03:12:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:33.933 03:12:36 -- common/autotest_common.sh@10 -- # set +x 00:17:33.933 [2024-11-27 03:12:36.470861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:33.933 [2024-11-27 03:12:36.470946] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2450682 ] 00:17:33.933 EAL: No free 2048 kB hugepages reported on node 1 00:17:33.933 [2024-11-27 03:12:36.533656] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:34.191 [2024-11-27 03:12:36.623436] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:35.121 03:12:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:35.121 03:12:37 -- common/autotest_common.sh@862 -- # return 0 00:17:35.121 03:12:37 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:35.378 Nvme0n1 00:17:35.378 03:12:37 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:35.635 [ 00:17:35.635 { 00:17:35.635 "name": "Nvme0n1", 00:17:35.635 "aliases": [ 00:17:35.635 "7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429" 00:17:35.635 ], 00:17:35.635 "product_name": "NVMe disk", 00:17:35.635 "block_size": 4096, 00:17:35.635 "num_blocks": 38912, 00:17:35.635 "uuid": "7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429", 00:17:35.635 "assigned_rate_limits": { 00:17:35.635 "rw_ios_per_sec": 0, 00:17:35.635 "rw_mbytes_per_sec": 0, 00:17:35.635 "r_mbytes_per_sec": 0, 00:17:35.635 "w_mbytes_per_sec": 0 00:17:35.635 }, 00:17:35.635 "claimed": false, 00:17:35.635 "zoned": false, 00:17:35.635 "supported_io_types": { 00:17:35.635 "read": true, 00:17:35.635 "write": true, 00:17:35.635 "unmap": true, 00:17:35.635 "write_zeroes": true, 00:17:35.635 "flush": true, 00:17:35.635 "reset": true, 00:17:35.635 "compare": true, 00:17:35.635 "compare_and_write": true, 00:17:35.635 "abort": true, 00:17:35.635 "nvme_admin": true, 00:17:35.635 "nvme_io": true 00:17:35.635 }, 00:17:35.635 "driver_specific": { 00:17:35.635 "nvme": [ 00:17:35.635 { 00:17:35.635 "trid": { 00:17:35.635 "trtype": "TCP", 00:17:35.635 "adrfam": "IPv4", 00:17:35.635 "traddr": "10.0.0.2", 00:17:35.635 "trsvcid": "4420", 00:17:35.635 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:35.635 }, 00:17:35.635 "ctrlr_data": { 00:17:35.635 "cntlid": 1, 00:17:35.635 "vendor_id": "0x8086", 00:17:35.635 "model_number": "SPDK bdev Controller", 00:17:35.635 "serial_number": "SPDK0", 00:17:35.635 "firmware_revision": "24.01.1", 00:17:35.635 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:35.635 "oacs": { 00:17:35.635 "security": 0, 00:17:35.635 "format": 0, 00:17:35.635 "firmware": 0, 00:17:35.635 "ns_manage": 0 00:17:35.635 }, 00:17:35.635 "multi_ctrlr": true, 00:17:35.635 "ana_reporting": false 00:17:35.635 }, 00:17:35.635 "vs": { 00:17:35.635 "nvme_version": "1.3" 00:17:35.635 }, 00:17:35.635 "ns_data": { 00:17:35.635 "id": 1, 00:17:35.635 "can_share": true 00:17:35.635 } 00:17:35.635 } 00:17:35.635 ], 00:17:35.635 "mp_policy": "active_passive" 00:17:35.635 } 00:17:35.635 } 00:17:35.635 ] 00:17:35.635 03:12:38 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2450835 00:17:35.635 03:12:38 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:35.635 03:12:38 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:35.635 Running I/O for 10 seconds... 00:17:37.013 Latency(us) 00:17:37.013 [2024-11-27T02:12:39.632Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.013 [2024-11-27T02:12:39.632Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:37.013 Nvme0n1 : 1.00 14993.00 58.57 0.00 0.00 0.00 0.00 0.00 00:17:37.013 [2024-11-27T02:12:39.632Z] =================================================================================================================== 00:17:37.013 [2024-11-27T02:12:39.632Z] Total : 14993.00 58.57 0.00 0.00 0.00 0.00 0.00 00:17:37.013 00:17:37.578 03:12:40 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:37.835 [2024-11-27T02:12:40.454Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:37.835 Nvme0n1 : 2.00 15060.00 58.83 0.00 0.00 0.00 0.00 0.00 00:17:37.835 [2024-11-27T02:12:40.454Z] =================================================================================================================== 00:17:37.835 [2024-11-27T02:12:40.454Z] Total : 15060.00 58.83 0.00 0.00 0.00 0.00 0.00 00:17:37.835 00:17:37.835 true 00:17:37.835 03:12:40 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:37.835 03:12:40 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:38.093 03:12:40 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:38.093 03:12:40 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:38.093 03:12:40 -- target/nvmf_lvs_grow.sh@65 -- # wait 2450835 00:17:38.660 [2024-11-27T02:12:41.279Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:38.660 Nvme0n1 : 3.00 15304.33 59.78 0.00 0.00 0.00 0.00 0.00 00:17:38.660 [2024-11-27T02:12:41.279Z] =================================================================================================================== 00:17:38.660 [2024-11-27T02:12:41.279Z] Total : 15304.33 59.78 0.00 0.00 0.00 0.00 0.00 00:17:38.660 00:17:40.034 [2024-11-27T02:12:42.653Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.034 Nvme0n1 : 4.00 15243.50 59.54 0.00 0.00 0.00 0.00 0.00 00:17:40.034 [2024-11-27T02:12:42.653Z] =================================================================================================================== 00:17:40.034 [2024-11-27T02:12:42.653Z] Total : 15243.50 59.54 0.00 0.00 0.00 0.00 0.00 00:17:40.034 00:17:40.969 [2024-11-27T02:12:43.588Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.969 Nvme0n1 : 5.00 15230.40 59.49 0.00 0.00 0.00 0.00 0.00 00:17:40.969 [2024-11-27T02:12:43.588Z] =================================================================================================================== 00:17:40.969 [2024-11-27T02:12:43.588Z] Total : 15230.40 59.49 0.00 0.00 0.00 0.00 0.00 00:17:40.969 00:17:41.904 [2024-11-27T02:12:44.523Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.904 Nvme0n1 : 6.00 15233.67 59.51 0.00 0.00 0.00 0.00 0.00 00:17:41.904 [2024-11-27T02:12:44.523Z] =================================================================================================================== 00:17:41.904 [2024-11-27T02:12:44.523Z] Total : 15233.67 59.51 0.00 0.00 0.00 0.00 0.00 00:17:41.904 00:17:42.838 [2024-11-27T02:12:45.457Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.838 Nvme0n1 : 7.00 15234.57 59.51 0.00 0.00 0.00 0.00 0.00 00:17:42.838 [2024-11-27T02:12:45.457Z] =================================================================================================================== 00:17:42.838 [2024-11-27T02:12:45.457Z] Total : 15234.57 59.51 0.00 0.00 0.00 0.00 0.00 00:17:42.838 00:17:43.771 [2024-11-27T02:12:46.390Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.771 Nvme0n1 : 8.00 15235.25 59.51 0.00 0.00 0.00 0.00 0.00 00:17:43.771 [2024-11-27T02:12:46.390Z] =================================================================================================================== 00:17:43.771 [2024-11-27T02:12:46.390Z] Total : 15235.25 59.51 0.00 0.00 0.00 0.00 0.00 00:17:43.771 00:17:44.705 [2024-11-27T02:12:47.324Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.705 Nvme0n1 : 9.00 15239.67 59.53 0.00 0.00 0.00 0.00 0.00 00:17:44.705 [2024-11-27T02:12:47.324Z] =================================================================================================================== 00:17:44.705 [2024-11-27T02:12:47.324Z] Total : 15239.67 59.53 0.00 0.00 0.00 0.00 0.00 00:17:44.705 00:17:45.648 [2024-11-27T02:12:48.267Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.648 Nvme0n1 : 10.00 15235.90 59.52 0.00 0.00 0.00 0.00 0.00 00:17:45.648 [2024-11-27T02:12:48.267Z] =================================================================================================================== 00:17:45.648 [2024-11-27T02:12:48.268Z] Total : 15235.90 59.52 0.00 0.00 0.00 0.00 0.00 00:17:45.649 00:17:45.649 00:17:45.649 Latency(us) 00:17:45.649 [2024-11-27T02:12:48.268Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:45.649 [2024-11-27T02:12:48.268Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.649 Nvme0n1 : 10.01 15240.68 59.53 0.00 0.00 8394.08 3131.16 16505.36 00:17:45.649 [2024-11-27T02:12:48.268Z] =================================================================================================================== 00:17:45.649 [2024-11-27T02:12:48.268Z] Total : 15240.68 59.53 0.00 0.00 8394.08 3131.16 16505.36 00:17:45.649 0 00:17:45.951 03:12:48 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2450682 00:17:45.951 03:12:48 -- common/autotest_common.sh@936 -- # '[' -z 2450682 ']' 00:17:45.951 03:12:48 -- common/autotest_common.sh@940 -- # kill -0 2450682 00:17:45.951 03:12:48 -- common/autotest_common.sh@941 -- # uname 00:17:45.951 03:12:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:45.951 03:12:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2450682 00:17:45.951 03:12:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:45.951 03:12:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:45.951 03:12:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2450682' 00:17:45.951 killing process with pid 2450682 00:17:45.951 03:12:48 -- common/autotest_common.sh@955 -- # kill 2450682 00:17:45.951 Received shutdown signal, test time was about 10.000000 seconds 00:17:45.951 00:17:45.951 Latency(us) 00:17:45.951 [2024-11-27T02:12:48.570Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:45.951 [2024-11-27T02:12:48.570Z] =================================================================================================================== 00:17:45.951 [2024-11-27T02:12:48.570Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:45.951 03:12:48 -- common/autotest_common.sh@960 -- # wait 2450682 00:17:45.951 03:12:48 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:46.210 03:12:48 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:46.210 03:12:48 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:46.469 03:12:49 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:46.469 03:12:49 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:17:46.469 03:12:49 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2447870 00:17:46.469 03:12:49 -- target/nvmf_lvs_grow.sh@74 -- # wait 2447870 00:17:46.726 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2447870 Killed "${NVMF_APP[@]}" "$@" 00:17:46.726 03:12:49 -- target/nvmf_lvs_grow.sh@74 -- # true 00:17:46.726 03:12:49 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:17:46.726 03:12:49 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:46.726 03:12:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:46.726 03:12:49 -- common/autotest_common.sh@10 -- # set +x 00:17:46.726 03:12:49 -- nvmf/common.sh@469 -- # nvmfpid=2452199 00:17:46.726 03:12:49 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:46.726 03:12:49 -- nvmf/common.sh@470 -- # waitforlisten 2452199 00:17:46.726 03:12:49 -- common/autotest_common.sh@829 -- # '[' -z 2452199 ']' 00:17:46.726 03:12:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:46.726 03:12:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:46.726 03:12:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:46.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:46.726 03:12:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:46.726 03:12:49 -- common/autotest_common.sh@10 -- # set +x 00:17:46.726 [2024-11-27 03:12:49.142910] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:46.726 [2024-11-27 03:12:49.143003] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:46.726 EAL: No free 2048 kB hugepages reported on node 1 00:17:46.726 [2024-11-27 03:12:49.212197] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:46.726 [2024-11-27 03:12:49.295227] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:46.726 [2024-11-27 03:12:49.295380] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:46.726 [2024-11-27 03:12:49.295396] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:46.726 [2024-11-27 03:12:49.295408] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:46.726 [2024-11-27 03:12:49.295432] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:47.658 03:12:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:47.658 03:12:50 -- common/autotest_common.sh@862 -- # return 0 00:17:47.659 03:12:50 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:47.659 03:12:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:47.659 03:12:50 -- common/autotest_common.sh@10 -- # set +x 00:17:47.659 03:12:50 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:47.659 03:12:50 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:47.916 [2024-11-27 03:12:50.407481] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:17:47.916 [2024-11-27 03:12:50.407649] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:17:47.916 [2024-11-27 03:12:50.407697] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:17:47.916 03:12:50 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:17:47.916 03:12:50 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429 00:17:47.916 03:12:50 -- common/autotest_common.sh@897 -- # local bdev_name=7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429 00:17:47.916 03:12:50 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:47.916 03:12:50 -- common/autotest_common.sh@899 -- # local i 00:17:47.917 03:12:50 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:47.917 03:12:50 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:47.917 03:12:50 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:48.175 03:12:50 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429 -t 2000 00:17:48.433 [ 00:17:48.433 { 00:17:48.433 "name": "7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429", 00:17:48.433 "aliases": [ 00:17:48.433 "lvs/lvol" 00:17:48.433 ], 00:17:48.433 "product_name": "Logical Volume", 00:17:48.433 "block_size": 4096, 00:17:48.433 "num_blocks": 38912, 00:17:48.433 "uuid": "7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429", 00:17:48.433 "assigned_rate_limits": { 00:17:48.433 "rw_ios_per_sec": 0, 00:17:48.433 "rw_mbytes_per_sec": 0, 00:17:48.433 "r_mbytes_per_sec": 0, 00:17:48.433 "w_mbytes_per_sec": 0 00:17:48.433 }, 00:17:48.433 "claimed": false, 00:17:48.433 "zoned": false, 00:17:48.433 "supported_io_types": { 00:17:48.433 "read": true, 00:17:48.433 "write": true, 00:17:48.433 "unmap": true, 00:17:48.433 "write_zeroes": true, 00:17:48.433 "flush": false, 00:17:48.433 "reset": true, 00:17:48.433 "compare": false, 00:17:48.433 "compare_and_write": false, 00:17:48.433 "abort": false, 00:17:48.433 "nvme_admin": false, 00:17:48.433 "nvme_io": false 00:17:48.433 }, 00:17:48.433 "driver_specific": { 00:17:48.433 "lvol": { 00:17:48.433 "lvol_store_uuid": "005589e7-be3c-4c97-8644-fb5d242bbabf", 00:17:48.433 "base_bdev": "aio_bdev", 00:17:48.433 "thin_provision": false, 00:17:48.433 "snapshot": false, 00:17:48.433 "clone": false, 00:17:48.433 "esnap_clone": false 00:17:48.433 } 00:17:48.433 } 00:17:48.433 } 00:17:48.433 ] 00:17:48.433 03:12:50 -- common/autotest_common.sh@905 -- # return 0 00:17:48.433 03:12:50 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:48.433 03:12:50 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:17:48.691 03:12:51 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:17:48.691 03:12:51 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:48.691 03:12:51 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:17:48.949 03:12:51 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:17:48.949 03:12:51 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:49.207 [2024-11-27 03:12:51.688676] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:49.207 03:12:51 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:49.207 03:12:51 -- common/autotest_common.sh@650 -- # local es=0 00:17:49.207 03:12:51 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:49.207 03:12:51 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.207 03:12:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.207 03:12:51 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.207 03:12:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.207 03:12:51 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.207 03:12:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.207 03:12:51 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:49.207 03:12:51 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:49.207 03:12:51 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:49.464 request: 00:17:49.464 { 00:17:49.464 "uuid": "005589e7-be3c-4c97-8644-fb5d242bbabf", 00:17:49.464 "method": "bdev_lvol_get_lvstores", 00:17:49.464 "req_id": 1 00:17:49.464 } 00:17:49.464 Got JSON-RPC error response 00:17:49.464 response: 00:17:49.464 { 00:17:49.464 "code": -19, 00:17:49.464 "message": "No such device" 00:17:49.464 } 00:17:49.464 03:12:52 -- common/autotest_common.sh@653 -- # es=1 00:17:49.464 03:12:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:49.464 03:12:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:49.464 03:12:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:49.464 03:12:52 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:49.722 aio_bdev 00:17:49.722 03:12:52 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429 00:17:49.722 03:12:52 -- common/autotest_common.sh@897 -- # local bdev_name=7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429 00:17:49.722 03:12:52 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:49.722 03:12:52 -- common/autotest_common.sh@899 -- # local i 00:17:49.722 03:12:52 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:49.722 03:12:52 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:49.722 03:12:52 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:49.979 03:12:52 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429 -t 2000 00:17:50.237 [ 00:17:50.237 { 00:17:50.237 "name": "7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429", 00:17:50.237 "aliases": [ 00:17:50.237 "lvs/lvol" 00:17:50.237 ], 00:17:50.237 "product_name": "Logical Volume", 00:17:50.237 "block_size": 4096, 00:17:50.237 "num_blocks": 38912, 00:17:50.237 "uuid": "7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429", 00:17:50.237 "assigned_rate_limits": { 00:17:50.237 "rw_ios_per_sec": 0, 00:17:50.237 "rw_mbytes_per_sec": 0, 00:17:50.237 "r_mbytes_per_sec": 0, 00:17:50.237 "w_mbytes_per_sec": 0 00:17:50.237 }, 00:17:50.237 "claimed": false, 00:17:50.237 "zoned": false, 00:17:50.237 "supported_io_types": { 00:17:50.237 "read": true, 00:17:50.237 "write": true, 00:17:50.237 "unmap": true, 00:17:50.237 "write_zeroes": true, 00:17:50.237 "flush": false, 00:17:50.237 "reset": true, 00:17:50.237 "compare": false, 00:17:50.237 "compare_and_write": false, 00:17:50.237 "abort": false, 00:17:50.237 "nvme_admin": false, 00:17:50.237 "nvme_io": false 00:17:50.237 }, 00:17:50.237 "driver_specific": { 00:17:50.237 "lvol": { 00:17:50.237 "lvol_store_uuid": "005589e7-be3c-4c97-8644-fb5d242bbabf", 00:17:50.237 "base_bdev": "aio_bdev", 00:17:50.237 "thin_provision": false, 00:17:50.237 "snapshot": false, 00:17:50.237 "clone": false, 00:17:50.237 "esnap_clone": false 00:17:50.237 } 00:17:50.237 } 00:17:50.237 } 00:17:50.237 ] 00:17:50.237 03:12:52 -- common/autotest_common.sh@905 -- # return 0 00:17:50.237 03:12:52 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:50.237 03:12:52 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:50.494 03:12:53 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:50.494 03:12:53 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:50.494 03:12:53 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:50.751 03:12:53 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:50.751 03:12:53 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7a3f0cb3-ef8d-4a3d-b1c9-38ec48e62429 00:17:51.316 03:12:53 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 005589e7-be3c-4c97-8644-fb5d242bbabf 00:17:51.316 03:12:53 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:51.573 03:12:54 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:51.829 00:17:51.829 real 0m20.480s 00:17:51.829 user 0m51.121s 00:17:51.829 sys 0m4.703s 00:17:51.829 03:12:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:51.829 03:12:54 -- common/autotest_common.sh@10 -- # set +x 00:17:51.829 ************************************ 00:17:51.829 END TEST lvs_grow_dirty 00:17:51.829 ************************************ 00:17:51.829 03:12:54 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:17:51.829 03:12:54 -- common/autotest_common.sh@806 -- # type=--id 00:17:51.829 03:12:54 -- common/autotest_common.sh@807 -- # id=0 00:17:51.829 03:12:54 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:17:51.829 03:12:54 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:17:51.829 03:12:54 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:17:51.829 03:12:54 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:17:51.829 03:12:54 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:17:51.829 03:12:54 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:17:51.829 nvmf_trace.0 00:17:51.829 03:12:54 -- common/autotest_common.sh@821 -- # return 0 00:17:51.829 03:12:54 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:17:51.829 03:12:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:51.829 03:12:54 -- nvmf/common.sh@116 -- # sync 00:17:51.829 03:12:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:51.829 03:12:54 -- nvmf/common.sh@119 -- # set +e 00:17:51.829 03:12:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:51.829 03:12:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:51.829 rmmod nvme_tcp 00:17:51.829 rmmod nvme_fabrics 00:17:51.829 rmmod nvme_keyring 00:17:51.829 03:12:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:51.829 03:12:54 -- nvmf/common.sh@123 -- # set -e 00:17:51.829 03:12:54 -- nvmf/common.sh@124 -- # return 0 00:17:51.829 03:12:54 -- nvmf/common.sh@477 -- # '[' -n 2452199 ']' 00:17:51.829 03:12:54 -- nvmf/common.sh@478 -- # killprocess 2452199 00:17:51.829 03:12:54 -- common/autotest_common.sh@936 -- # '[' -z 2452199 ']' 00:17:51.829 03:12:54 -- common/autotest_common.sh@940 -- # kill -0 2452199 00:17:51.829 03:12:54 -- common/autotest_common.sh@941 -- # uname 00:17:51.829 03:12:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:51.829 03:12:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2452199 00:17:51.829 03:12:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:51.829 03:12:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:51.829 03:12:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2452199' 00:17:51.829 killing process with pid 2452199 00:17:51.829 03:12:54 -- common/autotest_common.sh@955 -- # kill 2452199 00:17:51.829 03:12:54 -- common/autotest_common.sh@960 -- # wait 2452199 00:17:52.087 03:12:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:52.087 03:12:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:52.087 03:12:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:52.087 03:12:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:52.087 03:12:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:52.087 03:12:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:52.087 03:12:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:52.087 03:12:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:54.618 03:12:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:54.618 00:17:54.618 real 0m44.397s 00:17:54.618 user 1m14.785s 00:17:54.618 sys 0m8.786s 00:17:54.618 03:12:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:54.618 03:12:56 -- common/autotest_common.sh@10 -- # set +x 00:17:54.618 ************************************ 00:17:54.618 END TEST nvmf_lvs_grow 00:17:54.618 ************************************ 00:17:54.618 03:12:56 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:54.618 03:12:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:54.618 03:12:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:54.618 03:12:56 -- common/autotest_common.sh@10 -- # set +x 00:17:54.618 ************************************ 00:17:54.618 START TEST nvmf_bdev_io_wait 00:17:54.618 ************************************ 00:17:54.618 03:12:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:17:54.618 * Looking for test storage... 00:17:54.618 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:54.618 03:12:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:54.618 03:12:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:54.618 03:12:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:54.618 03:12:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:54.618 03:12:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:54.618 03:12:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:54.618 03:12:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:54.618 03:12:56 -- scripts/common.sh@335 -- # IFS=.-: 00:17:54.618 03:12:56 -- scripts/common.sh@335 -- # read -ra ver1 00:17:54.618 03:12:56 -- scripts/common.sh@336 -- # IFS=.-: 00:17:54.618 03:12:56 -- scripts/common.sh@336 -- # read -ra ver2 00:17:54.618 03:12:56 -- scripts/common.sh@337 -- # local 'op=<' 00:17:54.618 03:12:56 -- scripts/common.sh@339 -- # ver1_l=2 00:17:54.618 03:12:56 -- scripts/common.sh@340 -- # ver2_l=1 00:17:54.618 03:12:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:54.618 03:12:56 -- scripts/common.sh@343 -- # case "$op" in 00:17:54.618 03:12:56 -- scripts/common.sh@344 -- # : 1 00:17:54.618 03:12:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:54.618 03:12:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:54.618 03:12:56 -- scripts/common.sh@364 -- # decimal 1 00:17:54.618 03:12:56 -- scripts/common.sh@352 -- # local d=1 00:17:54.618 03:12:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:54.618 03:12:56 -- scripts/common.sh@354 -- # echo 1 00:17:54.618 03:12:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:54.618 03:12:56 -- scripts/common.sh@365 -- # decimal 2 00:17:54.618 03:12:56 -- scripts/common.sh@352 -- # local d=2 00:17:54.618 03:12:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:54.618 03:12:56 -- scripts/common.sh@354 -- # echo 2 00:17:54.618 03:12:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:54.618 03:12:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:54.618 03:12:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:54.618 03:12:56 -- scripts/common.sh@367 -- # return 0 00:17:54.618 03:12:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:54.618 03:12:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:54.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:54.618 --rc genhtml_branch_coverage=1 00:17:54.618 --rc genhtml_function_coverage=1 00:17:54.618 --rc genhtml_legend=1 00:17:54.618 --rc geninfo_all_blocks=1 00:17:54.618 --rc geninfo_unexecuted_blocks=1 00:17:54.618 00:17:54.618 ' 00:17:54.618 03:12:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:54.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:54.618 --rc genhtml_branch_coverage=1 00:17:54.618 --rc genhtml_function_coverage=1 00:17:54.618 --rc genhtml_legend=1 00:17:54.618 --rc geninfo_all_blocks=1 00:17:54.618 --rc geninfo_unexecuted_blocks=1 00:17:54.618 00:17:54.618 ' 00:17:54.618 03:12:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:54.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:54.618 --rc genhtml_branch_coverage=1 00:17:54.618 --rc genhtml_function_coverage=1 00:17:54.618 --rc genhtml_legend=1 00:17:54.618 --rc geninfo_all_blocks=1 00:17:54.618 --rc geninfo_unexecuted_blocks=1 00:17:54.618 00:17:54.618 ' 00:17:54.618 03:12:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:54.618 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:54.618 --rc genhtml_branch_coverage=1 00:17:54.618 --rc genhtml_function_coverage=1 00:17:54.618 --rc genhtml_legend=1 00:17:54.618 --rc geninfo_all_blocks=1 00:17:54.618 --rc geninfo_unexecuted_blocks=1 00:17:54.618 00:17:54.618 ' 00:17:54.618 03:12:56 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:54.618 03:12:56 -- nvmf/common.sh@7 -- # uname -s 00:17:54.618 03:12:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:54.618 03:12:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:54.618 03:12:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:54.618 03:12:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:54.618 03:12:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:54.618 03:12:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:54.618 03:12:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:54.618 03:12:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:54.618 03:12:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:54.618 03:12:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:54.618 03:12:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:54.618 03:12:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:54.618 03:12:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:54.618 03:12:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:54.618 03:12:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:54.618 03:12:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:54.618 03:12:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:54.618 03:12:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:54.618 03:12:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:54.618 03:12:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.618 03:12:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.618 03:12:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.618 03:12:56 -- paths/export.sh@5 -- # export PATH 00:17:54.618 03:12:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:54.618 03:12:56 -- nvmf/common.sh@46 -- # : 0 00:17:54.618 03:12:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:54.618 03:12:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:54.618 03:12:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:54.618 03:12:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:54.618 03:12:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:54.618 03:12:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:54.618 03:12:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:54.618 03:12:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:54.618 03:12:56 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:54.618 03:12:56 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:54.618 03:12:56 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:17:54.618 03:12:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:54.618 03:12:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:54.618 03:12:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:54.618 03:12:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:54.618 03:12:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:54.618 03:12:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:54.618 03:12:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:54.618 03:12:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:54.618 03:12:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:54.618 03:12:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:54.618 03:12:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:54.618 03:12:56 -- common/autotest_common.sh@10 -- # set +x 00:17:56.521 03:12:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:56.521 03:12:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:56.521 03:12:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:56.521 03:12:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:56.521 03:12:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:56.521 03:12:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:56.521 03:12:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:56.521 03:12:58 -- nvmf/common.sh@294 -- # net_devs=() 00:17:56.521 03:12:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:56.521 03:12:58 -- nvmf/common.sh@295 -- # e810=() 00:17:56.521 03:12:58 -- nvmf/common.sh@295 -- # local -ga e810 00:17:56.521 03:12:58 -- nvmf/common.sh@296 -- # x722=() 00:17:56.521 03:12:58 -- nvmf/common.sh@296 -- # local -ga x722 00:17:56.521 03:12:58 -- nvmf/common.sh@297 -- # mlx=() 00:17:56.521 03:12:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:56.521 03:12:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:56.521 03:12:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:56.521 03:12:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:56.521 03:12:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:56.521 03:12:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:56.521 03:12:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:56.521 03:12:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:56.522 03:12:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:56.522 03:12:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:56.522 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:56.522 03:12:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:56.522 03:12:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:56.522 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:56.522 03:12:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:56.522 03:12:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:56.522 03:12:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:56.522 03:12:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:56.522 03:12:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:56.522 03:12:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:56.522 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:56.522 03:12:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:56.522 03:12:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:56.522 03:12:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:56.522 03:12:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:56.522 03:12:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:56.522 03:12:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:56.522 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:56.522 03:12:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:56.522 03:12:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:56.522 03:12:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:56.522 03:12:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:56.522 03:12:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:56.522 03:12:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:56.522 03:12:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:56.522 03:12:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:56.522 03:12:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:56.522 03:12:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:56.522 03:12:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:56.522 03:12:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:56.522 03:12:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:56.522 03:12:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:56.522 03:12:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:56.522 03:12:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:56.522 03:12:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:56.522 03:12:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:56.522 03:12:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:56.522 03:12:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:56.522 03:12:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:56.522 03:12:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:56.522 03:12:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:56.522 03:12:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:56.522 03:12:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:56.522 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:56.522 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.265 ms 00:17:56.522 00:17:56.522 --- 10.0.0.2 ping statistics --- 00:17:56.522 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:56.522 rtt min/avg/max/mdev = 0.265/0.265/0.265/0.000 ms 00:17:56.522 03:12:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:56.522 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:56.522 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:17:56.522 00:17:56.522 --- 10.0.0.1 ping statistics --- 00:17:56.522 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:56.522 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:17:56.522 03:12:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:56.522 03:12:59 -- nvmf/common.sh@410 -- # return 0 00:17:56.522 03:12:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:56.522 03:12:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:56.522 03:12:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:56.522 03:12:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:56.522 03:12:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:56.522 03:12:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:56.522 03:12:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:56.522 03:12:59 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:17:56.522 03:12:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:56.522 03:12:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:56.522 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:56.522 03:12:59 -- nvmf/common.sh@469 -- # nvmfpid=2454886 00:17:56.522 03:12:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:17:56.522 03:12:59 -- nvmf/common.sh@470 -- # waitforlisten 2454886 00:17:56.522 03:12:59 -- common/autotest_common.sh@829 -- # '[' -z 2454886 ']' 00:17:56.522 03:12:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:56.522 03:12:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:56.522 03:12:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:56.522 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:56.522 03:12:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:56.522 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:56.522 [2024-11-27 03:12:59.079570] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:56.522 [2024-11-27 03:12:59.079657] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:56.522 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.793 [2024-11-27 03:12:59.149948] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:56.793 [2024-11-27 03:12:59.240184] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:56.793 [2024-11-27 03:12:59.240344] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:56.793 [2024-11-27 03:12:59.240363] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:56.793 [2024-11-27 03:12:59.240378] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:56.793 [2024-11-27 03:12:59.240461] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:56.793 [2024-11-27 03:12:59.240516] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:56.793 [2024-11-27 03:12:59.240580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:56.793 [2024-11-27 03:12:59.240584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:56.793 03:12:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:56.793 03:12:59 -- common/autotest_common.sh@862 -- # return 0 00:17:56.793 03:12:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:56.793 03:12:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:56.793 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:56.794 03:12:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:56.794 03:12:59 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:17:56.794 03:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:56.794 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:56.794 03:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:56.794 03:12:59 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:17:56.794 03:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:56.794 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:56.794 03:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:56.794 03:12:59 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:56.794 03:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:56.794 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:56.794 [2024-11-27 03:12:59.393979] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:56.794 03:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:56.794 03:12:59 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:56.794 03:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:56.794 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:57.056 Malloc0 00:17:57.057 03:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:57.057 03:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:57.057 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:57.057 03:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:57.057 03:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:57.057 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:57.057 03:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:57.057 03:12:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:57.057 03:12:59 -- common/autotest_common.sh@10 -- # set +x 00:17:57.057 [2024-11-27 03:12:59.459272] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:57.057 03:12:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2454915 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@30 -- # READ_PID=2454916 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:17:57.057 03:12:59 -- nvmf/common.sh@520 -- # config=() 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2454919 00:17:57.057 03:12:59 -- nvmf/common.sh@520 -- # local subsystem config 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:17:57.057 03:12:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:57.057 03:12:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:57.057 { 00:17:57.057 "params": { 00:17:57.057 "name": "Nvme$subsystem", 00:17:57.057 "trtype": "$TEST_TRANSPORT", 00:17:57.057 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:57.057 "adrfam": "ipv4", 00:17:57.057 "trsvcid": "$NVMF_PORT", 00:17:57.057 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:57.057 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:57.057 "hdgst": ${hdgst:-false}, 00:17:57.057 "ddgst": ${ddgst:-false} 00:17:57.057 }, 00:17:57.057 "method": "bdev_nvme_attach_controller" 00:17:57.057 } 00:17:57.057 EOF 00:17:57.057 )") 00:17:57.057 03:12:59 -- nvmf/common.sh@520 -- # config=() 00:17:57.057 03:12:59 -- nvmf/common.sh@520 -- # local subsystem config 00:17:57.057 03:12:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2454921 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:17:57.057 03:12:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:57.057 { 00:17:57.057 "params": { 00:17:57.057 "name": "Nvme$subsystem", 00:17:57.057 "trtype": "$TEST_TRANSPORT", 00:17:57.057 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:57.057 "adrfam": "ipv4", 00:17:57.057 "trsvcid": "$NVMF_PORT", 00:17:57.057 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:57.057 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:57.057 "hdgst": ${hdgst:-false}, 00:17:57.057 "ddgst": ${ddgst:-false} 00:17:57.057 }, 00:17:57.057 "method": "bdev_nvme_attach_controller" 00:17:57.057 } 00:17:57.057 EOF 00:17:57.057 )") 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@35 -- # sync 00:17:57.057 03:12:59 -- nvmf/common.sh@520 -- # config=() 00:17:57.057 03:12:59 -- nvmf/common.sh@520 -- # local subsystem config 00:17:57.057 03:12:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:17:57.057 03:12:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:57.057 { 00:17:57.057 "params": { 00:17:57.057 "name": "Nvme$subsystem", 00:17:57.057 "trtype": "$TEST_TRANSPORT", 00:17:57.057 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:57.057 "adrfam": "ipv4", 00:17:57.057 "trsvcid": "$NVMF_PORT", 00:17:57.057 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:57.057 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:57.057 "hdgst": ${hdgst:-false}, 00:17:57.057 "ddgst": ${ddgst:-false} 00:17:57.057 }, 00:17:57.057 "method": "bdev_nvme_attach_controller" 00:17:57.057 } 00:17:57.057 EOF 00:17:57.057 )") 00:17:57.057 03:12:59 -- nvmf/common.sh@542 -- # cat 00:17:57.057 03:12:59 -- nvmf/common.sh@520 -- # config=() 00:17:57.057 03:12:59 -- nvmf/common.sh@520 -- # local subsystem config 00:17:57.057 03:12:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:57.057 03:12:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:57.057 { 00:17:57.057 "params": { 00:17:57.057 "name": "Nvme$subsystem", 00:17:57.057 "trtype": "$TEST_TRANSPORT", 00:17:57.057 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:57.057 "adrfam": "ipv4", 00:17:57.057 "trsvcid": "$NVMF_PORT", 00:17:57.057 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:57.057 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:57.057 "hdgst": ${hdgst:-false}, 00:17:57.057 "ddgst": ${ddgst:-false} 00:17:57.057 }, 00:17:57.057 "method": "bdev_nvme_attach_controller" 00:17:57.057 } 00:17:57.057 EOF 00:17:57.057 )") 00:17:57.057 03:12:59 -- nvmf/common.sh@542 -- # cat 00:17:57.057 03:12:59 -- nvmf/common.sh@542 -- # cat 00:17:57.057 03:12:59 -- target/bdev_io_wait.sh@37 -- # wait 2454915 00:17:57.057 03:12:59 -- nvmf/common.sh@542 -- # cat 00:17:57.057 03:12:59 -- nvmf/common.sh@544 -- # jq . 00:17:57.057 03:12:59 -- nvmf/common.sh@544 -- # jq . 00:17:57.057 03:12:59 -- nvmf/common.sh@544 -- # jq . 00:17:57.057 03:12:59 -- nvmf/common.sh@544 -- # jq . 00:17:57.057 03:12:59 -- nvmf/common.sh@545 -- # IFS=, 00:17:57.057 03:12:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:57.057 "params": { 00:17:57.057 "name": "Nvme1", 00:17:57.057 "trtype": "tcp", 00:17:57.057 "traddr": "10.0.0.2", 00:17:57.057 "adrfam": "ipv4", 00:17:57.057 "trsvcid": "4420", 00:17:57.057 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:57.057 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:57.057 "hdgst": false, 00:17:57.057 "ddgst": false 00:17:57.057 }, 00:17:57.057 "method": "bdev_nvme_attach_controller" 00:17:57.057 }' 00:17:57.057 03:12:59 -- nvmf/common.sh@545 -- # IFS=, 00:17:57.057 03:12:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:57.057 "params": { 00:17:57.057 "name": "Nvme1", 00:17:57.057 "trtype": "tcp", 00:17:57.057 "traddr": "10.0.0.2", 00:17:57.057 "adrfam": "ipv4", 00:17:57.057 "trsvcid": "4420", 00:17:57.057 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:57.057 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:57.057 "hdgst": false, 00:17:57.057 "ddgst": false 00:17:57.057 }, 00:17:57.057 "method": "bdev_nvme_attach_controller" 00:17:57.057 }' 00:17:57.057 03:12:59 -- nvmf/common.sh@545 -- # IFS=, 00:17:57.057 03:12:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:57.057 "params": { 00:17:57.057 "name": "Nvme1", 00:17:57.057 "trtype": "tcp", 00:17:57.057 "traddr": "10.0.0.2", 00:17:57.057 "adrfam": "ipv4", 00:17:57.057 "trsvcid": "4420", 00:17:57.057 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:57.057 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:57.057 "hdgst": false, 00:17:57.057 "ddgst": false 00:17:57.057 }, 00:17:57.057 "method": "bdev_nvme_attach_controller" 00:17:57.057 }' 00:17:57.057 03:12:59 -- nvmf/common.sh@545 -- # IFS=, 00:17:57.057 03:12:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:57.057 "params": { 00:17:57.057 "name": "Nvme1", 00:17:57.057 "trtype": "tcp", 00:17:57.057 "traddr": "10.0.0.2", 00:17:57.057 "adrfam": "ipv4", 00:17:57.057 "trsvcid": "4420", 00:17:57.057 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:57.057 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:57.057 "hdgst": false, 00:17:57.057 "ddgst": false 00:17:57.057 }, 00:17:57.057 "method": "bdev_nvme_attach_controller" 00:17:57.057 }' 00:17:57.057 [2024-11-27 03:12:59.505115] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:57.057 [2024-11-27 03:12:59.505182] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:17:57.057 [2024-11-27 03:12:59.505675] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:57.057 [2024-11-27 03:12:59.505673] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:57.057 [2024-11-27 03:12:59.505672] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:57.057 [2024-11-27 03:12:59.505759] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-27 03:12:59.505759] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-27 03:12:59.505759] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:17:57.057 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:17:57.057 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:17:57.057 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.057 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.316 [2024-11-27 03:12:59.686641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.316 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.316 [2024-11-27 03:12:59.759722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:57.316 [2024-11-27 03:12:59.786388] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.316 EAL: No free 2048 kB hugepages reported on node 1 00:17:57.316 [2024-11-27 03:12:59.859304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:57.316 [2024-11-27 03:12:59.884577] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.574 [2024-11-27 03:12:59.951848] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.574 [2024-11-27 03:12:59.953371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:57.574 [2024-11-27 03:13:00.019992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:17:57.574 Running I/O for 1 seconds... 00:17:57.833 Running I/O for 1 seconds... 00:17:57.833 Running I/O for 1 seconds... 00:17:57.833 Running I/O for 1 seconds... 00:17:58.766 00:17:58.766 Latency(us) 00:17:58.766 [2024-11-27T02:13:01.385Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.766 [2024-11-27T02:13:01.385Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:17:58.766 Nvme1n1 : 1.02 6320.27 24.69 0.00 0.00 19972.81 8689.59 34369.99 00:17:58.766 [2024-11-27T02:13:01.385Z] =================================================================================================================== 00:17:58.766 [2024-11-27T02:13:01.385Z] Total : 6320.27 24.69 0.00 0.00 19972.81 8689.59 34369.99 00:17:58.766 00:17:58.766 Latency(us) 00:17:58.766 [2024-11-27T02:13:01.385Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.766 [2024-11-27T02:13:01.385Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:17:58.766 Nvme1n1 : 1.00 190056.14 742.41 0.00 0.00 670.90 256.38 946.63 00:17:58.766 [2024-11-27T02:13:01.385Z] =================================================================================================================== 00:17:58.766 [2024-11-27T02:13:01.385Z] Total : 190056.14 742.41 0.00 0.00 670.90 256.38 946.63 00:17:58.766 00:17:58.766 Latency(us) 00:17:58.766 [2024-11-27T02:13:01.385Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.766 [2024-11-27T02:13:01.385Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:17:58.766 Nvme1n1 : 1.01 6097.75 23.82 0.00 0.00 20924.36 5971.06 43108.12 00:17:58.766 [2024-11-27T02:13:01.385Z] =================================================================================================================== 00:17:58.766 [2024-11-27T02:13:01.385Z] Total : 6097.75 23.82 0.00 0.00 20924.36 5971.06 43108.12 00:17:58.766 00:17:58.766 Latency(us) 00:17:58.766 [2024-11-27T02:13:01.385Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:58.766 [2024-11-27T02:13:01.385Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:17:58.766 Nvme1n1 : 1.01 9657.58 37.72 0.00 0.00 13194.66 8058.50 23981.32 00:17:58.766 [2024-11-27T02:13:01.385Z] =================================================================================================================== 00:17:58.766 [2024-11-27T02:13:01.385Z] Total : 9657.58 37.72 0.00 0.00 13194.66 8058.50 23981.32 00:17:59.024 03:13:01 -- target/bdev_io_wait.sh@38 -- # wait 2454916 00:17:59.024 03:13:01 -- target/bdev_io_wait.sh@39 -- # wait 2454919 00:17:59.024 03:13:01 -- target/bdev_io_wait.sh@40 -- # wait 2454921 00:17:59.024 03:13:01 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:59.024 03:13:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:59.024 03:13:01 -- common/autotest_common.sh@10 -- # set +x 00:17:59.024 03:13:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:59.024 03:13:01 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:17:59.024 03:13:01 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:17:59.024 03:13:01 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:59.024 03:13:01 -- nvmf/common.sh@116 -- # sync 00:17:59.024 03:13:01 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:59.024 03:13:01 -- nvmf/common.sh@119 -- # set +e 00:17:59.024 03:13:01 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:59.024 03:13:01 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:59.024 rmmod nvme_tcp 00:17:59.024 rmmod nvme_fabrics 00:17:59.024 rmmod nvme_keyring 00:17:59.282 03:13:01 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:59.282 03:13:01 -- nvmf/common.sh@123 -- # set -e 00:17:59.282 03:13:01 -- nvmf/common.sh@124 -- # return 0 00:17:59.282 03:13:01 -- nvmf/common.sh@477 -- # '[' -n 2454886 ']' 00:17:59.282 03:13:01 -- nvmf/common.sh@478 -- # killprocess 2454886 00:17:59.282 03:13:01 -- common/autotest_common.sh@936 -- # '[' -z 2454886 ']' 00:17:59.282 03:13:01 -- common/autotest_common.sh@940 -- # kill -0 2454886 00:17:59.282 03:13:01 -- common/autotest_common.sh@941 -- # uname 00:17:59.282 03:13:01 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:59.282 03:13:01 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2454886 00:17:59.282 03:13:01 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:59.282 03:13:01 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:59.282 03:13:01 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2454886' 00:17:59.282 killing process with pid 2454886 00:17:59.282 03:13:01 -- common/autotest_common.sh@955 -- # kill 2454886 00:17:59.282 03:13:01 -- common/autotest_common.sh@960 -- # wait 2454886 00:17:59.541 03:13:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:59.541 03:13:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:59.541 03:13:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:59.541 03:13:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:59.541 03:13:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:59.541 03:13:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:59.541 03:13:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:59.541 03:13:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:01.442 03:13:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:01.442 00:18:01.442 real 0m7.262s 00:18:01.442 user 0m16.618s 00:18:01.442 sys 0m3.402s 00:18:01.442 03:13:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:01.442 03:13:03 -- common/autotest_common.sh@10 -- # set +x 00:18:01.442 ************************************ 00:18:01.442 END TEST nvmf_bdev_io_wait 00:18:01.442 ************************************ 00:18:01.442 03:13:03 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:01.442 03:13:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:01.442 03:13:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:01.442 03:13:03 -- common/autotest_common.sh@10 -- # set +x 00:18:01.442 ************************************ 00:18:01.442 START TEST nvmf_queue_depth 00:18:01.442 ************************************ 00:18:01.442 03:13:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:01.442 * Looking for test storage... 00:18:01.442 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:01.442 03:13:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:01.442 03:13:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:01.442 03:13:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:01.701 03:13:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:01.701 03:13:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:01.701 03:13:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:01.701 03:13:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:01.701 03:13:04 -- scripts/common.sh@335 -- # IFS=.-: 00:18:01.701 03:13:04 -- scripts/common.sh@335 -- # read -ra ver1 00:18:01.701 03:13:04 -- scripts/common.sh@336 -- # IFS=.-: 00:18:01.701 03:13:04 -- scripts/common.sh@336 -- # read -ra ver2 00:18:01.701 03:13:04 -- scripts/common.sh@337 -- # local 'op=<' 00:18:01.701 03:13:04 -- scripts/common.sh@339 -- # ver1_l=2 00:18:01.701 03:13:04 -- scripts/common.sh@340 -- # ver2_l=1 00:18:01.701 03:13:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:01.701 03:13:04 -- scripts/common.sh@343 -- # case "$op" in 00:18:01.701 03:13:04 -- scripts/common.sh@344 -- # : 1 00:18:01.701 03:13:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:01.701 03:13:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:01.701 03:13:04 -- scripts/common.sh@364 -- # decimal 1 00:18:01.701 03:13:04 -- scripts/common.sh@352 -- # local d=1 00:18:01.701 03:13:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:01.701 03:13:04 -- scripts/common.sh@354 -- # echo 1 00:18:01.701 03:13:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:01.701 03:13:04 -- scripts/common.sh@365 -- # decimal 2 00:18:01.701 03:13:04 -- scripts/common.sh@352 -- # local d=2 00:18:01.701 03:13:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:01.701 03:13:04 -- scripts/common.sh@354 -- # echo 2 00:18:01.701 03:13:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:01.701 03:13:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:01.701 03:13:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:01.701 03:13:04 -- scripts/common.sh@367 -- # return 0 00:18:01.701 03:13:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:01.701 03:13:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:01.701 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:01.701 --rc genhtml_branch_coverage=1 00:18:01.701 --rc genhtml_function_coverage=1 00:18:01.702 --rc genhtml_legend=1 00:18:01.702 --rc geninfo_all_blocks=1 00:18:01.702 --rc geninfo_unexecuted_blocks=1 00:18:01.702 00:18:01.702 ' 00:18:01.702 03:13:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:01.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:01.702 --rc genhtml_branch_coverage=1 00:18:01.702 --rc genhtml_function_coverage=1 00:18:01.702 --rc genhtml_legend=1 00:18:01.702 --rc geninfo_all_blocks=1 00:18:01.702 --rc geninfo_unexecuted_blocks=1 00:18:01.702 00:18:01.702 ' 00:18:01.702 03:13:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:01.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:01.702 --rc genhtml_branch_coverage=1 00:18:01.702 --rc genhtml_function_coverage=1 00:18:01.702 --rc genhtml_legend=1 00:18:01.702 --rc geninfo_all_blocks=1 00:18:01.702 --rc geninfo_unexecuted_blocks=1 00:18:01.702 00:18:01.702 ' 00:18:01.702 03:13:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:01.702 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:01.702 --rc genhtml_branch_coverage=1 00:18:01.702 --rc genhtml_function_coverage=1 00:18:01.702 --rc genhtml_legend=1 00:18:01.702 --rc geninfo_all_blocks=1 00:18:01.702 --rc geninfo_unexecuted_blocks=1 00:18:01.702 00:18:01.702 ' 00:18:01.702 03:13:04 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:01.702 03:13:04 -- nvmf/common.sh@7 -- # uname -s 00:18:01.702 03:13:04 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:01.702 03:13:04 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:01.702 03:13:04 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:01.702 03:13:04 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:01.702 03:13:04 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:01.702 03:13:04 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:01.702 03:13:04 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:01.702 03:13:04 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:01.702 03:13:04 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:01.702 03:13:04 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:01.702 03:13:04 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:01.702 03:13:04 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:01.702 03:13:04 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:01.702 03:13:04 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:01.702 03:13:04 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:01.702 03:13:04 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:01.702 03:13:04 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:01.702 03:13:04 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:01.702 03:13:04 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:01.702 03:13:04 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.702 03:13:04 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.702 03:13:04 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.702 03:13:04 -- paths/export.sh@5 -- # export PATH 00:18:01.702 03:13:04 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:01.702 03:13:04 -- nvmf/common.sh@46 -- # : 0 00:18:01.702 03:13:04 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:01.702 03:13:04 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:01.702 03:13:04 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:01.702 03:13:04 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:01.702 03:13:04 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:01.702 03:13:04 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:01.702 03:13:04 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:01.702 03:13:04 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:01.702 03:13:04 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:01.702 03:13:04 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:01.702 03:13:04 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:01.702 03:13:04 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:01.702 03:13:04 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:01.702 03:13:04 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:01.702 03:13:04 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:01.702 03:13:04 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:01.702 03:13:04 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:01.702 03:13:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:01.702 03:13:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:01.702 03:13:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:01.702 03:13:04 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:01.702 03:13:04 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:01.702 03:13:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:01.702 03:13:04 -- common/autotest_common.sh@10 -- # set +x 00:18:03.605 03:13:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:03.605 03:13:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:03.605 03:13:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:03.605 03:13:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:03.605 03:13:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:03.605 03:13:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:03.605 03:13:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:03.605 03:13:06 -- nvmf/common.sh@294 -- # net_devs=() 00:18:03.605 03:13:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:03.605 03:13:06 -- nvmf/common.sh@295 -- # e810=() 00:18:03.605 03:13:06 -- nvmf/common.sh@295 -- # local -ga e810 00:18:03.605 03:13:06 -- nvmf/common.sh@296 -- # x722=() 00:18:03.605 03:13:06 -- nvmf/common.sh@296 -- # local -ga x722 00:18:03.605 03:13:06 -- nvmf/common.sh@297 -- # mlx=() 00:18:03.605 03:13:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:03.605 03:13:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:03.605 03:13:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:03.605 03:13:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:03.605 03:13:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:03.605 03:13:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:03.605 03:13:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:03.605 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:03.605 03:13:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:03.605 03:13:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:03.605 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:03.605 03:13:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:03.605 03:13:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:03.605 03:13:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:03.605 03:13:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:03.605 03:13:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:03.605 03:13:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:03.605 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:03.605 03:13:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:03.605 03:13:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:03.605 03:13:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:03.605 03:13:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:03.605 03:13:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:03.605 03:13:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:03.605 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:03.605 03:13:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:03.605 03:13:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:03.605 03:13:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:03.605 03:13:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:03.605 03:13:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:03.605 03:13:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:03.605 03:13:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:03.605 03:13:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:03.605 03:13:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:03.605 03:13:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:03.605 03:13:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:03.605 03:13:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:03.605 03:13:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:03.605 03:13:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:03.605 03:13:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:03.605 03:13:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:03.605 03:13:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:03.605 03:13:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:03.864 03:13:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:03.864 03:13:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:03.864 03:13:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:03.864 03:13:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:03.864 03:13:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:03.864 03:13:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:03.864 03:13:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:03.864 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:03.864 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.341 ms 00:18:03.864 00:18:03.864 --- 10.0.0.2 ping statistics --- 00:18:03.864 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:03.864 rtt min/avg/max/mdev = 0.341/0.341/0.341/0.000 ms 00:18:03.864 03:13:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:03.864 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:03.864 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:18:03.864 00:18:03.864 --- 10.0.0.1 ping statistics --- 00:18:03.865 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:03.865 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:18:03.865 03:13:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:03.865 03:13:06 -- nvmf/common.sh@410 -- # return 0 00:18:03.865 03:13:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:03.865 03:13:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:03.865 03:13:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:03.865 03:13:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:03.865 03:13:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:03.865 03:13:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:03.865 03:13:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:03.865 03:13:06 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:03.865 03:13:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:03.865 03:13:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:03.865 03:13:06 -- common/autotest_common.sh@10 -- # set +x 00:18:03.865 03:13:06 -- nvmf/common.sh@469 -- # nvmfpid=2457168 00:18:03.865 03:13:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:03.865 03:13:06 -- nvmf/common.sh@470 -- # waitforlisten 2457168 00:18:03.865 03:13:06 -- common/autotest_common.sh@829 -- # '[' -z 2457168 ']' 00:18:03.865 03:13:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:03.865 03:13:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:03.865 03:13:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:03.865 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:03.865 03:13:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:03.865 03:13:06 -- common/autotest_common.sh@10 -- # set +x 00:18:03.865 [2024-11-27 03:13:06.358563] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:03.865 [2024-11-27 03:13:06.358652] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:03.865 EAL: No free 2048 kB hugepages reported on node 1 00:18:03.865 [2024-11-27 03:13:06.422680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:04.123 [2024-11-27 03:13:06.510111] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:04.123 [2024-11-27 03:13:06.510275] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:04.123 [2024-11-27 03:13:06.510292] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:04.123 [2024-11-27 03:13:06.510305] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:04.123 [2024-11-27 03:13:06.510331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:05.055 03:13:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:05.055 03:13:07 -- common/autotest_common.sh@862 -- # return 0 00:18:05.055 03:13:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:05.055 03:13:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:05.055 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:18:05.055 03:13:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:05.055 03:13:07 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:05.055 03:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:05.055 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:18:05.055 [2024-11-27 03:13:07.352474] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:05.055 03:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:05.055 03:13:07 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:05.055 03:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:05.055 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:18:05.055 Malloc0 00:18:05.055 03:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:05.055 03:13:07 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:05.055 03:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:05.055 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:18:05.055 03:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:05.055 03:13:07 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:05.055 03:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:05.055 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:18:05.055 03:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:05.055 03:13:07 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:05.055 03:13:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:05.055 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:18:05.055 [2024-11-27 03:13:07.412247] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:05.055 03:13:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:05.055 03:13:07 -- target/queue_depth.sh@30 -- # bdevperf_pid=2457322 00:18:05.055 03:13:07 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:05.056 03:13:07 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:05.056 03:13:07 -- target/queue_depth.sh@33 -- # waitforlisten 2457322 /var/tmp/bdevperf.sock 00:18:05.056 03:13:07 -- common/autotest_common.sh@829 -- # '[' -z 2457322 ']' 00:18:05.056 03:13:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:05.056 03:13:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:05.056 03:13:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:05.056 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:05.056 03:13:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:05.056 03:13:07 -- common/autotest_common.sh@10 -- # set +x 00:18:05.056 [2024-11-27 03:13:07.456855] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:05.056 [2024-11-27 03:13:07.456935] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2457322 ] 00:18:05.056 EAL: No free 2048 kB hugepages reported on node 1 00:18:05.056 [2024-11-27 03:13:07.516453] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:05.056 [2024-11-27 03:13:07.600837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:05.984 03:13:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:05.984 03:13:08 -- common/autotest_common.sh@862 -- # return 0 00:18:05.984 03:13:08 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:05.985 03:13:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:05.985 03:13:08 -- common/autotest_common.sh@10 -- # set +x 00:18:05.985 NVMe0n1 00:18:05.985 03:13:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:05.985 03:13:08 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:06.243 Running I/O for 10 seconds... 00:18:16.215 00:18:16.215 Latency(us) 00:18:16.215 [2024-11-27T02:13:18.834Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.215 [2024-11-27T02:13:18.834Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:16.215 Verification LBA range: start 0x0 length 0x4000 00:18:16.215 NVMe0n1 : 10.07 12146.58 47.45 0.00 0.00 83961.47 15049.01 63691.28 00:18:16.215 [2024-11-27T02:13:18.834Z] =================================================================================================================== 00:18:16.215 [2024-11-27T02:13:18.834Z] Total : 12146.58 47.45 0.00 0.00 83961.47 15049.01 63691.28 00:18:16.215 0 00:18:16.215 03:13:18 -- target/queue_depth.sh@39 -- # killprocess 2457322 00:18:16.215 03:13:18 -- common/autotest_common.sh@936 -- # '[' -z 2457322 ']' 00:18:16.215 03:13:18 -- common/autotest_common.sh@940 -- # kill -0 2457322 00:18:16.215 03:13:18 -- common/autotest_common.sh@941 -- # uname 00:18:16.215 03:13:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:16.215 03:13:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2457322 00:18:16.473 03:13:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:16.473 03:13:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:16.473 03:13:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2457322' 00:18:16.473 killing process with pid 2457322 00:18:16.473 03:13:18 -- common/autotest_common.sh@955 -- # kill 2457322 00:18:16.473 Received shutdown signal, test time was about 10.000000 seconds 00:18:16.473 00:18:16.473 Latency(us) 00:18:16.473 [2024-11-27T02:13:19.092Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.473 [2024-11-27T02:13:19.092Z] =================================================================================================================== 00:18:16.473 [2024-11-27T02:13:19.092Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:16.473 03:13:18 -- common/autotest_common.sh@960 -- # wait 2457322 00:18:16.473 03:13:19 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:16.473 03:13:19 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:16.473 03:13:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:16.473 03:13:19 -- nvmf/common.sh@116 -- # sync 00:18:16.473 03:13:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:16.473 03:13:19 -- nvmf/common.sh@119 -- # set +e 00:18:16.473 03:13:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:16.473 03:13:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:16.734 rmmod nvme_tcp 00:18:16.734 rmmod nvme_fabrics 00:18:16.734 rmmod nvme_keyring 00:18:16.734 03:13:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:16.734 03:13:19 -- nvmf/common.sh@123 -- # set -e 00:18:16.734 03:13:19 -- nvmf/common.sh@124 -- # return 0 00:18:16.734 03:13:19 -- nvmf/common.sh@477 -- # '[' -n 2457168 ']' 00:18:16.734 03:13:19 -- nvmf/common.sh@478 -- # killprocess 2457168 00:18:16.734 03:13:19 -- common/autotest_common.sh@936 -- # '[' -z 2457168 ']' 00:18:16.734 03:13:19 -- common/autotest_common.sh@940 -- # kill -0 2457168 00:18:16.734 03:13:19 -- common/autotest_common.sh@941 -- # uname 00:18:16.734 03:13:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:16.734 03:13:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2457168 00:18:16.734 03:13:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:16.734 03:13:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:16.734 03:13:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2457168' 00:18:16.734 killing process with pid 2457168 00:18:16.734 03:13:19 -- common/autotest_common.sh@955 -- # kill 2457168 00:18:16.734 03:13:19 -- common/autotest_common.sh@960 -- # wait 2457168 00:18:16.992 03:13:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:16.992 03:13:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:16.992 03:13:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:16.992 03:13:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:16.992 03:13:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:16.992 03:13:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:16.992 03:13:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:16.992 03:13:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:18.896 03:13:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:18.896 00:18:18.896 real 0m17.517s 00:18:18.896 user 0m25.003s 00:18:18.896 sys 0m3.263s 00:18:18.896 03:13:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:18.896 03:13:21 -- common/autotest_common.sh@10 -- # set +x 00:18:18.896 ************************************ 00:18:18.896 END TEST nvmf_queue_depth 00:18:18.896 ************************************ 00:18:18.896 03:13:21 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:18.896 03:13:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:18.896 03:13:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:18.896 03:13:21 -- common/autotest_common.sh@10 -- # set +x 00:18:18.896 ************************************ 00:18:18.896 START TEST nvmf_multipath 00:18:18.896 ************************************ 00:18:18.896 03:13:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:19.154 * Looking for test storage... 00:18:19.154 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:19.154 03:13:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:19.154 03:13:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:19.154 03:13:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:19.154 03:13:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:19.154 03:13:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:19.154 03:13:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:19.154 03:13:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:19.154 03:13:21 -- scripts/common.sh@335 -- # IFS=.-: 00:18:19.154 03:13:21 -- scripts/common.sh@335 -- # read -ra ver1 00:18:19.154 03:13:21 -- scripts/common.sh@336 -- # IFS=.-: 00:18:19.154 03:13:21 -- scripts/common.sh@336 -- # read -ra ver2 00:18:19.154 03:13:21 -- scripts/common.sh@337 -- # local 'op=<' 00:18:19.154 03:13:21 -- scripts/common.sh@339 -- # ver1_l=2 00:18:19.154 03:13:21 -- scripts/common.sh@340 -- # ver2_l=1 00:18:19.154 03:13:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:19.154 03:13:21 -- scripts/common.sh@343 -- # case "$op" in 00:18:19.154 03:13:21 -- scripts/common.sh@344 -- # : 1 00:18:19.154 03:13:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:19.154 03:13:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:19.154 03:13:21 -- scripts/common.sh@364 -- # decimal 1 00:18:19.154 03:13:21 -- scripts/common.sh@352 -- # local d=1 00:18:19.154 03:13:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:19.154 03:13:21 -- scripts/common.sh@354 -- # echo 1 00:18:19.154 03:13:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:19.154 03:13:21 -- scripts/common.sh@365 -- # decimal 2 00:18:19.154 03:13:21 -- scripts/common.sh@352 -- # local d=2 00:18:19.154 03:13:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:19.154 03:13:21 -- scripts/common.sh@354 -- # echo 2 00:18:19.154 03:13:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:19.154 03:13:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:19.154 03:13:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:19.154 03:13:21 -- scripts/common.sh@367 -- # return 0 00:18:19.154 03:13:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:19.154 03:13:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:19.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:19.154 --rc genhtml_branch_coverage=1 00:18:19.154 --rc genhtml_function_coverage=1 00:18:19.154 --rc genhtml_legend=1 00:18:19.154 --rc geninfo_all_blocks=1 00:18:19.154 --rc geninfo_unexecuted_blocks=1 00:18:19.154 00:18:19.154 ' 00:18:19.154 03:13:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:19.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:19.154 --rc genhtml_branch_coverage=1 00:18:19.154 --rc genhtml_function_coverage=1 00:18:19.154 --rc genhtml_legend=1 00:18:19.154 --rc geninfo_all_blocks=1 00:18:19.154 --rc geninfo_unexecuted_blocks=1 00:18:19.154 00:18:19.154 ' 00:18:19.154 03:13:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:19.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:19.154 --rc genhtml_branch_coverage=1 00:18:19.154 --rc genhtml_function_coverage=1 00:18:19.154 --rc genhtml_legend=1 00:18:19.154 --rc geninfo_all_blocks=1 00:18:19.154 --rc geninfo_unexecuted_blocks=1 00:18:19.154 00:18:19.154 ' 00:18:19.154 03:13:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:19.154 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:19.154 --rc genhtml_branch_coverage=1 00:18:19.154 --rc genhtml_function_coverage=1 00:18:19.154 --rc genhtml_legend=1 00:18:19.154 --rc geninfo_all_blocks=1 00:18:19.154 --rc geninfo_unexecuted_blocks=1 00:18:19.154 00:18:19.154 ' 00:18:19.154 03:13:21 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:19.154 03:13:21 -- nvmf/common.sh@7 -- # uname -s 00:18:19.154 03:13:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:19.154 03:13:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:19.154 03:13:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:19.154 03:13:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:19.154 03:13:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:19.154 03:13:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:19.154 03:13:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:19.154 03:13:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:19.154 03:13:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:19.154 03:13:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:19.154 03:13:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:19.154 03:13:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:19.154 03:13:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:19.155 03:13:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:19.155 03:13:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:19.155 03:13:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:19.155 03:13:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:19.155 03:13:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:19.155 03:13:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:19.155 03:13:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.155 03:13:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.155 03:13:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.155 03:13:21 -- paths/export.sh@5 -- # export PATH 00:18:19.155 03:13:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:19.155 03:13:21 -- nvmf/common.sh@46 -- # : 0 00:18:19.155 03:13:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:19.155 03:13:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:19.155 03:13:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:19.155 03:13:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:19.155 03:13:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:19.155 03:13:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:19.155 03:13:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:19.155 03:13:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:19.155 03:13:21 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:19.155 03:13:21 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:19.155 03:13:21 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:19.155 03:13:21 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:19.155 03:13:21 -- target/multipath.sh@43 -- # nvmftestinit 00:18:19.155 03:13:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:19.155 03:13:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:19.155 03:13:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:19.155 03:13:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:19.155 03:13:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:19.155 03:13:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:19.155 03:13:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:19.155 03:13:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:19.155 03:13:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:19.155 03:13:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:19.155 03:13:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:19.155 03:13:21 -- common/autotest_common.sh@10 -- # set +x 00:18:21.123 03:13:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:21.123 03:13:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:21.123 03:13:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:21.123 03:13:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:21.123 03:13:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:21.123 03:13:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:21.123 03:13:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:21.123 03:13:23 -- nvmf/common.sh@294 -- # net_devs=() 00:18:21.123 03:13:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:21.123 03:13:23 -- nvmf/common.sh@295 -- # e810=() 00:18:21.123 03:13:23 -- nvmf/common.sh@295 -- # local -ga e810 00:18:21.123 03:13:23 -- nvmf/common.sh@296 -- # x722=() 00:18:21.123 03:13:23 -- nvmf/common.sh@296 -- # local -ga x722 00:18:21.123 03:13:23 -- nvmf/common.sh@297 -- # mlx=() 00:18:21.123 03:13:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:21.123 03:13:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:21.123 03:13:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:21.123 03:13:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:21.123 03:13:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:21.123 03:13:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:21.123 03:13:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:21.123 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:21.123 03:13:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:21.123 03:13:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:21.123 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:21.123 03:13:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:21.123 03:13:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:21.123 03:13:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:21.123 03:13:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:21.123 03:13:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:21.123 03:13:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:21.123 03:13:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:21.123 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:21.123 03:13:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:21.123 03:13:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:21.123 03:13:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:21.123 03:13:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:21.123 03:13:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:21.123 03:13:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:21.124 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:21.124 03:13:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:21.124 03:13:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:21.124 03:13:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:21.124 03:13:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:21.124 03:13:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:21.124 03:13:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:21.124 03:13:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:21.124 03:13:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:21.124 03:13:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:21.124 03:13:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:21.124 03:13:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:21.124 03:13:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:21.124 03:13:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:21.124 03:13:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:21.124 03:13:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:21.124 03:13:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:21.124 03:13:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:21.124 03:13:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:21.124 03:13:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:21.382 03:13:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:21.382 03:13:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:21.382 03:13:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:21.382 03:13:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:21.382 03:13:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:21.382 03:13:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:21.382 03:13:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:21.382 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:21.382 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:18:21.382 00:18:21.382 --- 10.0.0.2 ping statistics --- 00:18:21.382 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:21.382 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:18:21.382 03:13:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:21.382 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:21.382 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.075 ms 00:18:21.382 00:18:21.382 --- 10.0.0.1 ping statistics --- 00:18:21.382 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:21.382 rtt min/avg/max/mdev = 0.075/0.075/0.075/0.000 ms 00:18:21.382 03:13:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:21.382 03:13:23 -- nvmf/common.sh@410 -- # return 0 00:18:21.382 03:13:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:21.382 03:13:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:21.382 03:13:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:21.382 03:13:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:21.382 03:13:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:21.382 03:13:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:21.382 03:13:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:21.382 03:13:23 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:21.382 03:13:23 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:21.382 only one NIC for nvmf test 00:18:21.382 03:13:23 -- target/multipath.sh@47 -- # nvmftestfini 00:18:21.382 03:13:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:21.382 03:13:23 -- nvmf/common.sh@116 -- # sync 00:18:21.382 03:13:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:21.382 03:13:23 -- nvmf/common.sh@119 -- # set +e 00:18:21.382 03:13:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:21.382 03:13:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:21.382 rmmod nvme_tcp 00:18:21.640 rmmod nvme_fabrics 00:18:21.640 rmmod nvme_keyring 00:18:21.640 03:13:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:21.640 03:13:24 -- nvmf/common.sh@123 -- # set -e 00:18:21.640 03:13:24 -- nvmf/common.sh@124 -- # return 0 00:18:21.640 03:13:24 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:21.640 03:13:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:21.640 03:13:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:21.640 03:13:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:21.640 03:13:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:21.640 03:13:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:21.640 03:13:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:21.640 03:13:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:21.640 03:13:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.542 03:13:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:23.542 03:13:26 -- target/multipath.sh@48 -- # exit 0 00:18:23.542 03:13:26 -- target/multipath.sh@1 -- # nvmftestfini 00:18:23.542 03:13:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:23.542 03:13:26 -- nvmf/common.sh@116 -- # sync 00:18:23.542 03:13:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:23.542 03:13:26 -- nvmf/common.sh@119 -- # set +e 00:18:23.542 03:13:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:23.542 03:13:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:23.542 03:13:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:23.542 03:13:26 -- nvmf/common.sh@123 -- # set -e 00:18:23.542 03:13:26 -- nvmf/common.sh@124 -- # return 0 00:18:23.542 03:13:26 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:23.542 03:13:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:23.542 03:13:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:23.542 03:13:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:23.542 03:13:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:23.542 03:13:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:23.542 03:13:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.542 03:13:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.542 03:13:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.542 03:13:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:23.542 00:18:23.542 real 0m4.598s 00:18:23.542 user 0m0.913s 00:18:23.542 sys 0m1.561s 00:18:23.542 03:13:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:23.542 03:13:26 -- common/autotest_common.sh@10 -- # set +x 00:18:23.542 ************************************ 00:18:23.542 END TEST nvmf_multipath 00:18:23.542 ************************************ 00:18:23.542 03:13:26 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:23.542 03:13:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:23.542 03:13:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:23.542 03:13:26 -- common/autotest_common.sh@10 -- # set +x 00:18:23.542 ************************************ 00:18:23.542 START TEST nvmf_zcopy 00:18:23.542 ************************************ 00:18:23.542 03:13:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:23.801 * Looking for test storage... 00:18:23.801 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:23.801 03:13:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:23.801 03:13:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:23.801 03:13:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:23.801 03:13:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:23.801 03:13:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:23.801 03:13:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:23.801 03:13:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:23.801 03:13:26 -- scripts/common.sh@335 -- # IFS=.-: 00:18:23.801 03:13:26 -- scripts/common.sh@335 -- # read -ra ver1 00:18:23.801 03:13:26 -- scripts/common.sh@336 -- # IFS=.-: 00:18:23.801 03:13:26 -- scripts/common.sh@336 -- # read -ra ver2 00:18:23.801 03:13:26 -- scripts/common.sh@337 -- # local 'op=<' 00:18:23.801 03:13:26 -- scripts/common.sh@339 -- # ver1_l=2 00:18:23.801 03:13:26 -- scripts/common.sh@340 -- # ver2_l=1 00:18:23.801 03:13:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:23.801 03:13:26 -- scripts/common.sh@343 -- # case "$op" in 00:18:23.801 03:13:26 -- scripts/common.sh@344 -- # : 1 00:18:23.801 03:13:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:23.801 03:13:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:23.801 03:13:26 -- scripts/common.sh@364 -- # decimal 1 00:18:23.801 03:13:26 -- scripts/common.sh@352 -- # local d=1 00:18:23.801 03:13:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:23.801 03:13:26 -- scripts/common.sh@354 -- # echo 1 00:18:23.801 03:13:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:23.801 03:13:26 -- scripts/common.sh@365 -- # decimal 2 00:18:23.801 03:13:26 -- scripts/common.sh@352 -- # local d=2 00:18:23.801 03:13:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:23.801 03:13:26 -- scripts/common.sh@354 -- # echo 2 00:18:23.801 03:13:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:23.801 03:13:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:23.801 03:13:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:23.801 03:13:26 -- scripts/common.sh@367 -- # return 0 00:18:23.801 03:13:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:23.801 03:13:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:23.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.801 --rc genhtml_branch_coverage=1 00:18:23.801 --rc genhtml_function_coverage=1 00:18:23.801 --rc genhtml_legend=1 00:18:23.801 --rc geninfo_all_blocks=1 00:18:23.801 --rc geninfo_unexecuted_blocks=1 00:18:23.801 00:18:23.801 ' 00:18:23.801 03:13:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:23.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.801 --rc genhtml_branch_coverage=1 00:18:23.801 --rc genhtml_function_coverage=1 00:18:23.801 --rc genhtml_legend=1 00:18:23.801 --rc geninfo_all_blocks=1 00:18:23.801 --rc geninfo_unexecuted_blocks=1 00:18:23.801 00:18:23.801 ' 00:18:23.801 03:13:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:23.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.801 --rc genhtml_branch_coverage=1 00:18:23.801 --rc genhtml_function_coverage=1 00:18:23.801 --rc genhtml_legend=1 00:18:23.801 --rc geninfo_all_blocks=1 00:18:23.801 --rc geninfo_unexecuted_blocks=1 00:18:23.801 00:18:23.801 ' 00:18:23.801 03:13:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:23.801 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:23.801 --rc genhtml_branch_coverage=1 00:18:23.801 --rc genhtml_function_coverage=1 00:18:23.801 --rc genhtml_legend=1 00:18:23.801 --rc geninfo_all_blocks=1 00:18:23.801 --rc geninfo_unexecuted_blocks=1 00:18:23.801 00:18:23.801 ' 00:18:23.801 03:13:26 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:23.801 03:13:26 -- nvmf/common.sh@7 -- # uname -s 00:18:23.801 03:13:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:23.801 03:13:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:23.801 03:13:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:23.801 03:13:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:23.801 03:13:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:23.801 03:13:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:23.801 03:13:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:23.801 03:13:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:23.801 03:13:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:23.801 03:13:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:23.801 03:13:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.801 03:13:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:23.801 03:13:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:23.801 03:13:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:23.801 03:13:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:23.801 03:13:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:23.801 03:13:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:23.801 03:13:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:23.801 03:13:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:23.801 03:13:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.801 03:13:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.802 03:13:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.802 03:13:26 -- paths/export.sh@5 -- # export PATH 00:18:23.802 03:13:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:23.802 03:13:26 -- nvmf/common.sh@46 -- # : 0 00:18:23.802 03:13:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:23.802 03:13:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:23.802 03:13:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:23.802 03:13:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:23.802 03:13:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:23.802 03:13:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:23.802 03:13:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:23.802 03:13:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:23.802 03:13:26 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:23.802 03:13:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:23.802 03:13:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:23.802 03:13:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:23.802 03:13:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:23.802 03:13:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:23.802 03:13:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:23.802 03:13:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:23.802 03:13:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:23.802 03:13:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:23.802 03:13:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:23.802 03:13:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:23.802 03:13:26 -- common/autotest_common.sh@10 -- # set +x 00:18:26.344 03:13:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:26.344 03:13:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:26.344 03:13:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:26.344 03:13:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:26.344 03:13:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:26.344 03:13:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:26.344 03:13:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:26.344 03:13:28 -- nvmf/common.sh@294 -- # net_devs=() 00:18:26.344 03:13:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:26.344 03:13:28 -- nvmf/common.sh@295 -- # e810=() 00:18:26.344 03:13:28 -- nvmf/common.sh@295 -- # local -ga e810 00:18:26.344 03:13:28 -- nvmf/common.sh@296 -- # x722=() 00:18:26.344 03:13:28 -- nvmf/common.sh@296 -- # local -ga x722 00:18:26.344 03:13:28 -- nvmf/common.sh@297 -- # mlx=() 00:18:26.344 03:13:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:26.344 03:13:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:26.344 03:13:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:26.344 03:13:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:26.344 03:13:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:26.344 03:13:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:26.345 03:13:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:26.345 03:13:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:26.345 03:13:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:26.345 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:26.345 03:13:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:26.345 03:13:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:26.345 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:26.345 03:13:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:26.345 03:13:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:26.345 03:13:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:26.345 03:13:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:26.345 03:13:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:26.345 03:13:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:26.345 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:26.345 03:13:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:26.345 03:13:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:26.345 03:13:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:26.345 03:13:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:26.345 03:13:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:26.345 03:13:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:26.345 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:26.345 03:13:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:26.345 03:13:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:26.345 03:13:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:26.345 03:13:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:26.345 03:13:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:26.345 03:13:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:26.345 03:13:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:26.345 03:13:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:26.345 03:13:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:26.345 03:13:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:26.345 03:13:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:26.345 03:13:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:26.345 03:13:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:26.345 03:13:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:26.345 03:13:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:26.345 03:13:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:26.345 03:13:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:26.345 03:13:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:26.345 03:13:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:26.345 03:13:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:26.345 03:13:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:26.345 03:13:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:26.345 03:13:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:26.345 03:13:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:26.345 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:26.345 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.343 ms 00:18:26.345 00:18:26.345 --- 10.0.0.2 ping statistics --- 00:18:26.345 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:26.345 rtt min/avg/max/mdev = 0.343/0.343/0.343/0.000 ms 00:18:26.345 03:13:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:26.345 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:26.345 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.128 ms 00:18:26.345 00:18:26.345 --- 10.0.0.1 ping statistics --- 00:18:26.345 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:26.345 rtt min/avg/max/mdev = 0.128/0.128/0.128/0.000 ms 00:18:26.345 03:13:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:26.345 03:13:28 -- nvmf/common.sh@410 -- # return 0 00:18:26.345 03:13:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:26.345 03:13:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:26.345 03:13:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:26.345 03:13:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:26.345 03:13:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:26.345 03:13:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:26.345 03:13:28 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:26.345 03:13:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:26.345 03:13:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:26.345 03:13:28 -- common/autotest_common.sh@10 -- # set +x 00:18:26.345 03:13:28 -- nvmf/common.sh@469 -- # nvmfpid=2462726 00:18:26.345 03:13:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:26.345 03:13:28 -- nvmf/common.sh@470 -- # waitforlisten 2462726 00:18:26.345 03:13:28 -- common/autotest_common.sh@829 -- # '[' -z 2462726 ']' 00:18:26.345 03:13:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:26.345 03:13:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:26.345 03:13:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:26.345 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:26.345 03:13:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:26.345 03:13:28 -- common/autotest_common.sh@10 -- # set +x 00:18:26.345 [2024-11-27 03:13:28.619359] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:26.345 [2024-11-27 03:13:28.619454] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:26.345 EAL: No free 2048 kB hugepages reported on node 1 00:18:26.345 [2024-11-27 03:13:28.685979] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:26.345 [2024-11-27 03:13:28.774771] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:26.345 [2024-11-27 03:13:28.774932] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:26.345 [2024-11-27 03:13:28.774949] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:26.345 [2024-11-27 03:13:28.774961] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:26.345 [2024-11-27 03:13:28.774989] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:27.279 03:13:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:27.279 03:13:29 -- common/autotest_common.sh@862 -- # return 0 00:18:27.279 03:13:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:27.279 03:13:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:27.279 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:18:27.279 03:13:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:27.279 03:13:29 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:27.279 03:13:29 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:27.279 03:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.279 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:18:27.279 [2024-11-27 03:13:29.638693] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:27.279 03:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.279 03:13:29 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:27.279 03:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.279 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:18:27.279 03:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.279 03:13:29 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:27.279 03:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.279 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:18:27.279 [2024-11-27 03:13:29.654902] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:27.279 03:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.279 03:13:29 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:27.279 03:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.279 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:18:27.279 03:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.279 03:13:29 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:27.279 03:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.279 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:18:27.279 malloc0 00:18:27.279 03:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.279 03:13:29 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:27.279 03:13:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:27.279 03:13:29 -- common/autotest_common.sh@10 -- # set +x 00:18:27.279 03:13:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:27.279 03:13:29 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:27.279 03:13:29 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:27.279 03:13:29 -- nvmf/common.sh@520 -- # config=() 00:18:27.279 03:13:29 -- nvmf/common.sh@520 -- # local subsystem config 00:18:27.279 03:13:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:27.279 03:13:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:27.279 { 00:18:27.279 "params": { 00:18:27.279 "name": "Nvme$subsystem", 00:18:27.279 "trtype": "$TEST_TRANSPORT", 00:18:27.279 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:27.279 "adrfam": "ipv4", 00:18:27.280 "trsvcid": "$NVMF_PORT", 00:18:27.280 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:27.280 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:27.280 "hdgst": ${hdgst:-false}, 00:18:27.280 "ddgst": ${ddgst:-false} 00:18:27.280 }, 00:18:27.280 "method": "bdev_nvme_attach_controller" 00:18:27.280 } 00:18:27.280 EOF 00:18:27.280 )") 00:18:27.280 03:13:29 -- nvmf/common.sh@542 -- # cat 00:18:27.280 03:13:29 -- nvmf/common.sh@544 -- # jq . 00:18:27.280 03:13:29 -- nvmf/common.sh@545 -- # IFS=, 00:18:27.280 03:13:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:27.280 "params": { 00:18:27.280 "name": "Nvme1", 00:18:27.280 "trtype": "tcp", 00:18:27.280 "traddr": "10.0.0.2", 00:18:27.280 "adrfam": "ipv4", 00:18:27.280 "trsvcid": "4420", 00:18:27.280 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:27.280 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:27.280 "hdgst": false, 00:18:27.280 "ddgst": false 00:18:27.280 }, 00:18:27.280 "method": "bdev_nvme_attach_controller" 00:18:27.280 }' 00:18:27.280 [2024-11-27 03:13:29.726156] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:27.280 [2024-11-27 03:13:29.726235] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2462883 ] 00:18:27.280 EAL: No free 2048 kB hugepages reported on node 1 00:18:27.280 [2024-11-27 03:13:29.788570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:27.280 [2024-11-27 03:13:29.877366] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:27.847 Running I/O for 10 seconds... 00:18:37.818 00:18:37.818 Latency(us) 00:18:37.818 [2024-11-27T02:13:40.437Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:37.818 [2024-11-27T02:13:40.437Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:37.818 Verification LBA range: start 0x0 length 0x1000 00:18:37.818 Nvme1n1 : 10.01 8566.85 66.93 0.00 0.00 14905.37 1905.40 23010.42 00:18:37.818 [2024-11-27T02:13:40.437Z] =================================================================================================================== 00:18:37.818 [2024-11-27T02:13:40.437Z] Total : 8566.85 66.93 0.00 0.00 14905.37 1905.40 23010.42 00:18:38.077 03:13:40 -- target/zcopy.sh@39 -- # perfpid=2464105 00:18:38.077 03:13:40 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:38.077 03:13:40 -- common/autotest_common.sh@10 -- # set +x 00:18:38.077 03:13:40 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:38.077 03:13:40 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:38.077 03:13:40 -- nvmf/common.sh@520 -- # config=() 00:18:38.077 03:13:40 -- nvmf/common.sh@520 -- # local subsystem config 00:18:38.077 03:13:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:38.077 03:13:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:38.077 { 00:18:38.077 "params": { 00:18:38.077 "name": "Nvme$subsystem", 00:18:38.077 "trtype": "$TEST_TRANSPORT", 00:18:38.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:38.077 "adrfam": "ipv4", 00:18:38.077 "trsvcid": "$NVMF_PORT", 00:18:38.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:38.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:38.077 "hdgst": ${hdgst:-false}, 00:18:38.077 "ddgst": ${ddgst:-false} 00:18:38.077 }, 00:18:38.077 "method": "bdev_nvme_attach_controller" 00:18:38.077 } 00:18:38.077 EOF 00:18:38.077 )") 00:18:38.078 [2024-11-27 03:13:40.463737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.463788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 03:13:40 -- nvmf/common.sh@542 -- # cat 00:18:38.078 03:13:40 -- nvmf/common.sh@544 -- # jq . 00:18:38.078 03:13:40 -- nvmf/common.sh@545 -- # IFS=, 00:18:38.078 03:13:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:38.078 "params": { 00:18:38.078 "name": "Nvme1", 00:18:38.078 "trtype": "tcp", 00:18:38.078 "traddr": "10.0.0.2", 00:18:38.078 "adrfam": "ipv4", 00:18:38.078 "trsvcid": "4420", 00:18:38.078 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:38.078 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:38.078 "hdgst": false, 00:18:38.078 "ddgst": false 00:18:38.078 }, 00:18:38.078 "method": "bdev_nvme_attach_controller" 00:18:38.078 }' 00:18:38.078 [2024-11-27 03:13:40.471701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.471726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.479742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.479771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.487741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.487765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.495763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.495786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.500096] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:38.078 [2024-11-27 03:13:40.500168] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2464105 ] 00:18:38.078 [2024-11-27 03:13:40.503786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.503823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.511826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.511848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.519853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.519895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.527867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.527903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 EAL: No free 2048 kB hugepages reported on node 1 00:18:38.078 [2024-11-27 03:13:40.535905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.535932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.543936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.543963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.551981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.552004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.559975] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.560003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.566103] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:38.078 [2024-11-27 03:13:40.567997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.568031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.576044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.576085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.584051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.584085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.592056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.592080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.600078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.600102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.608098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.608122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.616125] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.616149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.624166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.624202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.632170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.632197] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.640183] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.640209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.648210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.648235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.656229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.656255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.660924] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:38.078 [2024-11-27 03:13:40.664251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.664275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.672275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.672300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.680328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.680365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.078 [2024-11-27 03:13:40.688354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.078 [2024-11-27 03:13:40.688393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.696375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.696411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.704399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.704438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.712418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.712457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.720437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.720477] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.728431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.728455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.736478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.736517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.744499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.744545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.752500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.752534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.760519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.760551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.768558] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.768601] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.776591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.776614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.784607] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.784629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.792622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.792644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.800638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.800659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.808647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.808668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.337 [2024-11-27 03:13:40.816670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.337 [2024-11-27 03:13:40.816690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.824694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.824714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.832719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.832741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.840777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.840801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.848770] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.848793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.856826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.856855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.864833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.864860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.872856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.872905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 Running I/O for 5 seconds... 00:18:38.338 [2024-11-27 03:13:40.880900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.880936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.895603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.895631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.907034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.907065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.920399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.920430] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.931098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.931129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.942487] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.942539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.338 [2024-11-27 03:13:40.953853] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.338 [2024-11-27 03:13:40.953884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:40.965173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:40.965203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:40.976809] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:40.976855] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:40.990108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:40.990139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.000665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.000692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.012149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.012179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.023679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.023706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.035275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.035305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.046902] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.046931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.059843] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.059887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.069402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.069432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.081709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.081744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.092485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.092515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.103758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.103785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.114868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.114897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.126102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.126132] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.137342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.137372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.148585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.148612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.159346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.159375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.173085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.173115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.183453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.183483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.194657] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.194684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.597 [2024-11-27 03:13:41.207425] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.597 [2024-11-27 03:13:41.207455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.856 [2024-11-27 03:13:41.217461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.856 [2024-11-27 03:13:41.217491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.856 [2024-11-27 03:13:41.229117] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.856 [2024-11-27 03:13:41.229147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.856 [2024-11-27 03:13:41.240179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.856 [2024-11-27 03:13:41.240209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.251173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.251202] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.262065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.262094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.273032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.273062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.284141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.284171] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.297479] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.297517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.307799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.307842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.319053] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.319083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.331984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.332014] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.343085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.343115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.354393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.354422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.365072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.365102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.375801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.375827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.389632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.389659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.400400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.400429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.411821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.411851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.422621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.422648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.433570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.433597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.446590] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.446618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.457347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.457377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:38.857 [2024-11-27 03:13:41.468583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:38.857 [2024-11-27 03:13:41.468610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.481420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.481450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.491534] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.491578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.502783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.502810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.515260] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.515298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.525915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.525946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.536994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.537025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.547887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.547917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.558694] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.558721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.569756] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.569782] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.580656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.580683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.593863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.593893] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.604233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.604263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.615184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.615213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.116 [2024-11-27 03:13:41.627808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.116 [2024-11-27 03:13:41.627853] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.117 [2024-11-27 03:13:41.637962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.117 [2024-11-27 03:13:41.637991] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.117 [2024-11-27 03:13:41.648875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.117 [2024-11-27 03:13:41.648920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.117 [2024-11-27 03:13:41.661473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.117 [2024-11-27 03:13:41.661505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.117 [2024-11-27 03:13:41.670931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.117 [2024-11-27 03:13:41.670961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.117 [2024-11-27 03:13:41.684673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.117 [2024-11-27 03:13:41.684700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.117 [2024-11-27 03:13:41.696019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.117 [2024-11-27 03:13:41.696049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.117 [2024-11-27 03:13:41.708919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.117 [2024-11-27 03:13:41.708949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.117 [2024-11-27 03:13:41.719702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.117 [2024-11-27 03:13:41.719729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.117 [2024-11-27 03:13:41.731092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.117 [2024-11-27 03:13:41.731130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.742189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.742219] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.753068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.753099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.764031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.764062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.775548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.775592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.786730] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.786757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.797928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.797960] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.809668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.809696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.820808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.820851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.831667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.831694] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.842850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.842881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.855802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.855829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.865703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.865730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.876910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.876940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.890214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.890244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.900572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.900598] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.911728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.911755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.924436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.924466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.934464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.934494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.945592] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.945619] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.956894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.956924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.967912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.376 [2024-11-27 03:13:41.967942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.376 [2024-11-27 03:13:41.979190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.377 [2024-11-27 03:13:41.979222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.377 [2024-11-27 03:13:41.989749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.377 [2024-11-27 03:13:41.989777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.000863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.000895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.012054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.012086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.023291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.023322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.034182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.034212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.045364] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.045395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.056156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.056186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.067251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.067281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.078497] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.078537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.091601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.091629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.102089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.102120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.113575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.113603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.126621] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.126648] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.137036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.137066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.147867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.147897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.158791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.158818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.169786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.169833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.181042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.181072] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.191907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.191937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.205019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.205051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.214702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.214730] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.225664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.225692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.238436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.238466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.636 [2024-11-27 03:13:42.248852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.636 [2024-11-27 03:13:42.248882] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.260094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.260124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.271504] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.271548] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.282652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.282680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.295840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.295883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.305331] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.305360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.317163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.317193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.328232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.328262] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.339089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.339119] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.349627] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.349654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.360765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.360792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.371864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.371894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.382981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.383011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.393934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.393964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.406741] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.406768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.416388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.416417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.428727] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.428754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.439339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.439370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.450293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.450323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.461549] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.461579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.472498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.472540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.485576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.895 [2024-11-27 03:13:42.485604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.895 [2024-11-27 03:13:42.496137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.896 [2024-11-27 03:13:42.496167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:39.896 [2024-11-27 03:13:42.507187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:39.896 [2024-11-27 03:13:42.507217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.519938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.519969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.529576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.529603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.541341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.541371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.552466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.552495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.563578] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.563604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.575069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.575099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.586599] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.586626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.598360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.598390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.610212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.610242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.621787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.621814] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.634662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.634689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.646223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.646252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.655535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.655580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.667347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.667378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.677934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.677966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.154 [2024-11-27 03:13:42.688914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.154 [2024-11-27 03:13:42.688944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.155 [2024-11-27 03:13:42.701762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.155 [2024-11-27 03:13:42.701788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.155 [2024-11-27 03:13:42.711901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.155 [2024-11-27 03:13:42.711932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.155 [2024-11-27 03:13:42.723935] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.155 [2024-11-27 03:13:42.723965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.155 [2024-11-27 03:13:42.734943] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.155 [2024-11-27 03:13:42.734973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.155 [2024-11-27 03:13:42.745916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.155 [2024-11-27 03:13:42.745946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.155 [2024-11-27 03:13:42.758991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.155 [2024-11-27 03:13:42.759021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.155 [2024-11-27 03:13:42.769649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.155 [2024-11-27 03:13:42.769676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.413 [2024-11-27 03:13:42.780829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.413 [2024-11-27 03:13:42.780872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.413 [2024-11-27 03:13:42.791765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.413 [2024-11-27 03:13:42.791802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.413 [2024-11-27 03:13:42.803239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.413 [2024-11-27 03:13:42.803270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.413 [2024-11-27 03:13:42.813983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.413 [2024-11-27 03:13:42.814013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.413 [2024-11-27 03:13:42.824907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.824938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.836170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.836199] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.847461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.847490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.858959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.858988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.870348] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.870378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.881735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.881762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.893268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.893298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.904579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.904605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.916014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.916043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.926811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.926837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.937763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.937789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.948320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.948349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.958956] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.958986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.969791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.969832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.980796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.980822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:42.993825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:42.993869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:43.003980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:43.004024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:43.014653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:43.014696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.414 [2024-11-27 03:13:43.025773] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.414 [2024-11-27 03:13:43.025800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.672 [2024-11-27 03:13:43.036820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.672 [2024-11-27 03:13:43.036864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.672 [2024-11-27 03:13:43.047749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.672 [2024-11-27 03:13:43.047776] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.672 [2024-11-27 03:13:43.058968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.672 [2024-11-27 03:13:43.058998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.672 [2024-11-27 03:13:43.070349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.672 [2024-11-27 03:13:43.070379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.672 [2024-11-27 03:13:43.081536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.081580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.094828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.094871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.105482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.105513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.116920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.116952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.130154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.130185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.140439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.140470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.152214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.152245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.163278] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.163309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.176284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.176315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.186831] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.186876] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.197931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.197962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.210953] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.210984] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.221594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.221628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.232263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.232293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.243617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.243644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.254842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.254873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.266025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.266055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.277846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.277892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.673 [2024-11-27 03:13:43.288889] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.673 [2024-11-27 03:13:43.288919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.301628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.301656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.311896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.311927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.323098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.323128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.336174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.336204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.346420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.346451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.357491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.357522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.368419] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.368449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.379262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.379292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.390648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.390676] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.401349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.401379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.414472] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.414502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.424750] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.424777] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.435697] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.435732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.931 [2024-11-27 03:13:43.448369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.931 [2024-11-27 03:13:43.448399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.932 [2024-11-27 03:13:43.458237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.932 [2024-11-27 03:13:43.458266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.932 [2024-11-27 03:13:43.469847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.932 [2024-11-27 03:13:43.469891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.932 [2024-11-27 03:13:43.480900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.932 [2024-11-27 03:13:43.480930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.932 [2024-11-27 03:13:43.491898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.932 [2024-11-27 03:13:43.491927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.932 [2024-11-27 03:13:43.502983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.932 [2024-11-27 03:13:43.503012] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.932 [2024-11-27 03:13:43.514358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.932 [2024-11-27 03:13:43.514387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.932 [2024-11-27 03:13:43.525393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.932 [2024-11-27 03:13:43.525422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.932 [2024-11-27 03:13:43.538225] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.932 [2024-11-27 03:13:43.538255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:40.932 [2024-11-27 03:13:43.548517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:40.932 [2024-11-27 03:13:43.548571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.559442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.559471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.572962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.572993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.583610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.583637] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.594642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.594669] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.607283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.607313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.616744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.616771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.628085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.628114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.641179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.641209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.650762] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.650790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.662631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.662658] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.673293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.673323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.684264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.684295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.697298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.697328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.706650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.706677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.718669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.718697] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.732169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.732200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.742901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.742930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.753791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.753818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.766901] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.766931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.777065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.777097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.788343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.788373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.190 [2024-11-27 03:13:43.799254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.190 [2024-11-27 03:13:43.799284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.810006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.810036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.820841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.820871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.831792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.831819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.844722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.844749] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.854699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.854726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.865777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.865803] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.876423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.876453] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.887171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.887201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.897924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.897955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.909028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.909058] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.922002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.922033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.932684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.932711] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.943767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.943794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.956138] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.956168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.966428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.966458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.977537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.977581] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:43.990568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:43.990594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:44.000498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:44.000538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:44.011658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:44.011685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:44.025084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:44.025114] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:44.035002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:44.035031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:44.046085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:44.046115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.449 [2024-11-27 03:13:44.059202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.449 [2024-11-27 03:13:44.059232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.069814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.069841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.081070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.081100] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.094033] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.094063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.104593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.104621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.115698] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.115726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.127006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.127036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.138216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.138245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.151291] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.151320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.161919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.161949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.173268] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.173297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.184613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.184640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.195801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.707 [2024-11-27 03:13:44.195827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.707 [2024-11-27 03:13:44.206653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.206680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.219122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.219152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.229883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.229913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.240951] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.240978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.254292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.254322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.264955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.264994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.275838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.275870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.286699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.286727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.297410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.297440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.310644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.310671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.708 [2024-11-27 03:13:44.321103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.708 [2024-11-27 03:13:44.321142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.332806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.332858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.343818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.343850] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.355016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.355046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.366537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.366580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.377839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.377869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.390745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.390772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.400735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.400762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.411782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.411809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.424872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.424902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.435056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.435086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.446131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.446160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.459212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.459241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.469635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.469663] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.480942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.480973] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.491790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.491818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.502821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.502873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.514071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.514102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.524931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.524961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.538475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.538504] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.550939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.550982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.560881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.966 [2024-11-27 03:13:44.560911] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.966 [2024-11-27 03:13:44.572623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.967 [2024-11-27 03:13:44.572650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:41.967 [2024-11-27 03:13:44.584060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:41.967 [2024-11-27 03:13:44.584090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.225 [2024-11-27 03:13:44.594937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.594967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.605811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.605856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.617109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.617139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.630179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.630209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.640407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.640436] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.651377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.651407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.664567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.664594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.675314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.675344] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.686363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.686393] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.698735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.698763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.708105] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.708134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.721701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.721736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.732740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.732767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.743862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.743892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.754732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.754759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.765760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.765788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.776864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.776895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.787904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.787935] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.798973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.799003] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.810114] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.810144] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.820933] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.820963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.226 [2024-11-27 03:13:44.833751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.226 [2024-11-27 03:13:44.833778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.844216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.844245] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.855643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.855670] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.867048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.867078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.878254] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.878284] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.890929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.890959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.900994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.901024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.911986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.912016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.922812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.922839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.933702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.933737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.946638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.946665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.956803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.956845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.968010] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.968040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.981004] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.981034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:44.991986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:44.992017] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:45.003335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:45.003365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:45.016336] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.485 [2024-11-27 03:13:45.016366] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.485 [2024-11-27 03:13:45.026580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.486 [2024-11-27 03:13:45.026608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.486 [2024-11-27 03:13:45.037716] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.486 [2024-11-27 03:13:45.037744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.486 [2024-11-27 03:13:45.050771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.486 [2024-11-27 03:13:45.050799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.486 [2024-11-27 03:13:45.061424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.486 [2024-11-27 03:13:45.061455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.486 [2024-11-27 03:13:45.072718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.486 [2024-11-27 03:13:45.072745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.486 [2024-11-27 03:13:45.085993] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.486 [2024-11-27 03:13:45.086023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.486 [2024-11-27 03:13:45.097005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.486 [2024-11-27 03:13:45.097035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.744 [2024-11-27 03:13:45.108630] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.744 [2024-11-27 03:13:45.108657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.744 [2024-11-27 03:13:45.120226] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.744 [2024-11-27 03:13:45.120255] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.744 [2024-11-27 03:13:45.130932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.744 [2024-11-27 03:13:45.130963] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.744 [2024-11-27 03:13:45.141708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.744 [2024-11-27 03:13:45.141735] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.744 [2024-11-27 03:13:45.152842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.744 [2024-11-27 03:13:45.152881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.744 [2024-11-27 03:13:45.164035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.744 [2024-11-27 03:13:45.164065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.744 [2024-11-27 03:13:45.175045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.744 [2024-11-27 03:13:45.175076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.744 [2024-11-27 03:13:45.186018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.744 [2024-11-27 03:13:45.186048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.744 [2024-11-27 03:13:45.197096] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.197126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.208036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.208066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.218510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.218549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.229605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.229632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.240964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.240994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.254006] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.254036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.264428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.264459] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.275915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.275945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.286711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.286738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.298005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.298035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.308887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.308916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.321823] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.321867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.332236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.332266] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.343640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.343667] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:42.745 [2024-11-27 03:13:45.356735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:42.745 [2024-11-27 03:13:45.356764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.366841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.366884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.377647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.377675] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.388369] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.388409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.399980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.400010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.410937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.410968] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.423733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.423761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.434284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.434314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.445612] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.445639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.458904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.458934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.469498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.469538] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.480436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.480466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.492929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.492961] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.502494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.502534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.513187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.513217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.524088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.524118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.534683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.534710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.545385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.545415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.556634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.556661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.567686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.567713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.580383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.580414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.590746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.590774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.601537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.601582] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.004 [2024-11-27 03:13:45.614489] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.004 [2024-11-27 03:13:45.614520] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.624086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.624116] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.635783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.635810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.646708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.646736] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.657870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.657901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.671253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.671283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.682103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.682133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.692969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.692999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.705883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.705912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.716108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.716139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.726665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.726692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.738031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.738062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.749149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.749181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.761645] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.761688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.771922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.771952] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.782746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.782774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.795405] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.795434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.805718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.805746] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.817092] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.817122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.829689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.829716] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.840031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.840061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.850686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.850713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.861875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.861905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.263 [2024-11-27 03:13:45.872660] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.263 [2024-11-27 03:13:45.872688] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.885027] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.885057] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.894046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.894075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 00:18:43.522 Latency(us) 00:18:43.522 [2024-11-27T02:13:46.141Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:43.522 [2024-11-27T02:13:46.141Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:18:43.522 Nvme1n1 : 5.01 11480.43 89.69 0.00 0.00 11135.48 4781.70 25243.50 00:18:43.522 [2024-11-27T02:13:46.141Z] =================================================================================================================== 00:18:43.522 [2024-11-27T02:13:46.141Z] Total : 11480.43 89.69 0.00 0.00 11135.48 4781.70 25243.50 00:18:43.522 [2024-11-27 03:13:45.901505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.901542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.909507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.909544] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.917582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.917628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.925623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.925674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.937669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.937725] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.945666] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.945714] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.953690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.953738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.961703] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.961751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.969746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.969795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.977761] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.977813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.985776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.985828] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:45.993789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:45.993836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:46.001810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:46.001866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:46.009838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:46.009889] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:46.017864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.522 [2024-11-27 03:13:46.017912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.522 [2024-11-27 03:13:46.025867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.025913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.033866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.033892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.041895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.041927] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.049957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.050008] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.057967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.058016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.065979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.066024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.073980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.074007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.082034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.082080] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.090062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.090113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.098083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.098149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.106063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.106088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.114083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.114107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 [2024-11-27 03:13:46.122107] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:43.523 [2024-11-27 03:13:46.122131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:43.523 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2464105) - No such process 00:18:43.523 03:13:46 -- target/zcopy.sh@49 -- # wait 2464105 00:18:43.523 03:13:46 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:18:43.523 03:13:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.523 03:13:46 -- common/autotest_common.sh@10 -- # set +x 00:18:43.523 03:13:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.523 03:13:46 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:18:43.523 03:13:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.523 03:13:46 -- common/autotest_common.sh@10 -- # set +x 00:18:43.781 delay0 00:18:43.781 03:13:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.781 03:13:46 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:18:43.781 03:13:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:43.781 03:13:46 -- common/autotest_common.sh@10 -- # set +x 00:18:43.781 03:13:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:43.781 03:13:46 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:18:43.781 EAL: No free 2048 kB hugepages reported on node 1 00:18:43.781 [2024-11-27 03:13:46.244392] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:18:50.340 Initializing NVMe Controllers 00:18:50.340 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:50.340 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:50.340 Initialization complete. Launching workers. 00:18:50.340 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 91 00:18:50.340 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 378, failed to submit 33 00:18:50.340 success 165, unsuccess 213, failed 0 00:18:50.340 03:13:52 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:18:50.340 03:13:52 -- target/zcopy.sh@60 -- # nvmftestfini 00:18:50.340 03:13:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:50.340 03:13:52 -- nvmf/common.sh@116 -- # sync 00:18:50.340 03:13:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:50.340 03:13:52 -- nvmf/common.sh@119 -- # set +e 00:18:50.340 03:13:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:50.340 03:13:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:50.340 rmmod nvme_tcp 00:18:50.340 rmmod nvme_fabrics 00:18:50.340 rmmod nvme_keyring 00:18:50.340 03:13:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:50.340 03:13:52 -- nvmf/common.sh@123 -- # set -e 00:18:50.340 03:13:52 -- nvmf/common.sh@124 -- # return 0 00:18:50.340 03:13:52 -- nvmf/common.sh@477 -- # '[' -n 2462726 ']' 00:18:50.340 03:13:52 -- nvmf/common.sh@478 -- # killprocess 2462726 00:18:50.340 03:13:52 -- common/autotest_common.sh@936 -- # '[' -z 2462726 ']' 00:18:50.340 03:13:52 -- common/autotest_common.sh@940 -- # kill -0 2462726 00:18:50.340 03:13:52 -- common/autotest_common.sh@941 -- # uname 00:18:50.340 03:13:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:50.340 03:13:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2462726 00:18:50.340 03:13:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:50.340 03:13:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:50.340 03:13:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2462726' 00:18:50.340 killing process with pid 2462726 00:18:50.340 03:13:52 -- common/autotest_common.sh@955 -- # kill 2462726 00:18:50.340 03:13:52 -- common/autotest_common.sh@960 -- # wait 2462726 00:18:50.340 03:13:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:50.340 03:13:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:50.340 03:13:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:50.340 03:13:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:50.340 03:13:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:50.340 03:13:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:50.340 03:13:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:50.340 03:13:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:52.873 03:13:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:52.873 00:18:52.873 real 0m28.750s 00:18:52.873 user 0m42.339s 00:18:52.873 sys 0m8.154s 00:18:52.873 03:13:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:52.873 03:13:54 -- common/autotest_common.sh@10 -- # set +x 00:18:52.873 ************************************ 00:18:52.873 END TEST nvmf_zcopy 00:18:52.873 ************************************ 00:18:52.873 03:13:54 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:52.873 03:13:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:52.873 03:13:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:52.873 03:13:54 -- common/autotest_common.sh@10 -- # set +x 00:18:52.873 ************************************ 00:18:52.873 START TEST nvmf_nmic 00:18:52.873 ************************************ 00:18:52.873 03:13:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:18:52.873 * Looking for test storage... 00:18:52.873 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:52.873 03:13:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:52.873 03:13:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:52.873 03:13:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:52.873 03:13:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:52.873 03:13:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:52.873 03:13:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:52.873 03:13:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:52.873 03:13:55 -- scripts/common.sh@335 -- # IFS=.-: 00:18:52.873 03:13:55 -- scripts/common.sh@335 -- # read -ra ver1 00:18:52.873 03:13:55 -- scripts/common.sh@336 -- # IFS=.-: 00:18:52.873 03:13:55 -- scripts/common.sh@336 -- # read -ra ver2 00:18:52.873 03:13:55 -- scripts/common.sh@337 -- # local 'op=<' 00:18:52.873 03:13:55 -- scripts/common.sh@339 -- # ver1_l=2 00:18:52.873 03:13:55 -- scripts/common.sh@340 -- # ver2_l=1 00:18:52.873 03:13:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:52.873 03:13:55 -- scripts/common.sh@343 -- # case "$op" in 00:18:52.873 03:13:55 -- scripts/common.sh@344 -- # : 1 00:18:52.873 03:13:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:52.873 03:13:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:52.873 03:13:55 -- scripts/common.sh@364 -- # decimal 1 00:18:52.873 03:13:55 -- scripts/common.sh@352 -- # local d=1 00:18:52.873 03:13:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:52.873 03:13:55 -- scripts/common.sh@354 -- # echo 1 00:18:52.873 03:13:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:52.873 03:13:55 -- scripts/common.sh@365 -- # decimal 2 00:18:52.873 03:13:55 -- scripts/common.sh@352 -- # local d=2 00:18:52.873 03:13:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:52.873 03:13:55 -- scripts/common.sh@354 -- # echo 2 00:18:52.873 03:13:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:52.873 03:13:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:52.873 03:13:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:52.873 03:13:55 -- scripts/common.sh@367 -- # return 0 00:18:52.873 03:13:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:52.873 03:13:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:52.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:52.873 --rc genhtml_branch_coverage=1 00:18:52.873 --rc genhtml_function_coverage=1 00:18:52.873 --rc genhtml_legend=1 00:18:52.873 --rc geninfo_all_blocks=1 00:18:52.873 --rc geninfo_unexecuted_blocks=1 00:18:52.873 00:18:52.873 ' 00:18:52.873 03:13:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:52.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:52.873 --rc genhtml_branch_coverage=1 00:18:52.873 --rc genhtml_function_coverage=1 00:18:52.873 --rc genhtml_legend=1 00:18:52.873 --rc geninfo_all_blocks=1 00:18:52.873 --rc geninfo_unexecuted_blocks=1 00:18:52.873 00:18:52.873 ' 00:18:52.873 03:13:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:52.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:52.873 --rc genhtml_branch_coverage=1 00:18:52.873 --rc genhtml_function_coverage=1 00:18:52.873 --rc genhtml_legend=1 00:18:52.873 --rc geninfo_all_blocks=1 00:18:52.873 --rc geninfo_unexecuted_blocks=1 00:18:52.873 00:18:52.873 ' 00:18:52.873 03:13:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:52.873 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:52.873 --rc genhtml_branch_coverage=1 00:18:52.873 --rc genhtml_function_coverage=1 00:18:52.873 --rc genhtml_legend=1 00:18:52.874 --rc geninfo_all_blocks=1 00:18:52.874 --rc geninfo_unexecuted_blocks=1 00:18:52.874 00:18:52.874 ' 00:18:52.874 03:13:55 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:52.874 03:13:55 -- nvmf/common.sh@7 -- # uname -s 00:18:52.874 03:13:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:52.874 03:13:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:52.874 03:13:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:52.874 03:13:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:52.874 03:13:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:52.874 03:13:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:52.874 03:13:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:52.874 03:13:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:52.874 03:13:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:52.874 03:13:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:52.874 03:13:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:52.874 03:13:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:52.874 03:13:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:52.874 03:13:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:52.874 03:13:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:52.874 03:13:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:52.874 03:13:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:52.874 03:13:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:52.874 03:13:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:52.874 03:13:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.874 03:13:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.874 03:13:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.874 03:13:55 -- paths/export.sh@5 -- # export PATH 00:18:52.874 03:13:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:52.874 03:13:55 -- nvmf/common.sh@46 -- # : 0 00:18:52.874 03:13:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:52.874 03:13:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:52.874 03:13:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:52.874 03:13:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:52.874 03:13:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:52.874 03:13:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:52.874 03:13:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:52.874 03:13:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:52.874 03:13:55 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:52.874 03:13:55 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:52.874 03:13:55 -- target/nmic.sh@14 -- # nvmftestinit 00:18:52.874 03:13:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:52.874 03:13:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:52.874 03:13:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:52.874 03:13:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:52.874 03:13:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:52.874 03:13:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:52.874 03:13:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:52.874 03:13:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:52.874 03:13:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:52.874 03:13:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:52.874 03:13:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:52.874 03:13:55 -- common/autotest_common.sh@10 -- # set +x 00:18:54.776 03:13:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:54.776 03:13:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:54.776 03:13:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:54.776 03:13:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:54.776 03:13:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:54.776 03:13:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:54.776 03:13:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:54.776 03:13:57 -- nvmf/common.sh@294 -- # net_devs=() 00:18:54.776 03:13:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:54.776 03:13:57 -- nvmf/common.sh@295 -- # e810=() 00:18:54.776 03:13:57 -- nvmf/common.sh@295 -- # local -ga e810 00:18:54.776 03:13:57 -- nvmf/common.sh@296 -- # x722=() 00:18:54.776 03:13:57 -- nvmf/common.sh@296 -- # local -ga x722 00:18:54.776 03:13:57 -- nvmf/common.sh@297 -- # mlx=() 00:18:54.776 03:13:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:54.776 03:13:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:54.776 03:13:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:54.776 03:13:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:54.776 03:13:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:54.776 03:13:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:54.776 03:13:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:54.776 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:54.776 03:13:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:54.776 03:13:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:54.776 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:54.776 03:13:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:54.776 03:13:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:54.776 03:13:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:54.776 03:13:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:54.776 03:13:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:54.776 03:13:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:54.777 03:13:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:54.777 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:54.777 03:13:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:54.777 03:13:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:54.777 03:13:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:54.777 03:13:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:54.777 03:13:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:54.777 03:13:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:54.777 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:54.777 03:13:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:54.777 03:13:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:54.777 03:13:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:54.777 03:13:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:54.777 03:13:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:54.777 03:13:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:54.777 03:13:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:54.777 03:13:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:54.777 03:13:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:54.777 03:13:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:54.777 03:13:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:54.777 03:13:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:54.777 03:13:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:54.777 03:13:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:54.777 03:13:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:54.777 03:13:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:54.777 03:13:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:54.777 03:13:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:54.777 03:13:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:54.777 03:13:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:54.777 03:13:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:54.777 03:13:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:54.777 03:13:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:54.777 03:13:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:54.777 03:13:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:54.777 03:13:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:54.777 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:54.777 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.316 ms 00:18:54.777 00:18:54.777 --- 10.0.0.2 ping statistics --- 00:18:54.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:54.777 rtt min/avg/max/mdev = 0.316/0.316/0.316/0.000 ms 00:18:54.777 03:13:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:54.777 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:54.777 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:18:54.777 00:18:54.777 --- 10.0.0.1 ping statistics --- 00:18:54.777 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:54.777 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:18:54.777 03:13:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:54.777 03:13:57 -- nvmf/common.sh@410 -- # return 0 00:18:54.777 03:13:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:54.777 03:13:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:54.777 03:13:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:54.777 03:13:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:54.777 03:13:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:54.777 03:13:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:54.777 03:13:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:54.777 03:13:57 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:18:54.777 03:13:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:54.777 03:13:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:54.777 03:13:57 -- common/autotest_common.sh@10 -- # set +x 00:18:54.777 03:13:57 -- nvmf/common.sh@469 -- # nvmfpid=2467551 00:18:54.777 03:13:57 -- nvmf/common.sh@470 -- # waitforlisten 2467551 00:18:54.777 03:13:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:18:54.777 03:13:57 -- common/autotest_common.sh@829 -- # '[' -z 2467551 ']' 00:18:54.777 03:13:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:54.777 03:13:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:54.777 03:13:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:54.777 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:54.777 03:13:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:54.777 03:13:57 -- common/autotest_common.sh@10 -- # set +x 00:18:54.777 [2024-11-27 03:13:57.328835] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:54.777 [2024-11-27 03:13:57.328923] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:54.777 EAL: No free 2048 kB hugepages reported on node 1 00:18:55.035 [2024-11-27 03:13:57.411295] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:55.035 [2024-11-27 03:13:57.512031] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:55.035 [2024-11-27 03:13:57.512197] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:55.036 [2024-11-27 03:13:57.512217] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:55.036 [2024-11-27 03:13:57.512231] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:55.036 [2024-11-27 03:13:57.512294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:55.036 [2024-11-27 03:13:57.512357] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:55.036 [2024-11-27 03:13:57.512385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:55.036 [2024-11-27 03:13:57.512391] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:55.969 03:13:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:55.969 03:13:58 -- common/autotest_common.sh@862 -- # return 0 00:18:55.969 03:13:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:55.969 03:13:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 03:13:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:55.969 03:13:58 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:55.969 03:13:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 [2024-11-27 03:13:58.377280] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:55.969 03:13:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.969 03:13:58 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:55.969 03:13:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 Malloc0 00:18:55.969 03:13:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.969 03:13:58 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:18:55.969 03:13:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 03:13:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.969 03:13:58 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:55.969 03:13:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 03:13:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.969 03:13:58 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:55.969 03:13:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 [2024-11-27 03:13:58.428350] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:55.969 03:13:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.969 03:13:58 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:18:55.969 test case1: single bdev can't be used in multiple subsystems 00:18:55.969 03:13:58 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:18:55.969 03:13:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 03:13:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.969 03:13:58 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:18:55.969 03:13:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 03:13:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.969 03:13:58 -- target/nmic.sh@28 -- # nmic_status=0 00:18:55.969 03:13:58 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:18:55.969 03:13:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 [2024-11-27 03:13:58.452197] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:18:55.969 [2024-11-27 03:13:58.452228] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:18:55.969 [2024-11-27 03:13:58.452258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:55.969 request: 00:18:55.969 { 00:18:55.969 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:18:55.969 "namespace": { 00:18:55.969 "bdev_name": "Malloc0" 00:18:55.969 }, 00:18:55.969 "method": "nvmf_subsystem_add_ns", 00:18:55.969 "req_id": 1 00:18:55.969 } 00:18:55.969 Got JSON-RPC error response 00:18:55.969 response: 00:18:55.969 { 00:18:55.969 "code": -32602, 00:18:55.969 "message": "Invalid parameters" 00:18:55.969 } 00:18:55.969 03:13:58 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:18:55.969 03:13:58 -- target/nmic.sh@29 -- # nmic_status=1 00:18:55.969 03:13:58 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:18:55.969 03:13:58 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:18:55.969 Adding namespace failed - expected result. 00:18:55.969 03:13:58 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:18:55.969 test case2: host connect to nvmf target in multiple paths 00:18:55.969 03:13:58 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:18:55.969 03:13:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:55.969 03:13:58 -- common/autotest_common.sh@10 -- # set +x 00:18:55.969 [2024-11-27 03:13:58.460313] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:18:55.969 03:13:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:55.969 03:13:58 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:18:56.535 03:13:59 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:18:57.541 03:13:59 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:18:57.541 03:13:59 -- common/autotest_common.sh@1187 -- # local i=0 00:18:57.541 03:13:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:18:57.541 03:13:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:18:57.541 03:13:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:18:59.436 03:14:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:18:59.436 03:14:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:18:59.436 03:14:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:18:59.436 03:14:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:18:59.436 03:14:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:18:59.436 03:14:01 -- common/autotest_common.sh@1197 -- # return 0 00:18:59.436 03:14:01 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:18:59.436 [global] 00:18:59.436 thread=1 00:18:59.436 invalidate=1 00:18:59.436 rw=write 00:18:59.436 time_based=1 00:18:59.436 runtime=1 00:18:59.436 ioengine=libaio 00:18:59.436 direct=1 00:18:59.436 bs=4096 00:18:59.436 iodepth=1 00:18:59.436 norandommap=0 00:18:59.436 numjobs=1 00:18:59.436 00:18:59.436 verify_dump=1 00:18:59.436 verify_backlog=512 00:18:59.436 verify_state_save=0 00:18:59.436 do_verify=1 00:18:59.436 verify=crc32c-intel 00:18:59.436 [job0] 00:18:59.436 filename=/dev/nvme0n1 00:18:59.436 Could not set queue depth (nvme0n1) 00:18:59.436 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:18:59.436 fio-3.35 00:18:59.436 Starting 1 thread 00:19:00.809 00:19:00.809 job0: (groupid=0, jobs=1): err= 0: pid=2468217: Wed Nov 27 03:14:03 2024 00:19:00.809 read: IOPS=511, BW=2046KiB/s (2095kB/s)(2048KiB/1001msec) 00:19:00.809 slat (nsec): min=10328, max=63960, avg=22658.20, stdev=10598.77 00:19:00.809 clat (usec): min=183, max=41024, avg=1580.93, stdev=7077.94 00:19:00.809 lat (usec): min=194, max=41041, avg=1603.58, stdev=7078.41 00:19:00.809 clat percentiles (usec): 00:19:00.809 | 1.00th=[ 190], 5.00th=[ 196], 10.00th=[ 204], 20.00th=[ 229], 00:19:00.809 | 30.00th=[ 255], 40.00th=[ 269], 50.00th=[ 281], 60.00th=[ 322], 00:19:00.809 | 70.00th=[ 334], 80.00th=[ 433], 90.00th=[ 486], 95.00th=[ 545], 00:19:00.809 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:00.809 | 99.99th=[41157] 00:19:00.809 write: IOPS=807, BW=3229KiB/s (3306kB/s)(3232KiB/1001msec); 0 zone resets 00:19:00.809 slat (usec): min=7, max=35070, avg=57.72, stdev=1233.29 00:19:00.809 clat (usec): min=127, max=307, avg=155.76, stdev=29.29 00:19:00.809 lat (usec): min=135, max=35292, avg=213.48, stdev=1235.94 00:19:00.809 clat percentiles (usec): 00:19:00.809 | 1.00th=[ 130], 5.00th=[ 133], 10.00th=[ 137], 20.00th=[ 139], 00:19:00.809 | 30.00th=[ 143], 40.00th=[ 147], 50.00th=[ 149], 60.00th=[ 151], 00:19:00.809 | 70.00th=[ 155], 80.00th=[ 159], 90.00th=[ 176], 95.00th=[ 243], 00:19:00.809 | 99.00th=[ 247], 99.50th=[ 253], 99.90th=[ 310], 99.95th=[ 310], 00:19:00.809 | 99.99th=[ 310] 00:19:00.809 bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=1 00:19:00.809 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:00.809 lat (usec) : 250=71.06%, 500=25.76%, 750=1.97% 00:19:00.809 lat (msec) : 50=1.21% 00:19:00.809 cpu : usr=1.30%, sys=2.40%, ctx=1322, majf=0, minf=1 00:19:00.809 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:00.809 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:00.809 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:00.809 issued rwts: total=512,808,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:00.809 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:00.809 00:19:00.809 Run status group 0 (all jobs): 00:19:00.809 READ: bw=2046KiB/s (2095kB/s), 2046KiB/s-2046KiB/s (2095kB/s-2095kB/s), io=2048KiB (2097kB), run=1001-1001msec 00:19:00.809 WRITE: bw=3229KiB/s (3306kB/s), 3229KiB/s-3229KiB/s (3306kB/s-3306kB/s), io=3232KiB (3310kB), run=1001-1001msec 00:19:00.809 00:19:00.809 Disk stats (read/write): 00:19:00.809 nvme0n1: ios=536/512, merge=0/0, ticks=1706/78, in_queue=1784, util=98.90% 00:19:00.809 03:14:03 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:00.809 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:00.809 03:14:03 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:00.809 03:14:03 -- common/autotest_common.sh@1208 -- # local i=0 00:19:00.809 03:14:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:00.809 03:14:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:00.809 03:14:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:00.809 03:14:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:00.809 03:14:03 -- common/autotest_common.sh@1220 -- # return 0 00:19:00.809 03:14:03 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:00.809 03:14:03 -- target/nmic.sh@53 -- # nvmftestfini 00:19:00.809 03:14:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:00.809 03:14:03 -- nvmf/common.sh@116 -- # sync 00:19:00.809 03:14:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:00.809 03:14:03 -- nvmf/common.sh@119 -- # set +e 00:19:00.809 03:14:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:00.809 03:14:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:00.809 rmmod nvme_tcp 00:19:00.809 rmmod nvme_fabrics 00:19:00.809 rmmod nvme_keyring 00:19:00.809 03:14:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:00.809 03:14:03 -- nvmf/common.sh@123 -- # set -e 00:19:00.809 03:14:03 -- nvmf/common.sh@124 -- # return 0 00:19:00.809 03:14:03 -- nvmf/common.sh@477 -- # '[' -n 2467551 ']' 00:19:00.809 03:14:03 -- nvmf/common.sh@478 -- # killprocess 2467551 00:19:00.809 03:14:03 -- common/autotest_common.sh@936 -- # '[' -z 2467551 ']' 00:19:00.809 03:14:03 -- common/autotest_common.sh@940 -- # kill -0 2467551 00:19:00.809 03:14:03 -- common/autotest_common.sh@941 -- # uname 00:19:00.809 03:14:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:00.809 03:14:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2467551 00:19:00.809 03:14:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:00.809 03:14:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:00.809 03:14:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2467551' 00:19:00.809 killing process with pid 2467551 00:19:00.809 03:14:03 -- common/autotest_common.sh@955 -- # kill 2467551 00:19:00.809 03:14:03 -- common/autotest_common.sh@960 -- # wait 2467551 00:19:01.068 03:14:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:01.068 03:14:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:01.068 03:14:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:01.068 03:14:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:01.068 03:14:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:01.068 03:14:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:01.068 03:14:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:01.068 03:14:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:03.606 03:14:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:03.606 00:19:03.606 real 0m10.758s 00:19:03.606 user 0m25.580s 00:19:03.606 sys 0m2.426s 00:19:03.606 03:14:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:03.606 03:14:05 -- common/autotest_common.sh@10 -- # set +x 00:19:03.606 ************************************ 00:19:03.606 END TEST nvmf_nmic 00:19:03.606 ************************************ 00:19:03.606 03:14:05 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:03.606 03:14:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:03.606 03:14:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:03.606 03:14:05 -- common/autotest_common.sh@10 -- # set +x 00:19:03.606 ************************************ 00:19:03.606 START TEST nvmf_fio_target 00:19:03.606 ************************************ 00:19:03.606 03:14:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:03.606 * Looking for test storage... 00:19:03.606 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:03.606 03:14:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:03.606 03:14:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:03.606 03:14:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:03.606 03:14:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:03.606 03:14:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:03.606 03:14:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:03.606 03:14:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:03.606 03:14:05 -- scripts/common.sh@335 -- # IFS=.-: 00:19:03.606 03:14:05 -- scripts/common.sh@335 -- # read -ra ver1 00:19:03.606 03:14:05 -- scripts/common.sh@336 -- # IFS=.-: 00:19:03.606 03:14:05 -- scripts/common.sh@336 -- # read -ra ver2 00:19:03.606 03:14:05 -- scripts/common.sh@337 -- # local 'op=<' 00:19:03.606 03:14:05 -- scripts/common.sh@339 -- # ver1_l=2 00:19:03.606 03:14:05 -- scripts/common.sh@340 -- # ver2_l=1 00:19:03.606 03:14:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:03.606 03:14:05 -- scripts/common.sh@343 -- # case "$op" in 00:19:03.606 03:14:05 -- scripts/common.sh@344 -- # : 1 00:19:03.606 03:14:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:03.606 03:14:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:03.606 03:14:05 -- scripts/common.sh@364 -- # decimal 1 00:19:03.606 03:14:05 -- scripts/common.sh@352 -- # local d=1 00:19:03.606 03:14:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:03.606 03:14:05 -- scripts/common.sh@354 -- # echo 1 00:19:03.606 03:14:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:03.606 03:14:05 -- scripts/common.sh@365 -- # decimal 2 00:19:03.606 03:14:05 -- scripts/common.sh@352 -- # local d=2 00:19:03.606 03:14:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:03.606 03:14:05 -- scripts/common.sh@354 -- # echo 2 00:19:03.606 03:14:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:03.606 03:14:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:03.606 03:14:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:03.606 03:14:05 -- scripts/common.sh@367 -- # return 0 00:19:03.606 03:14:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:03.606 03:14:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:03.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:03.606 --rc genhtml_branch_coverage=1 00:19:03.606 --rc genhtml_function_coverage=1 00:19:03.606 --rc genhtml_legend=1 00:19:03.606 --rc geninfo_all_blocks=1 00:19:03.606 --rc geninfo_unexecuted_blocks=1 00:19:03.606 00:19:03.606 ' 00:19:03.606 03:14:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:03.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:03.606 --rc genhtml_branch_coverage=1 00:19:03.606 --rc genhtml_function_coverage=1 00:19:03.606 --rc genhtml_legend=1 00:19:03.606 --rc geninfo_all_blocks=1 00:19:03.606 --rc geninfo_unexecuted_blocks=1 00:19:03.606 00:19:03.606 ' 00:19:03.606 03:14:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:03.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:03.606 --rc genhtml_branch_coverage=1 00:19:03.606 --rc genhtml_function_coverage=1 00:19:03.606 --rc genhtml_legend=1 00:19:03.606 --rc geninfo_all_blocks=1 00:19:03.606 --rc geninfo_unexecuted_blocks=1 00:19:03.606 00:19:03.606 ' 00:19:03.606 03:14:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:03.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:03.606 --rc genhtml_branch_coverage=1 00:19:03.606 --rc genhtml_function_coverage=1 00:19:03.606 --rc genhtml_legend=1 00:19:03.606 --rc geninfo_all_blocks=1 00:19:03.606 --rc geninfo_unexecuted_blocks=1 00:19:03.606 00:19:03.606 ' 00:19:03.606 03:14:05 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:03.606 03:14:05 -- nvmf/common.sh@7 -- # uname -s 00:19:03.606 03:14:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:03.606 03:14:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:03.606 03:14:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:03.606 03:14:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:03.606 03:14:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:03.606 03:14:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:03.606 03:14:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:03.606 03:14:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:03.606 03:14:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:03.606 03:14:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:03.606 03:14:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:03.606 03:14:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:03.606 03:14:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:03.606 03:14:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:03.606 03:14:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:03.606 03:14:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:03.606 03:14:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:03.606 03:14:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:03.606 03:14:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:03.606 03:14:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.606 03:14:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.606 03:14:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.606 03:14:05 -- paths/export.sh@5 -- # export PATH 00:19:03.607 03:14:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:03.607 03:14:05 -- nvmf/common.sh@46 -- # : 0 00:19:03.607 03:14:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:03.607 03:14:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:03.607 03:14:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:03.607 03:14:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:03.607 03:14:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:03.607 03:14:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:03.607 03:14:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:03.607 03:14:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:03.607 03:14:05 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:03.607 03:14:05 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:03.607 03:14:05 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:03.607 03:14:05 -- target/fio.sh@16 -- # nvmftestinit 00:19:03.607 03:14:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:03.607 03:14:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:03.607 03:14:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:03.607 03:14:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:03.607 03:14:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:03.607 03:14:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:03.607 03:14:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:03.607 03:14:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:03.607 03:14:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:03.607 03:14:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:03.607 03:14:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:03.607 03:14:05 -- common/autotest_common.sh@10 -- # set +x 00:19:05.509 03:14:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:05.509 03:14:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:05.509 03:14:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:05.510 03:14:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:05.510 03:14:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:05.510 03:14:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:05.510 03:14:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:05.510 03:14:07 -- nvmf/common.sh@294 -- # net_devs=() 00:19:05.510 03:14:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:05.510 03:14:07 -- nvmf/common.sh@295 -- # e810=() 00:19:05.510 03:14:07 -- nvmf/common.sh@295 -- # local -ga e810 00:19:05.510 03:14:07 -- nvmf/common.sh@296 -- # x722=() 00:19:05.510 03:14:07 -- nvmf/common.sh@296 -- # local -ga x722 00:19:05.510 03:14:07 -- nvmf/common.sh@297 -- # mlx=() 00:19:05.510 03:14:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:05.510 03:14:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:05.510 03:14:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:05.510 03:14:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:05.510 03:14:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:05.510 03:14:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:05.510 03:14:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:05.510 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:05.510 03:14:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:05.510 03:14:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:05.510 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:05.510 03:14:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:05.510 03:14:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:05.510 03:14:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:05.510 03:14:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:05.510 03:14:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:05.510 03:14:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:05.510 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:05.510 03:14:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:05.510 03:14:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:05.510 03:14:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:05.510 03:14:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:05.510 03:14:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:05.510 03:14:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:05.510 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:05.510 03:14:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:05.510 03:14:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:05.510 03:14:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:05.510 03:14:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:05.510 03:14:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:05.510 03:14:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:05.510 03:14:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:05.510 03:14:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:05.510 03:14:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:05.510 03:14:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:05.510 03:14:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:05.510 03:14:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:05.510 03:14:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:05.510 03:14:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:05.510 03:14:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:05.510 03:14:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:05.510 03:14:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:05.510 03:14:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:05.510 03:14:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:05.510 03:14:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:05.510 03:14:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:05.510 03:14:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:05.510 03:14:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:05.510 03:14:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:05.510 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:05.510 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:19:05.510 00:19:05.510 --- 10.0.0.2 ping statistics --- 00:19:05.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:05.510 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:19:05.510 03:14:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:05.510 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:05.510 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.122 ms 00:19:05.510 00:19:05.510 --- 10.0.0.1 ping statistics --- 00:19:05.510 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:05.510 rtt min/avg/max/mdev = 0.122/0.122/0.122/0.000 ms 00:19:05.510 03:14:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:05.510 03:14:07 -- nvmf/common.sh@410 -- # return 0 00:19:05.510 03:14:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:05.510 03:14:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:05.510 03:14:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:05.510 03:14:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:05.510 03:14:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:05.510 03:14:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:05.510 03:14:08 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:05.510 03:14:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:05.510 03:14:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:05.510 03:14:08 -- common/autotest_common.sh@10 -- # set +x 00:19:05.510 03:14:08 -- nvmf/common.sh@469 -- # nvmfpid=2470311 00:19:05.510 03:14:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:05.510 03:14:08 -- nvmf/common.sh@470 -- # waitforlisten 2470311 00:19:05.510 03:14:08 -- common/autotest_common.sh@829 -- # '[' -z 2470311 ']' 00:19:05.510 03:14:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:05.510 03:14:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:05.510 03:14:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:05.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:05.510 03:14:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:05.510 03:14:08 -- common/autotest_common.sh@10 -- # set +x 00:19:05.510 [2024-11-27 03:14:08.061006] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:05.510 [2024-11-27 03:14:08.061077] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:05.510 EAL: No free 2048 kB hugepages reported on node 1 00:19:05.769 [2024-11-27 03:14:08.134866] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:05.769 [2024-11-27 03:14:08.234900] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:05.769 [2024-11-27 03:14:08.235062] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:05.769 [2024-11-27 03:14:08.235081] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:05.769 [2024-11-27 03:14:08.235095] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:05.769 [2024-11-27 03:14:08.235177] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:05.769 [2024-11-27 03:14:08.235230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:05.769 [2024-11-27 03:14:08.235257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:05.769 [2024-11-27 03:14:08.235261] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:06.703 03:14:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:06.703 03:14:09 -- common/autotest_common.sh@862 -- # return 0 00:19:06.703 03:14:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:06.703 03:14:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:06.703 03:14:09 -- common/autotest_common.sh@10 -- # set +x 00:19:06.703 03:14:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:06.703 03:14:09 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:06.960 [2024-11-27 03:14:09.376324] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:06.960 03:14:09 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:07.218 03:14:09 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:07.218 03:14:09 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:07.477 03:14:09 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:07.477 03:14:09 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:07.735 03:14:10 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:07.735 03:14:10 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:07.993 03:14:10 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:07.993 03:14:10 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:08.251 03:14:10 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:08.509 03:14:11 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:08.509 03:14:11 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:08.768 03:14:11 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:08.768 03:14:11 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:09.026 03:14:11 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:09.026 03:14:11 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:09.283 03:14:11 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:09.541 03:14:12 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:09.541 03:14:12 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:09.799 03:14:12 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:09.799 03:14:12 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:10.057 03:14:12 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:10.315 [2024-11-27 03:14:12.789208] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:10.315 03:14:12 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:10.573 03:14:13 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:10.830 03:14:13 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:11.396 03:14:13 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:11.396 03:14:13 -- common/autotest_common.sh@1187 -- # local i=0 00:19:11.396 03:14:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:11.396 03:14:13 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:11.396 03:14:13 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:11.396 03:14:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:13.922 03:14:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:13.922 03:14:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:13.922 03:14:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:13.922 03:14:15 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:13.922 03:14:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:13.922 03:14:15 -- common/autotest_common.sh@1197 -- # return 0 00:19:13.922 03:14:15 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:13.922 [global] 00:19:13.922 thread=1 00:19:13.922 invalidate=1 00:19:13.922 rw=write 00:19:13.922 time_based=1 00:19:13.922 runtime=1 00:19:13.922 ioengine=libaio 00:19:13.922 direct=1 00:19:13.922 bs=4096 00:19:13.922 iodepth=1 00:19:13.922 norandommap=0 00:19:13.922 numjobs=1 00:19:13.922 00:19:13.922 verify_dump=1 00:19:13.922 verify_backlog=512 00:19:13.922 verify_state_save=0 00:19:13.922 do_verify=1 00:19:13.922 verify=crc32c-intel 00:19:13.922 [job0] 00:19:13.922 filename=/dev/nvme0n1 00:19:13.922 [job1] 00:19:13.922 filename=/dev/nvme0n2 00:19:13.922 [job2] 00:19:13.922 filename=/dev/nvme0n3 00:19:13.922 [job3] 00:19:13.922 filename=/dev/nvme0n4 00:19:13.922 Could not set queue depth (nvme0n1) 00:19:13.922 Could not set queue depth (nvme0n2) 00:19:13.922 Could not set queue depth (nvme0n3) 00:19:13.922 Could not set queue depth (nvme0n4) 00:19:13.922 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.922 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.922 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.922 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:13.922 fio-3.35 00:19:13.922 Starting 4 threads 00:19:14.855 00:19:14.855 job0: (groupid=0, jobs=1): err= 0: pid=2471544: Wed Nov 27 03:14:17 2024 00:19:14.855 read: IOPS=23, BW=95.6KiB/s (97.9kB/s)(96.0KiB/1004msec) 00:19:14.855 slat (nsec): min=5500, max=34060, avg=15619.79, stdev=4801.97 00:19:14.855 clat (usec): min=229, max=41072, avg=35889.42, stdev=13730.60 00:19:14.855 lat (usec): min=244, max=41088, avg=35905.04, stdev=13733.17 00:19:14.855 clat percentiles (usec): 00:19:14.855 | 1.00th=[ 231], 5.00th=[ 306], 10.00th=[ 445], 20.00th=[41157], 00:19:14.855 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:14.855 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:14.855 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:14.855 | 99.99th=[41157] 00:19:14.855 write: IOPS=509, BW=2040KiB/s (2089kB/s)(2048KiB/1004msec); 0 zone resets 00:19:14.855 slat (usec): min=7, max=834, avg=21.94, stdev=45.32 00:19:14.855 clat (usec): min=149, max=482, avg=248.53, stdev=58.79 00:19:14.855 lat (usec): min=165, max=1178, avg=270.47, stdev=76.82 00:19:14.855 clat percentiles (usec): 00:19:14.855 | 1.00th=[ 165], 5.00th=[ 184], 10.00th=[ 196], 20.00th=[ 208], 00:19:14.855 | 30.00th=[ 217], 40.00th=[ 225], 50.00th=[ 231], 60.00th=[ 241], 00:19:14.855 | 70.00th=[ 262], 80.00th=[ 285], 90.00th=[ 334], 95.00th=[ 367], 00:19:14.855 | 99.00th=[ 457], 99.50th=[ 474], 99.90th=[ 482], 99.95th=[ 482], 00:19:14.855 | 99.99th=[ 482] 00:19:14.855 bw ( KiB/s): min= 4096, max= 4096, per=25.43%, avg=4096.00, stdev= 0.00, samples=1 00:19:14.855 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:14.855 lat (usec) : 250=63.06%, 500=33.02% 00:19:14.855 lat (msec) : 50=3.92% 00:19:14.855 cpu : usr=0.70%, sys=0.70%, ctx=539, majf=0, minf=1 00:19:14.855 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.855 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.855 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.855 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.855 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.855 job1: (groupid=0, jobs=1): err= 0: pid=2471545: Wed Nov 27 03:14:17 2024 00:19:14.855 read: IOPS=21, BW=86.5KiB/s (88.6kB/s)(88.0KiB/1017msec) 00:19:14.855 slat (nsec): min=8521, max=35234, avg=17120.82, stdev=5977.70 00:19:14.855 clat (usec): min=40688, max=41023, avg=40962.75, stdev=64.48 00:19:14.855 lat (usec): min=40697, max=41039, avg=40979.87, stdev=65.62 00:19:14.855 clat percentiles (usec): 00:19:14.855 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:14.856 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:14.856 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:14.856 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:14.856 | 99.99th=[41157] 00:19:14.856 write: IOPS=503, BW=2014KiB/s (2062kB/s)(2048KiB/1017msec); 0 zone resets 00:19:14.856 slat (nsec): min=9291, max=54032, avg=19375.30, stdev=6840.83 00:19:14.856 clat (usec): min=147, max=369, avg=197.73, stdev=31.03 00:19:14.856 lat (usec): min=157, max=385, avg=217.10, stdev=31.28 00:19:14.856 clat percentiles (usec): 00:19:14.856 | 1.00th=[ 157], 5.00th=[ 163], 10.00th=[ 174], 20.00th=[ 182], 00:19:14.856 | 30.00th=[ 186], 40.00th=[ 188], 50.00th=[ 192], 60.00th=[ 196], 00:19:14.856 | 70.00th=[ 200], 80.00th=[ 206], 90.00th=[ 229], 95.00th=[ 260], 00:19:14.856 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 371], 99.95th=[ 371], 00:19:14.856 | 99.99th=[ 371] 00:19:14.856 bw ( KiB/s): min= 4096, max= 4096, per=25.43%, avg=4096.00, stdev= 0.00, samples=1 00:19:14.856 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:14.856 lat (usec) : 250=89.70%, 500=6.18% 00:19:14.856 lat (msec) : 50=4.12% 00:19:14.856 cpu : usr=0.69%, sys=1.28%, ctx=535, majf=0, minf=1 00:19:14.856 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.856 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.856 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.856 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.856 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.856 job2: (groupid=0, jobs=1): err= 0: pid=2471546: Wed Nov 27 03:14:17 2024 00:19:14.856 read: IOPS=24, BW=99.6KiB/s (102kB/s)(100KiB/1004msec) 00:19:14.856 slat (nsec): min=5988, max=34358, avg=15643.88, stdev=4824.28 00:19:14.856 clat (usec): min=311, max=41106, avg=34492.71, stdev=15120.18 00:19:14.856 lat (usec): min=318, max=41122, avg=34508.36, stdev=15122.19 00:19:14.856 clat percentiles (usec): 00:19:14.856 | 1.00th=[ 310], 5.00th=[ 347], 10.00th=[ 351], 20.00th=[40633], 00:19:14.856 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:14.856 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:14.856 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:14.856 | 99.99th=[41157] 00:19:14.856 write: IOPS=509, BW=2040KiB/s (2089kB/s)(2048KiB/1004msec); 0 zone resets 00:19:14.856 slat (nsec): min=7570, max=54056, avg=19427.90, stdev=8925.22 00:19:14.856 clat (usec): min=164, max=520, avg=248.89, stdev=52.93 00:19:14.856 lat (usec): min=192, max=560, avg=268.31, stdev=51.91 00:19:14.856 clat percentiles (usec): 00:19:14.856 | 1.00th=[ 178], 5.00th=[ 188], 10.00th=[ 198], 20.00th=[ 208], 00:19:14.856 | 30.00th=[ 217], 40.00th=[ 225], 50.00th=[ 233], 60.00th=[ 243], 00:19:14.856 | 70.00th=[ 265], 80.00th=[ 302], 90.00th=[ 330], 95.00th=[ 351], 00:19:14.856 | 99.00th=[ 383], 99.50th=[ 416], 99.90th=[ 523], 99.95th=[ 523], 00:19:14.856 | 99.99th=[ 523] 00:19:14.856 bw ( KiB/s): min= 4096, max= 4096, per=25.43%, avg=4096.00, stdev= 0.00, samples=1 00:19:14.856 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:14.856 lat (usec) : 250=62.20%, 500=33.33%, 750=0.37% 00:19:14.856 lat (msec) : 2=0.19%, 50=3.91% 00:19:14.856 cpu : usr=0.80%, sys=0.60%, ctx=540, majf=0, minf=1 00:19:14.856 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.856 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.856 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.856 issued rwts: total=25,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.856 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.856 job3: (groupid=0, jobs=1): err= 0: pid=2471547: Wed Nov 27 03:14:17 2024 00:19:14.856 read: IOPS=2214, BW=8859KiB/s (9072kB/s)(8868KiB/1001msec) 00:19:14.856 slat (nsec): min=5860, max=45834, avg=9246.29, stdev=4012.89 00:19:14.856 clat (usec): min=184, max=383, avg=226.63, stdev=28.57 00:19:14.856 lat (usec): min=192, max=401, avg=235.87, stdev=30.62 00:19:14.856 clat percentiles (usec): 00:19:14.856 | 1.00th=[ 190], 5.00th=[ 194], 10.00th=[ 198], 20.00th=[ 202], 00:19:14.856 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 217], 60.00th=[ 233], 00:19:14.856 | 70.00th=[ 243], 80.00th=[ 249], 90.00th=[ 260], 95.00th=[ 285], 00:19:14.856 | 99.00th=[ 318], 99.50th=[ 326], 99.90th=[ 343], 99.95th=[ 343], 00:19:14.856 | 99.99th=[ 383] 00:19:14.856 write: IOPS=2557, BW=9.99MiB/s (10.5MB/s)(10.0MiB/1001msec); 0 zone resets 00:19:14.856 slat (nsec): min=7231, max=58496, avg=12246.84, stdev=5844.66 00:19:14.856 clat (usec): min=130, max=1058, avg=168.45, stdev=45.17 00:19:14.856 lat (usec): min=139, max=1079, avg=180.70, stdev=47.94 00:19:14.856 clat percentiles (usec): 00:19:14.856 | 1.00th=[ 139], 5.00th=[ 141], 10.00th=[ 143], 20.00th=[ 145], 00:19:14.856 | 30.00th=[ 147], 40.00th=[ 149], 50.00th=[ 153], 60.00th=[ 157], 00:19:14.856 | 70.00th=[ 165], 80.00th=[ 186], 90.00th=[ 219], 95.00th=[ 239], 00:19:14.856 | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 701], 99.95th=[ 717], 00:19:14.856 | 99.99th=[ 1057] 00:19:14.856 bw ( KiB/s): min=10272, max=10272, per=63.76%, avg=10272.00, stdev= 0.00, samples=1 00:19:14.856 iops : min= 2568, max= 2568, avg=2568.00, stdev= 0.00, samples=1 00:19:14.856 lat (usec) : 250=89.85%, 500=10.07%, 750=0.06% 00:19:14.856 lat (msec) : 2=0.02% 00:19:14.856 cpu : usr=4.00%, sys=6.80%, ctx=4777, majf=0, minf=2 00:19:14.856 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:14.856 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.856 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:14.856 issued rwts: total=2217,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:14.856 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:14.856 00:19:14.856 Run status group 0 (all jobs): 00:19:14.856 READ: bw=8999KiB/s (9215kB/s), 86.5KiB/s-8859KiB/s (88.6kB/s-9072kB/s), io=9152KiB (9372kB), run=1001-1017msec 00:19:14.856 WRITE: bw=15.7MiB/s (16.5MB/s), 2014KiB/s-9.99MiB/s (2062kB/s-10.5MB/s), io=16.0MiB (16.8MB), run=1001-1017msec 00:19:14.856 00:19:14.856 Disk stats (read/write): 00:19:14.856 nvme0n1: ios=69/512, merge=0/0, ticks=744/127, in_queue=871, util=87.17% 00:19:14.856 nvme0n2: ios=41/512, merge=0/0, ticks=1643/99, in_queue=1742, util=89.84% 00:19:14.856 nvme0n3: ios=74/512, merge=0/0, ticks=904/129, in_queue=1033, util=93.54% 00:19:14.856 nvme0n4: ios=2060/2048, merge=0/0, ticks=503/340, in_queue=843, util=95.49% 00:19:14.856 03:14:17 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:14.856 [global] 00:19:14.856 thread=1 00:19:14.856 invalidate=1 00:19:14.856 rw=randwrite 00:19:14.856 time_based=1 00:19:14.856 runtime=1 00:19:14.856 ioengine=libaio 00:19:14.856 direct=1 00:19:14.856 bs=4096 00:19:14.856 iodepth=1 00:19:14.856 norandommap=0 00:19:14.856 numjobs=1 00:19:14.856 00:19:14.856 verify_dump=1 00:19:14.856 verify_backlog=512 00:19:14.856 verify_state_save=0 00:19:14.856 do_verify=1 00:19:14.856 verify=crc32c-intel 00:19:14.856 [job0] 00:19:14.856 filename=/dev/nvme0n1 00:19:14.856 [job1] 00:19:14.856 filename=/dev/nvme0n2 00:19:14.856 [job2] 00:19:14.856 filename=/dev/nvme0n3 00:19:14.856 [job3] 00:19:14.856 filename=/dev/nvme0n4 00:19:14.856 Could not set queue depth (nvme0n1) 00:19:14.856 Could not set queue depth (nvme0n2) 00:19:14.856 Could not set queue depth (nvme0n3) 00:19:14.856 Could not set queue depth (nvme0n4) 00:19:15.112 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:15.112 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:15.112 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:15.112 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:15.112 fio-3.35 00:19:15.112 Starting 4 threads 00:19:16.486 00:19:16.486 job0: (groupid=0, jobs=1): err= 0: pid=2471775: Wed Nov 27 03:14:18 2024 00:19:16.486 read: IOPS=837, BW=3349KiB/s (3429kB/s)(3416KiB/1020msec) 00:19:16.486 slat (nsec): min=5895, max=51963, avg=14192.61, stdev=7539.47 00:19:16.486 clat (usec): min=203, max=41330, avg=902.27, stdev=4786.74 00:19:16.486 lat (usec): min=210, max=41347, avg=916.46, stdev=4786.63 00:19:16.486 clat percentiles (usec): 00:19:16.486 | 1.00th=[ 243], 5.00th=[ 258], 10.00th=[ 265], 20.00th=[ 269], 00:19:16.486 | 30.00th=[ 277], 40.00th=[ 285], 50.00th=[ 293], 60.00th=[ 306], 00:19:16.486 | 70.00th=[ 334], 80.00th=[ 400], 90.00th=[ 490], 95.00th=[ 578], 00:19:16.486 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:16.486 | 99.99th=[41157] 00:19:16.486 write: IOPS=1003, BW=4016KiB/s (4112kB/s)(4096KiB/1020msec); 0 zone resets 00:19:16.486 slat (nsec): min=7373, max=57941, avg=16874.07, stdev=7644.76 00:19:16.486 clat (usec): min=127, max=1278, avg=205.15, stdev=60.08 00:19:16.486 lat (usec): min=135, max=1288, avg=222.03, stdev=63.07 00:19:16.486 clat percentiles (usec): 00:19:16.486 | 1.00th=[ 137], 5.00th=[ 141], 10.00th=[ 151], 20.00th=[ 174], 00:19:16.486 | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 194], 60.00th=[ 202], 00:19:16.486 | 70.00th=[ 208], 80.00th=[ 227], 90.00th=[ 265], 95.00th=[ 297], 00:19:16.486 | 99.00th=[ 388], 99.50th=[ 441], 99.90th=[ 474], 99.95th=[ 1287], 00:19:16.486 | 99.99th=[ 1287] 00:19:16.486 bw ( KiB/s): min= 8192, max= 8192, per=37.01%, avg=8192.00, stdev= 0.00, samples=1 00:19:16.486 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:16.486 lat (usec) : 250=47.82%, 500=47.82%, 750=3.67% 00:19:16.486 lat (msec) : 2=0.05%, 50=0.64% 00:19:16.486 cpu : usr=2.45%, sys=3.63%, ctx=1879, majf=0, minf=2 00:19:16.486 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:16.486 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.486 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.486 issued rwts: total=854,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:16.486 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:16.486 job1: (groupid=0, jobs=1): err= 0: pid=2471778: Wed Nov 27 03:14:18 2024 00:19:16.486 read: IOPS=30, BW=121KiB/s (124kB/s)(124KiB/1025msec) 00:19:16.486 slat (nsec): min=12140, max=36035, avg=20888.65, stdev=8516.34 00:19:16.486 clat (usec): min=273, max=41381, avg=29175.85, stdev=18675.37 00:19:16.486 lat (usec): min=308, max=41393, avg=29196.73, stdev=18670.77 00:19:16.486 clat percentiles (usec): 00:19:16.486 | 1.00th=[ 273], 5.00th=[ 293], 10.00th=[ 392], 20.00th=[ 570], 00:19:16.486 | 30.00th=[40633], 40.00th=[40633], 50.00th=[41157], 60.00th=[41157], 00:19:16.486 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:16.486 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:16.486 | 99.99th=[41157] 00:19:16.486 write: IOPS=499, BW=1998KiB/s (2046kB/s)(2048KiB/1025msec); 0 zone resets 00:19:16.486 slat (nsec): min=5960, max=73510, avg=16763.99, stdev=9494.92 00:19:16.486 clat (usec): min=134, max=520, avg=211.15, stdev=70.36 00:19:16.486 lat (usec): min=142, max=562, avg=227.92, stdev=75.70 00:19:16.486 clat percentiles (usec): 00:19:16.486 | 1.00th=[ 139], 5.00th=[ 147], 10.00th=[ 151], 20.00th=[ 159], 00:19:16.486 | 30.00th=[ 167], 40.00th=[ 176], 50.00th=[ 186], 60.00th=[ 202], 00:19:16.486 | 70.00th=[ 231], 80.00th=[ 249], 90.00th=[ 302], 95.00th=[ 371], 00:19:16.486 | 99.00th=[ 465], 99.50th=[ 494], 99.90th=[ 523], 99.95th=[ 523], 00:19:16.486 | 99.99th=[ 523] 00:19:16.486 bw ( KiB/s): min= 4096, max= 4096, per=18.50%, avg=4096.00, stdev= 0.00, samples=1 00:19:16.486 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:16.486 lat (usec) : 250=75.87%, 500=18.97%, 750=1.10% 00:19:16.486 lat (msec) : 50=4.05% 00:19:16.486 cpu : usr=0.88%, sys=0.59%, ctx=546, majf=0, minf=1 00:19:16.486 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:16.486 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.486 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.486 issued rwts: total=31,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:16.486 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:16.486 job2: (groupid=0, jobs=1): err= 0: pid=2471779: Wed Nov 27 03:14:18 2024 00:19:16.486 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:16.486 slat (nsec): min=5291, max=58515, avg=12088.44, stdev=5424.17 00:19:16.486 clat (usec): min=206, max=41119, avg=265.84, stdev=903.58 00:19:16.486 lat (usec): min=216, max=41130, avg=277.93, stdev=903.58 00:19:16.486 clat percentiles (usec): 00:19:16.486 | 1.00th=[ 212], 5.00th=[ 221], 10.00th=[ 225], 20.00th=[ 229], 00:19:16.486 | 30.00th=[ 235], 40.00th=[ 239], 50.00th=[ 241], 60.00th=[ 245], 00:19:16.486 | 70.00th=[ 249], 80.00th=[ 258], 90.00th=[ 273], 95.00th=[ 289], 00:19:16.486 | 99.00th=[ 338], 99.50th=[ 351], 99.90th=[ 416], 99.95th=[ 791], 00:19:16.486 | 99.99th=[41157] 00:19:16.486 write: IOPS=2082, BW=8332KiB/s (8532kB/s)(8340KiB/1001msec); 0 zone resets 00:19:16.486 slat (nsec): min=6350, max=50051, avg=13876.86, stdev=4715.74 00:19:16.487 clat (usec): min=146, max=710, avg=185.59, stdev=22.19 00:19:16.487 lat (usec): min=158, max=742, avg=199.46, stdev=23.75 00:19:16.487 clat percentiles (usec): 00:19:16.487 | 1.00th=[ 159], 5.00th=[ 165], 10.00th=[ 167], 20.00th=[ 172], 00:19:16.487 | 30.00th=[ 176], 40.00th=[ 180], 50.00th=[ 182], 60.00th=[ 186], 00:19:16.487 | 70.00th=[ 192], 80.00th=[ 196], 90.00th=[ 206], 95.00th=[ 219], 00:19:16.487 | 99.00th=[ 251], 99.50th=[ 265], 99.90th=[ 343], 99.95th=[ 490], 00:19:16.487 | 99.99th=[ 709] 00:19:16.487 bw ( KiB/s): min= 8192, max= 8192, per=37.01%, avg=8192.00, stdev= 0.00, samples=1 00:19:16.487 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:16.487 lat (usec) : 250=84.95%, 500=14.98%, 750=0.02%, 1000=0.02% 00:19:16.487 lat (msec) : 50=0.02% 00:19:16.487 cpu : usr=2.60%, sys=6.00%, ctx=4134, majf=0, minf=1 00:19:16.487 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:16.487 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.487 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.487 issued rwts: total=2048,2085,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:16.487 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:16.487 job3: (groupid=0, jobs=1): err= 0: pid=2471780: Wed Nov 27 03:14:18 2024 00:19:16.487 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:19:16.487 slat (nsec): min=5344, max=52990, avg=9791.09, stdev=5807.46 00:19:16.487 clat (usec): min=204, max=1162, avg=265.61, stdev=47.40 00:19:16.487 lat (usec): min=210, max=1170, avg=275.41, stdev=50.32 00:19:16.487 clat percentiles (usec): 00:19:16.487 | 1.00th=[ 210], 5.00th=[ 217], 10.00th=[ 221], 20.00th=[ 227], 00:19:16.487 | 30.00th=[ 233], 40.00th=[ 239], 50.00th=[ 255], 60.00th=[ 273], 00:19:16.487 | 70.00th=[ 289], 80.00th=[ 302], 90.00th=[ 330], 95.00th=[ 347], 00:19:16.487 | 99.00th=[ 379], 99.50th=[ 396], 99.90th=[ 465], 99.95th=[ 474], 00:19:16.487 | 99.99th=[ 1156] 00:19:16.487 write: IOPS=2048, BW=8196KiB/s (8393kB/s)(8204KiB/1001msec); 0 zone resets 00:19:16.487 slat (nsec): min=7009, max=72789, avg=13671.26, stdev=7601.40 00:19:16.487 clat (usec): min=137, max=844, avg=191.91, stdev=43.74 00:19:16.487 lat (usec): min=144, max=856, avg=205.58, stdev=47.71 00:19:16.487 clat percentiles (usec): 00:19:16.487 | 1.00th=[ 145], 5.00th=[ 151], 10.00th=[ 153], 20.00th=[ 161], 00:19:16.487 | 30.00th=[ 169], 40.00th=[ 180], 50.00th=[ 188], 60.00th=[ 194], 00:19:16.487 | 70.00th=[ 202], 80.00th=[ 210], 90.00th=[ 229], 95.00th=[ 262], 00:19:16.487 | 99.00th=[ 375], 99.50th=[ 412], 99.90th=[ 635], 99.95th=[ 660], 00:19:16.487 | 99.99th=[ 848] 00:19:16.487 bw ( KiB/s): min= 8192, max= 8192, per=37.01%, avg=8192.00, stdev= 0.00, samples=1 00:19:16.487 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:16.487 lat (usec) : 250=70.82%, 500=29.08%, 750=0.05%, 1000=0.02% 00:19:16.487 lat (msec) : 2=0.02% 00:19:16.487 cpu : usr=3.40%, sys=6.70%, ctx=4100, majf=0, minf=1 00:19:16.487 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:16.487 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.487 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:16.487 issued rwts: total=2048,2051,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:16.487 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:16.487 00:19:16.487 Run status group 0 (all jobs): 00:19:16.487 READ: bw=19.0MiB/s (19.9MB/s), 121KiB/s-8184KiB/s (124kB/s-8380kB/s), io=19.5MiB (20.4MB), run=1001-1025msec 00:19:16.487 WRITE: bw=21.6MiB/s (22.7MB/s), 1998KiB/s-8332KiB/s (2046kB/s-8532kB/s), io=22.2MiB (23.2MB), run=1001-1025msec 00:19:16.487 00:19:16.487 Disk stats (read/write): 00:19:16.487 nvme0n1: ios=892/1024, merge=0/0, ticks=616/205, in_queue=821, util=87.78% 00:19:16.487 nvme0n2: ios=77/512, merge=0/0, ticks=934/93, in_queue=1027, util=98.07% 00:19:16.487 nvme0n3: ios=1563/1996, merge=0/0, ticks=1397/347, in_queue=1744, util=98.44% 00:19:16.487 nvme0n4: ios=1536/1892, merge=0/0, ticks=393/343, in_queue=736, util=89.59% 00:19:16.487 03:14:18 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:16.487 [global] 00:19:16.487 thread=1 00:19:16.487 invalidate=1 00:19:16.487 rw=write 00:19:16.487 time_based=1 00:19:16.487 runtime=1 00:19:16.487 ioengine=libaio 00:19:16.487 direct=1 00:19:16.487 bs=4096 00:19:16.487 iodepth=128 00:19:16.487 norandommap=0 00:19:16.487 numjobs=1 00:19:16.487 00:19:16.487 verify_dump=1 00:19:16.487 verify_backlog=512 00:19:16.487 verify_state_save=0 00:19:16.487 do_verify=1 00:19:16.487 verify=crc32c-intel 00:19:16.487 [job0] 00:19:16.487 filename=/dev/nvme0n1 00:19:16.487 [job1] 00:19:16.487 filename=/dev/nvme0n2 00:19:16.487 [job2] 00:19:16.487 filename=/dev/nvme0n3 00:19:16.487 [job3] 00:19:16.487 filename=/dev/nvme0n4 00:19:16.487 Could not set queue depth (nvme0n1) 00:19:16.487 Could not set queue depth (nvme0n2) 00:19:16.487 Could not set queue depth (nvme0n3) 00:19:16.487 Could not set queue depth (nvme0n4) 00:19:16.746 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:16.746 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:16.746 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:16.746 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:16.746 fio-3.35 00:19:16.746 Starting 4 threads 00:19:18.124 00:19:18.124 job0: (groupid=0, jobs=1): err= 0: pid=2472013: Wed Nov 27 03:14:20 2024 00:19:18.124 read: IOPS=5080, BW=19.8MiB/s (20.8MB/s)(19.9MiB/1003msec) 00:19:18.124 slat (usec): min=3, max=7726, avg=93.89, stdev=514.16 00:19:18.124 clat (usec): min=766, max=27164, avg=11966.09, stdev=4276.62 00:19:18.124 lat (usec): min=6145, max=27196, avg=12059.99, stdev=4306.01 00:19:18.124 clat percentiles (usec): 00:19:18.124 | 1.00th=[ 6456], 5.00th=[ 8160], 10.00th=[ 9241], 20.00th=[ 9634], 00:19:18.124 | 30.00th=[ 9896], 40.00th=[10028], 50.00th=[10290], 60.00th=[10421], 00:19:18.124 | 70.00th=[10814], 80.00th=[13960], 90.00th=[19006], 95.00th=[21365], 00:19:18.124 | 99.00th=[26608], 99.50th=[27132], 99.90th=[27132], 99.95th=[27132], 00:19:18.124 | 99.99th=[27132] 00:19:18.124 write: IOPS=5104, BW=19.9MiB/s (20.9MB/s)(20.0MiB/1003msec); 0 zone resets 00:19:18.124 slat (usec): min=4, max=40991, avg=92.94, stdev=783.41 00:19:18.124 clat (usec): min=5060, max=47452, avg=11293.49, stdev=2788.40 00:19:18.124 lat (usec): min=5069, max=69184, avg=11386.43, stdev=2921.18 00:19:18.124 clat percentiles (usec): 00:19:18.124 | 1.00th=[ 6128], 5.00th=[ 8225], 10.00th=[ 9634], 20.00th=[10028], 00:19:18.124 | 30.00th=[10159], 40.00th=[10290], 50.00th=[10421], 60.00th=[10552], 00:19:18.124 | 70.00th=[11076], 80.00th=[11994], 90.00th=[15270], 95.00th=[17957], 00:19:18.124 | 99.00th=[20841], 99.50th=[22938], 99.90th=[25035], 99.95th=[25035], 00:19:18.124 | 99.99th=[47449] 00:19:18.125 bw ( KiB/s): min=18824, max=22136, per=32.66%, avg=20480.00, stdev=2341.94, samples=2 00:19:18.125 iops : min= 4706, max= 5534, avg=5120.00, stdev=585.48, samples=2 00:19:18.125 lat (usec) : 1000=0.01% 00:19:18.125 lat (msec) : 10=30.14%, 20=65.46%, 50=4.40% 00:19:18.125 cpu : usr=6.49%, sys=8.58%, ctx=480, majf=0, minf=1 00:19:18.125 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:18.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.125 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:18.125 issued rwts: total=5096,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:18.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:18.125 job1: (groupid=0, jobs=1): err= 0: pid=2472014: Wed Nov 27 03:14:20 2024 00:19:18.125 read: IOPS=5018, BW=19.6MiB/s (20.6MB/s)(20.5MiB/1045msec) 00:19:18.125 slat (usec): min=3, max=9120, avg=89.80, stdev=581.55 00:19:18.125 clat (usec): min=3596, max=64888, avg=12496.05, stdev=7593.52 00:19:18.125 lat (usec): min=3604, max=64894, avg=12585.85, stdev=7629.26 00:19:18.125 clat percentiles (usec): 00:19:18.125 | 1.00th=[ 5800], 5.00th=[ 7504], 10.00th=[ 8029], 20.00th=[ 8848], 00:19:18.125 | 30.00th=[ 9110], 40.00th=[ 9503], 50.00th=[10028], 60.00th=[10290], 00:19:18.125 | 70.00th=[12256], 80.00th=[15139], 90.00th=[18744], 95.00th=[24511], 00:19:18.125 | 99.00th=[51119], 99.50th=[57410], 99.90th=[63701], 99.95th=[63701], 00:19:18.125 | 99.99th=[64750] 00:19:18.125 write: IOPS=5389, BW=21.1MiB/s (22.1MB/s)(22.0MiB/1045msec); 0 zone resets 00:19:18.125 slat (usec): min=4, max=13524, avg=84.95, stdev=420.54 00:19:18.125 clat (usec): min=1394, max=64918, avg=11865.34, stdev=5852.76 00:19:18.125 lat (usec): min=1420, max=64926, avg=11950.29, stdev=5891.45 00:19:18.125 clat percentiles (usec): 00:19:18.125 | 1.00th=[ 3458], 5.00th=[ 4752], 10.00th=[ 6521], 20.00th=[ 8717], 00:19:18.125 | 30.00th=[ 9896], 40.00th=[10421], 50.00th=[10814], 60.00th=[10945], 00:19:18.125 | 70.00th=[11207], 80.00th=[11600], 90.00th=[19006], 95.00th=[23462], 00:19:18.125 | 99.00th=[36439], 99.50th=[41157], 99.90th=[44827], 99.95th=[64750], 00:19:18.125 | 99.99th=[64750] 00:19:18.125 bw ( KiB/s): min=18928, max=26096, per=35.90%, avg=22512.00, stdev=5068.54, samples=2 00:19:18.125 iops : min= 4732, max= 6524, avg=5628.00, stdev=1267.14, samples=2 00:19:18.125 lat (msec) : 2=0.01%, 4=1.53%, 10=40.05%, 20=50.30%, 50=7.34% 00:19:18.125 lat (msec) : 100=0.77% 00:19:18.125 cpu : usr=7.09%, sys=9.00%, ctx=665, majf=0, minf=1 00:19:18.125 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:18.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.125 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:18.125 issued rwts: total=5244,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:18.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:18.125 job2: (groupid=0, jobs=1): err= 0: pid=2472021: Wed Nov 27 03:14:20 2024 00:19:18.125 read: IOPS=2603, BW=10.2MiB/s (10.7MB/s)(10.3MiB/1010msec) 00:19:18.125 slat (usec): min=3, max=14550, avg=182.47, stdev=1208.84 00:19:18.125 clat (usec): min=6354, max=83312, avg=20855.80, stdev=13286.65 00:19:18.125 lat (usec): min=6363, max=83320, avg=21038.28, stdev=13397.95 00:19:18.125 clat percentiles (usec): 00:19:18.125 | 1.00th=[ 9241], 5.00th=[11207], 10.00th=[13042], 20.00th=[13435], 00:19:18.125 | 30.00th=[14222], 40.00th=[15008], 50.00th=[15401], 60.00th=[17433], 00:19:18.125 | 70.00th=[21103], 80.00th=[25035], 90.00th=[30802], 95.00th=[46924], 00:19:18.125 | 99.00th=[78119], 99.50th=[80217], 99.90th=[83362], 99.95th=[83362], 00:19:18.125 | 99.99th=[83362] 00:19:18.125 write: IOPS=3041, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1010msec); 0 zone resets 00:19:18.125 slat (usec): min=4, max=15871, avg=160.56, stdev=917.42 00:19:18.125 clat (usec): min=1375, max=83316, avg=23831.04, stdev=14063.94 00:19:18.125 lat (usec): min=1388, max=83328, avg=23991.60, stdev=14145.12 00:19:18.125 clat percentiles (usec): 00:19:18.125 | 1.00th=[ 6128], 5.00th=[ 7373], 10.00th=[10683], 20.00th=[12125], 00:19:18.125 | 30.00th=[14615], 40.00th=[16909], 50.00th=[19530], 60.00th=[25822], 00:19:18.125 | 70.00th=[27395], 80.00th=[29230], 90.00th=[45876], 95.00th=[50594], 00:19:18.125 | 99.00th=[69731], 99.50th=[71828], 99.90th=[74974], 99.95th=[83362], 00:19:18.125 | 99.99th=[83362] 00:19:18.125 bw ( KiB/s): min= 8672, max=15448, per=19.23%, avg=12060.00, stdev=4791.36, samples=2 00:19:18.125 iops : min= 2168, max= 3862, avg=3015.00, stdev=1197.84, samples=2 00:19:18.125 lat (msec) : 2=0.05%, 4=0.21%, 10=4.93%, 20=55.79%, 50=33.99% 00:19:18.125 lat (msec) : 100=5.03% 00:19:18.125 cpu : usr=3.57%, sys=5.15%, ctx=254, majf=0, minf=1 00:19:18.125 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:19:18.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.125 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:18.125 issued rwts: total=2630,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:18.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:18.125 job3: (groupid=0, jobs=1): err= 0: pid=2472022: Wed Nov 27 03:14:20 2024 00:19:18.125 read: IOPS=2514, BW=9.82MiB/s (10.3MB/s)(9.85MiB/1003msec) 00:19:18.125 slat (usec): min=2, max=19016, avg=140.42, stdev=1010.49 00:19:18.125 clat (usec): min=2127, max=51561, avg=17582.32, stdev=8233.66 00:19:18.125 lat (usec): min=6030, max=51582, avg=17722.75, stdev=8325.14 00:19:18.125 clat percentiles (usec): 00:19:18.125 | 1.00th=[ 6390], 5.00th=[ 8848], 10.00th=[10814], 20.00th=[12125], 00:19:18.125 | 30.00th=[12518], 40.00th=[13304], 50.00th=[13960], 60.00th=[14615], 00:19:18.125 | 70.00th=[19268], 80.00th=[24511], 90.00th=[33817], 95.00th=[35390], 00:19:18.125 | 99.00th=[38011], 99.50th=[39060], 99.90th=[40633], 99.95th=[44827], 00:19:18.125 | 99.99th=[51643] 00:19:18.125 write: IOPS=2552, BW=9.97MiB/s (10.5MB/s)(10.0MiB/1003msec); 0 zone resets 00:19:18.125 slat (usec): min=3, max=45746, avg=246.44, stdev=1855.79 00:19:18.125 clat (usec): min=3711, max=86035, avg=28505.82, stdev=16701.78 00:19:18.125 lat (msec): min=3, max=106, avg=28.75, stdev=16.88 00:19:18.125 clat percentiles (usec): 00:19:18.125 | 1.00th=[ 8029], 5.00th=[12387], 10.00th=[12649], 20.00th=[12911], 00:19:18.125 | 30.00th=[17171], 40.00th=[25560], 50.00th=[27132], 60.00th=[27919], 00:19:18.125 | 70.00th=[30278], 80.00th=[37487], 90.00th=[57410], 95.00th=[63177], 00:19:18.125 | 99.00th=[81265], 99.50th=[82314], 99.90th=[84411], 99.95th=[86508], 00:19:18.125 | 99.99th=[86508] 00:19:18.125 bw ( KiB/s): min= 7920, max=12560, per=16.33%, avg=10240.00, stdev=3280.98, samples=2 00:19:18.125 iops : min= 1980, max= 3140, avg=2560.00, stdev=820.24, samples=2 00:19:18.125 lat (msec) : 4=0.14%, 10=5.49%, 20=47.76%, 50=40.61%, 100=6.00% 00:19:18.125 cpu : usr=1.90%, sys=2.99%, ctx=217, majf=0, minf=1 00:19:18.125 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:19:18.125 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.125 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:18.125 issued rwts: total=2522,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:18.125 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:18.125 00:19:18.125 Run status group 0 (all jobs): 00:19:18.125 READ: bw=57.9MiB/s (60.7MB/s), 9.82MiB/s-19.8MiB/s (10.3MB/s-20.8MB/s), io=60.5MiB (63.5MB), run=1003-1045msec 00:19:18.125 WRITE: bw=61.2MiB/s (64.2MB/s), 9.97MiB/s-21.1MiB/s (10.5MB/s-22.1MB/s), io=64.0MiB (67.1MB), run=1003-1045msec 00:19:18.125 00:19:18.125 Disk stats (read/write): 00:19:18.125 nvme0n1: ios=4628/4608, merge=0/0, ticks=22619/21762, in_queue=44381, util=91.58% 00:19:18.125 nvme0n2: ios=4898/5120, merge=0/0, ticks=46088/47030, in_queue=93118, util=97.06% 00:19:18.125 nvme0n3: ios=2617/2615, merge=0/0, ticks=51837/51556, in_queue=103393, util=90.94% 00:19:18.125 nvme0n4: ios=1564/2013, merge=0/0, ticks=31852/54918, in_queue=86770, util=99.90% 00:19:18.125 03:14:20 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:18.125 [global] 00:19:18.125 thread=1 00:19:18.125 invalidate=1 00:19:18.125 rw=randwrite 00:19:18.125 time_based=1 00:19:18.125 runtime=1 00:19:18.125 ioengine=libaio 00:19:18.125 direct=1 00:19:18.125 bs=4096 00:19:18.125 iodepth=128 00:19:18.125 norandommap=0 00:19:18.125 numjobs=1 00:19:18.125 00:19:18.125 verify_dump=1 00:19:18.125 verify_backlog=512 00:19:18.125 verify_state_save=0 00:19:18.125 do_verify=1 00:19:18.125 verify=crc32c-intel 00:19:18.125 [job0] 00:19:18.125 filename=/dev/nvme0n1 00:19:18.125 [job1] 00:19:18.125 filename=/dev/nvme0n2 00:19:18.125 [job2] 00:19:18.125 filename=/dev/nvme0n3 00:19:18.125 [job3] 00:19:18.125 filename=/dev/nvme0n4 00:19:18.125 Could not set queue depth (nvme0n1) 00:19:18.125 Could not set queue depth (nvme0n2) 00:19:18.125 Could not set queue depth (nvme0n3) 00:19:18.125 Could not set queue depth (nvme0n4) 00:19:18.125 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:18.125 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:18.125 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:18.125 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:18.125 fio-3.35 00:19:18.125 Starting 4 threads 00:19:19.504 00:19:19.504 job0: (groupid=0, jobs=1): err= 0: pid=2472322: Wed Nov 27 03:14:21 2024 00:19:19.504 read: IOPS=3398, BW=13.3MiB/s (13.9MB/s)(13.4MiB/1009msec) 00:19:19.504 slat (usec): min=2, max=18998, avg=167.21, stdev=1109.18 00:19:19.504 clat (usec): min=1908, max=83377, avg=20287.12, stdev=14966.26 00:19:19.504 lat (usec): min=5302, max=83392, avg=20454.33, stdev=15054.56 00:19:19.504 clat percentiles (usec): 00:19:19.504 | 1.00th=[ 6194], 5.00th=[ 8586], 10.00th=[ 9110], 20.00th=[ 9896], 00:19:19.504 | 30.00th=[11469], 40.00th=[13829], 50.00th=[16450], 60.00th=[17695], 00:19:19.504 | 70.00th=[20317], 80.00th=[23987], 90.00th=[40109], 95.00th=[51119], 00:19:19.504 | 99.00th=[80217], 99.50th=[83362], 99.90th=[83362], 99.95th=[83362], 00:19:19.504 | 99.99th=[83362] 00:19:19.504 write: IOPS=3552, BW=13.9MiB/s (14.5MB/s)(14.0MiB/1009msec); 0 zone resets 00:19:19.504 slat (usec): min=3, max=12402, avg=114.16, stdev=797.42 00:19:19.504 clat (usec): min=5021, max=56795, avg=16291.11, stdev=8934.92 00:19:19.504 lat (usec): min=5032, max=56801, avg=16405.27, stdev=8961.87 00:19:19.504 clat percentiles (usec): 00:19:19.504 | 1.00th=[ 7570], 5.00th=[ 8979], 10.00th=[ 9241], 20.00th=[11076], 00:19:19.504 | 30.00th=[11338], 40.00th=[12256], 50.00th=[12911], 60.00th=[13173], 00:19:19.504 | 70.00th=[17695], 80.00th=[20841], 90.00th=[27657], 95.00th=[34341], 00:19:19.504 | 99.00th=[51119], 99.50th=[56886], 99.90th=[56886], 99.95th=[56886], 00:19:19.504 | 99.99th=[56886] 00:19:19.504 bw ( KiB/s): min=12288, max=16384, per=22.96%, avg=14336.00, stdev=2896.31, samples=2 00:19:19.504 iops : min= 3072, max= 4096, avg=3584.00, stdev=724.08, samples=2 00:19:19.504 lat (msec) : 2=0.01%, 10=18.58%, 20=54.68%, 50=23.19%, 100=3.54% 00:19:19.504 cpu : usr=2.88%, sys=4.46%, ctx=218, majf=0, minf=1 00:19:19.504 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:19:19.504 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.504 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:19.504 issued rwts: total=3429,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.504 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:19.504 job1: (groupid=0, jobs=1): err= 0: pid=2472336: Wed Nov 27 03:14:21 2024 00:19:19.504 read: IOPS=4043, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1013msec) 00:19:19.504 slat (usec): min=3, max=12995, avg=119.60, stdev=758.00 00:19:19.504 clat (usec): min=4113, max=59177, avg=13640.59, stdev=7404.27 00:19:19.504 lat (usec): min=4139, max=59193, avg=13760.19, stdev=7472.05 00:19:19.504 clat percentiles (usec): 00:19:19.504 | 1.00th=[ 4883], 5.00th=[ 8225], 10.00th=[ 8717], 20.00th=[ 9503], 00:19:19.504 | 30.00th=[10159], 40.00th=[10683], 50.00th=[11338], 60.00th=[11994], 00:19:19.504 | 70.00th=[13042], 80.00th=[15926], 90.00th=[20579], 95.00th=[28967], 00:19:19.504 | 99.00th=[45876], 99.50th=[57934], 99.90th=[58983], 99.95th=[58983], 00:19:19.504 | 99.99th=[58983] 00:19:19.504 write: IOPS=4207, BW=16.4MiB/s (17.2MB/s)(16.6MiB/1013msec); 0 zone resets 00:19:19.504 slat (usec): min=3, max=8321, avg=110.46, stdev=535.19 00:19:19.504 clat (usec): min=2757, max=59205, avg=16817.19, stdev=8403.59 00:19:19.504 lat (usec): min=2764, max=59225, avg=16927.66, stdev=8447.07 00:19:19.504 clat percentiles (usec): 00:19:19.504 | 1.00th=[ 3916], 5.00th=[ 6783], 10.00th=[ 8291], 20.00th=[ 9503], 00:19:19.504 | 30.00th=[11600], 40.00th=[12387], 50.00th=[14353], 60.00th=[17433], 00:19:19.504 | 70.00th=[20055], 80.00th=[24773], 90.00th=[29230], 95.00th=[34341], 00:19:19.504 | 99.00th=[39060], 99.50th=[44827], 99.90th=[46924], 99.95th=[46924], 00:19:19.504 | 99.99th=[58983] 00:19:19.504 bw ( KiB/s): min=15808, max=17264, per=26.49%, avg=16536.00, stdev=1029.55, samples=2 00:19:19.504 iops : min= 3952, max= 4316, avg=4134.00, stdev=257.39, samples=2 00:19:19.504 lat (msec) : 4=0.68%, 10=23.44%, 20=55.29%, 50=20.12%, 100=0.47% 00:19:19.504 cpu : usr=5.04%, sys=8.00%, ctx=430, majf=0, minf=1 00:19:19.504 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:19.504 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.504 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:19.504 issued rwts: total=4096,4262,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.504 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:19.504 job2: (groupid=0, jobs=1): err= 0: pid=2472373: Wed Nov 27 03:14:21 2024 00:19:19.504 read: IOPS=3893, BW=15.2MiB/s (15.9MB/s)(15.3MiB/1006msec) 00:19:19.504 slat (usec): min=2, max=15343, avg=117.11, stdev=762.40 00:19:19.504 clat (usec): min=1786, max=43880, avg=14612.08, stdev=5376.09 00:19:19.504 lat (usec): min=3467, max=43888, avg=14729.19, stdev=5443.58 00:19:19.504 clat percentiles (usec): 00:19:19.504 | 1.00th=[ 6259], 5.00th=[ 8455], 10.00th=[ 9896], 20.00th=[11076], 00:19:19.504 | 30.00th=[12125], 40.00th=[12387], 50.00th=[12649], 60.00th=[14353], 00:19:19.504 | 70.00th=[15795], 80.00th=[16909], 90.00th=[20317], 95.00th=[28443], 00:19:19.504 | 99.00th=[30540], 99.50th=[34341], 99.90th=[43779], 99.95th=[43779], 00:19:19.504 | 99.99th=[43779] 00:19:19.504 write: IOPS=4071, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1006msec); 0 zone resets 00:19:19.504 slat (usec): min=3, max=11128, avg=123.94, stdev=709.21 00:19:19.504 clat (usec): min=832, max=51786, avg=17022.21, stdev=9324.92 00:19:19.504 lat (usec): min=7737, max=51819, avg=17146.15, stdev=9383.13 00:19:19.504 clat percentiles (usec): 00:19:19.504 | 1.00th=[ 8356], 5.00th=[ 9110], 10.00th=[10159], 20.00th=[10814], 00:19:19.504 | 30.00th=[12125], 40.00th=[13042], 50.00th=[13566], 60.00th=[14484], 00:19:19.504 | 70.00th=[15270], 80.00th=[21103], 90.00th=[31851], 95.00th=[39584], 00:19:19.504 | 99.00th=[50070], 99.50th=[51643], 99.90th=[51643], 99.95th=[51643], 00:19:19.504 | 99.99th=[51643] 00:19:19.504 bw ( KiB/s): min=14776, max=18028, per=26.27%, avg=16402.00, stdev=2299.51, samples=2 00:19:19.504 iops : min= 3694, max= 4507, avg=4100.50, stdev=574.88, samples=2 00:19:19.504 lat (usec) : 1000=0.01% 00:19:19.504 lat (msec) : 2=0.01%, 4=0.01%, 10=9.98%, 20=72.63%, 50=16.80% 00:19:19.504 lat (msec) : 100=0.55% 00:19:19.504 cpu : usr=3.88%, sys=5.17%, ctx=313, majf=0, minf=2 00:19:19.504 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:19.504 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.504 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:19.504 issued rwts: total=3917,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.504 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:19.504 job3: (groupid=0, jobs=1): err= 0: pid=2472375: Wed Nov 27 03:14:21 2024 00:19:19.504 read: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec) 00:19:19.504 slat (usec): min=2, max=20738, avg=123.78, stdev=844.43 00:19:19.504 clat (usec): min=7844, max=59406, avg=16680.06, stdev=7755.92 00:19:19.504 lat (usec): min=7871, max=63539, avg=16803.84, stdev=7817.34 00:19:19.504 clat percentiles (usec): 00:19:19.504 | 1.00th=[ 8160], 5.00th=[ 9372], 10.00th=[10945], 20.00th=[11731], 00:19:19.504 | 30.00th=[12911], 40.00th=[13698], 50.00th=[13960], 60.00th=[14746], 00:19:19.504 | 70.00th=[17695], 80.00th=[19006], 90.00th=[26608], 95.00th=[33817], 00:19:19.504 | 99.00th=[47973], 99.50th=[51643], 99.90th=[54789], 99.95th=[54789], 00:19:19.504 | 99.99th=[59507] 00:19:19.504 write: IOPS=3845, BW=15.0MiB/s (15.8MB/s)(15.1MiB/1006msec); 0 zone resets 00:19:19.505 slat (usec): min=2, max=19624, avg=137.44, stdev=762.76 00:19:19.505 clat (usec): min=3389, max=54452, avg=17462.76, stdev=7508.88 00:19:19.505 lat (usec): min=7745, max=54456, avg=17600.20, stdev=7568.79 00:19:19.505 clat percentiles (usec): 00:19:19.505 | 1.00th=[ 7963], 5.00th=[ 9896], 10.00th=[11731], 20.00th=[12387], 00:19:19.505 | 30.00th=[12649], 40.00th=[13173], 50.00th=[13960], 60.00th=[15139], 00:19:19.505 | 70.00th=[19530], 80.00th=[24249], 90.00th=[28967], 95.00th=[31589], 00:19:19.505 | 99.00th=[39584], 99.50th=[44303], 99.90th=[54264], 99.95th=[54264], 00:19:19.505 | 99.99th=[54264] 00:19:19.505 bw ( KiB/s): min=13432, max=16496, per=23.97%, avg=14964.00, stdev=2166.58, samples=2 00:19:19.505 iops : min= 3358, max= 4124, avg=3741.00, stdev=541.64, samples=2 00:19:19.505 lat (msec) : 4=0.01%, 10=6.09%, 20=70.27%, 50=23.13%, 100=0.50% 00:19:19.505 cpu : usr=3.38%, sys=4.78%, ctx=347, majf=0, minf=1 00:19:19.505 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:19.505 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:19.505 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:19.505 issued rwts: total=3584,3869,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:19.505 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:19.505 00:19:19.505 Run status group 0 (all jobs): 00:19:19.505 READ: bw=57.9MiB/s (60.8MB/s), 13.3MiB/s-15.8MiB/s (13.9MB/s-16.6MB/s), io=58.7MiB (61.5MB), run=1006-1013msec 00:19:19.505 WRITE: bw=61.0MiB/s (63.9MB/s), 13.9MiB/s-16.4MiB/s (14.5MB/s-17.2MB/s), io=61.8MiB (64.8MB), run=1006-1013msec 00:19:19.505 00:19:19.505 Disk stats (read/write): 00:19:19.505 nvme0n1: ios=2822/3072, merge=0/0, ticks=24053/21392, in_queue=45445, util=98.80% 00:19:19.505 nvme0n2: ios=3633/3767, merge=0/0, ticks=39639/48180, in_queue=87819, util=86.59% 00:19:19.505 nvme0n3: ios=3129/3465, merge=0/0, ticks=16413/20434, in_queue=36847, util=93.42% 00:19:19.505 nvme0n4: ios=3129/3551, merge=0/0, ticks=18288/20219, in_queue=38507, util=95.15% 00:19:19.505 03:14:21 -- target/fio.sh@55 -- # sync 00:19:19.505 03:14:21 -- target/fio.sh@59 -- # fio_pid=2472516 00:19:19.505 03:14:21 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:19.505 03:14:21 -- target/fio.sh@61 -- # sleep 3 00:19:19.505 [global] 00:19:19.505 thread=1 00:19:19.505 invalidate=1 00:19:19.505 rw=read 00:19:19.505 time_based=1 00:19:19.505 runtime=10 00:19:19.505 ioengine=libaio 00:19:19.505 direct=1 00:19:19.505 bs=4096 00:19:19.505 iodepth=1 00:19:19.505 norandommap=1 00:19:19.505 numjobs=1 00:19:19.505 00:19:19.505 [job0] 00:19:19.505 filename=/dev/nvme0n1 00:19:19.505 [job1] 00:19:19.505 filename=/dev/nvme0n2 00:19:19.505 [job2] 00:19:19.505 filename=/dev/nvme0n3 00:19:19.505 [job3] 00:19:19.505 filename=/dev/nvme0n4 00:19:19.505 Could not set queue depth (nvme0n1) 00:19:19.505 Could not set queue depth (nvme0n2) 00:19:19.505 Could not set queue depth (nvme0n3) 00:19:19.505 Could not set queue depth (nvme0n4) 00:19:19.505 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:19.505 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:19.505 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:19.505 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:19.505 fio-3.35 00:19:19.505 Starting 4 threads 00:19:22.793 03:14:24 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:22.793 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=48951296, buflen=4096 00:19:22.793 fio: pid=2472608, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:22.793 03:14:25 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:22.793 03:14:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:22.793 03:14:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:22.793 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=372736, buflen=4096 00:19:22.793 fio: pid=2472607, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:23.051 03:14:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:23.051 03:14:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:23.317 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=1085440, buflen=4096 00:19:23.317 fio: pid=2472605, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:23.317 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=34312192, buflen=4096 00:19:23.317 fio: pid=2472606, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:23.317 03:14:25 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:23.317 03:14:25 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:23.576 00:19:23.576 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2472605: Wed Nov 27 03:14:25 2024 00:19:23.576 read: IOPS=76, BW=305KiB/s (312kB/s)(1060KiB/3476msec) 00:19:23.576 slat (usec): min=5, max=13955, avg=65.60, stdev=854.88 00:19:23.576 clat (usec): min=238, max=47896, avg=12959.97, stdev=18819.57 00:19:23.576 lat (usec): min=249, max=61851, avg=13025.75, stdev=18940.99 00:19:23.576 clat percentiles (usec): 00:19:23.576 | 1.00th=[ 243], 5.00th=[ 265], 10.00th=[ 289], 20.00th=[ 318], 00:19:23.576 | 30.00th=[ 367], 40.00th=[ 404], 50.00th=[ 465], 60.00th=[ 506], 00:19:23.576 | 70.00th=[40633], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:23.576 | 99.00th=[41157], 99.50th=[42730], 99.90th=[47973], 99.95th=[47973], 00:19:23.576 | 99.99th=[47973] 00:19:23.576 bw ( KiB/s): min= 96, max= 872, per=1.51%, avg=338.67, stdev=349.95, samples=6 00:19:23.576 iops : min= 24, max= 218, avg=84.67, stdev=87.49, samples=6 00:19:23.576 lat (usec) : 250=1.88%, 500=57.14%, 750=9.77% 00:19:23.576 lat (msec) : 50=30.83% 00:19:23.576 cpu : usr=0.03%, sys=0.17%, ctx=267, majf=0, minf=1 00:19:23.576 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:23.576 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.576 complete : 0=0.4%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.576 issued rwts: total=266,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.576 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:23.576 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2472606: Wed Nov 27 03:14:25 2024 00:19:23.576 read: IOPS=2260, BW=9039KiB/s (9256kB/s)(32.7MiB/3707msec) 00:19:23.576 slat (usec): min=4, max=27369, avg=14.51, stdev=355.70 00:19:23.576 clat (usec): min=152, max=41412, avg=425.11, stdev=2991.77 00:19:23.576 lat (usec): min=160, max=41431, avg=439.62, stdev=3016.84 00:19:23.576 clat percentiles (usec): 00:19:23.576 | 1.00th=[ 165], 5.00th=[ 172], 10.00th=[ 178], 20.00th=[ 184], 00:19:23.576 | 30.00th=[ 188], 40.00th=[ 192], 50.00th=[ 196], 60.00th=[ 200], 00:19:23.576 | 70.00th=[ 206], 80.00th=[ 212], 90.00th=[ 233], 95.00th=[ 273], 00:19:23.576 | 99.00th=[ 371], 99.50th=[40633], 99.90th=[41157], 99.95th=[41157], 00:19:23.576 | 99.99th=[41157] 00:19:23.576 bw ( KiB/s): min= 112, max=20496, per=38.36%, avg=8561.43, stdev=9103.23, samples=7 00:19:23.576 iops : min= 28, max= 5124, avg=2140.29, stdev=2275.72, samples=7 00:19:23.576 lat (usec) : 250=91.69%, 500=7.72%, 750=0.01% 00:19:23.576 lat (msec) : 10=0.01%, 50=0.55% 00:19:23.576 cpu : usr=0.86%, sys=1.86%, ctx=8385, majf=0, minf=2 00:19:23.576 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:23.576 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.576 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.576 issued rwts: total=8378,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.576 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:23.576 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2472607: Wed Nov 27 03:14:25 2024 00:19:23.576 read: IOPS=28, BW=114KiB/s (117kB/s)(364KiB/3185msec) 00:19:23.576 slat (nsec): min=6830, max=36596, avg=19366.90, stdev=9031.35 00:19:23.576 clat (usec): min=217, max=43005, avg=34720.21, stdev=14771.51 00:19:23.576 lat (usec): min=226, max=43021, avg=34739.59, stdev=14773.61 00:19:23.576 clat percentiles (usec): 00:19:23.577 | 1.00th=[ 219], 5.00th=[ 231], 10.00th=[ 249], 20.00th=[40633], 00:19:23.577 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:23.577 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:23.577 | 99.00th=[43254], 99.50th=[43254], 99.90th=[43254], 99.95th=[43254], 00:19:23.577 | 99.99th=[43254] 00:19:23.577 bw ( KiB/s): min= 96, max= 160, per=0.52%, avg=116.00, stdev=26.65, samples=6 00:19:23.577 iops : min= 24, max= 40, avg=29.00, stdev= 6.66, samples=6 00:19:23.577 lat (usec) : 250=10.87%, 500=4.35% 00:19:23.577 lat (msec) : 50=83.70% 00:19:23.577 cpu : usr=0.13%, sys=0.00%, ctx=92, majf=0, minf=1 00:19:23.577 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:23.577 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.577 complete : 0=1.1%, 4=98.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.577 issued rwts: total=92,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.577 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:23.577 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2472608: Wed Nov 27 03:14:25 2024 00:19:23.577 read: IOPS=4128, BW=16.1MiB/s (16.9MB/s)(46.7MiB/2895msec) 00:19:23.577 slat (nsec): min=4032, max=57631, avg=9697.62, stdev=6379.34 00:19:23.577 clat (usec): min=168, max=41226, avg=229.51, stdev=529.68 00:19:23.577 lat (usec): min=174, max=41232, avg=239.21, stdev=529.87 00:19:23.577 clat percentiles (usec): 00:19:23.577 | 1.00th=[ 180], 5.00th=[ 190], 10.00th=[ 196], 20.00th=[ 202], 00:19:23.577 | 30.00th=[ 208], 40.00th=[ 212], 50.00th=[ 217], 60.00th=[ 221], 00:19:23.577 | 70.00th=[ 225], 80.00th=[ 233], 90.00th=[ 262], 95.00th=[ 281], 00:19:23.577 | 99.00th=[ 367], 99.50th=[ 404], 99.90th=[ 494], 99.95th=[ 537], 00:19:23.577 | 99.99th=[41157] 00:19:23.577 bw ( KiB/s): min=13160, max=17704, per=73.65%, avg=16438.40, stdev=1868.08, samples=5 00:19:23.577 iops : min= 3290, max= 4426, avg=4109.60, stdev=467.02, samples=5 00:19:23.577 lat (usec) : 250=88.38%, 500=11.55%, 750=0.04% 00:19:23.577 lat (msec) : 2=0.01%, 50=0.02% 00:19:23.577 cpu : usr=1.76%, sys=4.73%, ctx=11952, majf=0, minf=2 00:19:23.577 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:23.577 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.577 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:23.577 issued rwts: total=11952,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:23.577 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:23.577 00:19:23.577 Run status group 0 (all jobs): 00:19:23.577 READ: bw=21.8MiB/s (22.9MB/s), 114KiB/s-16.1MiB/s (117kB/s-16.9MB/s), io=80.8MiB (84.7MB), run=2895-3707msec 00:19:23.577 00:19:23.577 Disk stats (read/write): 00:19:23.577 nvme0n1: ios=262/0, merge=0/0, ticks=3306/0, in_queue=3306, util=95.65% 00:19:23.577 nvme0n2: ios=7987/0, merge=0/0, ticks=4444/0, in_queue=4444, util=97.59% 00:19:23.577 nvme0n3: ios=89/0, merge=0/0, ticks=3080/0, in_queue=3080, util=96.79% 00:19:23.577 nvme0n4: ios=11823/0, merge=0/0, ticks=2642/0, in_queue=2642, util=96.75% 00:19:23.577 03:14:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:23.577 03:14:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:24.144 03:14:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:24.144 03:14:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:24.144 03:14:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:24.144 03:14:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:24.402 03:14:26 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:24.402 03:14:26 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:24.661 03:14:27 -- target/fio.sh@69 -- # fio_status=0 00:19:24.661 03:14:27 -- target/fio.sh@70 -- # wait 2472516 00:19:24.661 03:14:27 -- target/fio.sh@70 -- # fio_status=4 00:19:24.661 03:14:27 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:24.925 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:24.925 03:14:27 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:24.925 03:14:27 -- common/autotest_common.sh@1208 -- # local i=0 00:19:24.925 03:14:27 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:24.925 03:14:27 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:24.925 03:14:27 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:24.925 03:14:27 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:24.925 03:14:27 -- common/autotest_common.sh@1220 -- # return 0 00:19:24.925 03:14:27 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:24.925 03:14:27 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:24.925 nvmf hotplug test: fio failed as expected 00:19:24.925 03:14:27 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:25.190 03:14:27 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:25.190 03:14:27 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:25.190 03:14:27 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:25.190 03:14:27 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:25.190 03:14:27 -- target/fio.sh@91 -- # nvmftestfini 00:19:25.190 03:14:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:25.190 03:14:27 -- nvmf/common.sh@116 -- # sync 00:19:25.190 03:14:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:25.190 03:14:27 -- nvmf/common.sh@119 -- # set +e 00:19:25.190 03:14:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:25.190 03:14:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:25.190 rmmod nvme_tcp 00:19:25.190 rmmod nvme_fabrics 00:19:25.190 rmmod nvme_keyring 00:19:25.190 03:14:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:25.190 03:14:27 -- nvmf/common.sh@123 -- # set -e 00:19:25.190 03:14:27 -- nvmf/common.sh@124 -- # return 0 00:19:25.190 03:14:27 -- nvmf/common.sh@477 -- # '[' -n 2470311 ']' 00:19:25.190 03:14:27 -- nvmf/common.sh@478 -- # killprocess 2470311 00:19:25.190 03:14:27 -- common/autotest_common.sh@936 -- # '[' -z 2470311 ']' 00:19:25.190 03:14:27 -- common/autotest_common.sh@940 -- # kill -0 2470311 00:19:25.190 03:14:27 -- common/autotest_common.sh@941 -- # uname 00:19:25.190 03:14:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:25.190 03:14:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2470311 00:19:25.190 03:14:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:25.190 03:14:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:25.190 03:14:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2470311' 00:19:25.190 killing process with pid 2470311 00:19:25.190 03:14:27 -- common/autotest_common.sh@955 -- # kill 2470311 00:19:25.190 03:14:27 -- common/autotest_common.sh@960 -- # wait 2470311 00:19:25.449 03:14:27 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:25.449 03:14:27 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:25.449 03:14:27 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:25.449 03:14:27 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:25.449 03:14:27 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:25.449 03:14:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:25.449 03:14:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:25.449 03:14:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:28.053 03:14:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:28.053 00:19:28.053 real 0m24.318s 00:19:28.053 user 1m25.506s 00:19:28.053 sys 0m6.764s 00:19:28.053 03:14:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:28.053 03:14:30 -- common/autotest_common.sh@10 -- # set +x 00:19:28.053 ************************************ 00:19:28.053 END TEST nvmf_fio_target 00:19:28.053 ************************************ 00:19:28.053 03:14:30 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:28.053 03:14:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:28.053 03:14:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:28.053 03:14:30 -- common/autotest_common.sh@10 -- # set +x 00:19:28.053 ************************************ 00:19:28.053 START TEST nvmf_bdevio 00:19:28.053 ************************************ 00:19:28.053 03:14:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:28.053 * Looking for test storage... 00:19:28.053 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:28.053 03:14:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:28.053 03:14:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:28.053 03:14:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:28.053 03:14:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:28.053 03:14:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:28.053 03:14:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:28.053 03:14:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:28.053 03:14:30 -- scripts/common.sh@335 -- # IFS=.-: 00:19:28.053 03:14:30 -- scripts/common.sh@335 -- # read -ra ver1 00:19:28.053 03:14:30 -- scripts/common.sh@336 -- # IFS=.-: 00:19:28.053 03:14:30 -- scripts/common.sh@336 -- # read -ra ver2 00:19:28.053 03:14:30 -- scripts/common.sh@337 -- # local 'op=<' 00:19:28.053 03:14:30 -- scripts/common.sh@339 -- # ver1_l=2 00:19:28.053 03:14:30 -- scripts/common.sh@340 -- # ver2_l=1 00:19:28.053 03:14:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:28.053 03:14:30 -- scripts/common.sh@343 -- # case "$op" in 00:19:28.053 03:14:30 -- scripts/common.sh@344 -- # : 1 00:19:28.053 03:14:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:28.053 03:14:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:28.053 03:14:30 -- scripts/common.sh@364 -- # decimal 1 00:19:28.053 03:14:30 -- scripts/common.sh@352 -- # local d=1 00:19:28.053 03:14:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:28.053 03:14:30 -- scripts/common.sh@354 -- # echo 1 00:19:28.053 03:14:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:28.053 03:14:30 -- scripts/common.sh@365 -- # decimal 2 00:19:28.053 03:14:30 -- scripts/common.sh@352 -- # local d=2 00:19:28.053 03:14:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:28.053 03:14:30 -- scripts/common.sh@354 -- # echo 2 00:19:28.053 03:14:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:28.053 03:14:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:28.053 03:14:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:28.053 03:14:30 -- scripts/common.sh@367 -- # return 0 00:19:28.053 03:14:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:28.053 03:14:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:28.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.053 --rc genhtml_branch_coverage=1 00:19:28.053 --rc genhtml_function_coverage=1 00:19:28.053 --rc genhtml_legend=1 00:19:28.053 --rc geninfo_all_blocks=1 00:19:28.053 --rc geninfo_unexecuted_blocks=1 00:19:28.053 00:19:28.053 ' 00:19:28.053 03:14:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:28.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.053 --rc genhtml_branch_coverage=1 00:19:28.053 --rc genhtml_function_coverage=1 00:19:28.053 --rc genhtml_legend=1 00:19:28.053 --rc geninfo_all_blocks=1 00:19:28.053 --rc geninfo_unexecuted_blocks=1 00:19:28.053 00:19:28.053 ' 00:19:28.053 03:14:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:28.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.053 --rc genhtml_branch_coverage=1 00:19:28.053 --rc genhtml_function_coverage=1 00:19:28.053 --rc genhtml_legend=1 00:19:28.053 --rc geninfo_all_blocks=1 00:19:28.053 --rc geninfo_unexecuted_blocks=1 00:19:28.053 00:19:28.053 ' 00:19:28.053 03:14:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:28.053 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:28.053 --rc genhtml_branch_coverage=1 00:19:28.053 --rc genhtml_function_coverage=1 00:19:28.053 --rc genhtml_legend=1 00:19:28.053 --rc geninfo_all_blocks=1 00:19:28.053 --rc geninfo_unexecuted_blocks=1 00:19:28.053 00:19:28.053 ' 00:19:28.053 03:14:30 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:28.053 03:14:30 -- nvmf/common.sh@7 -- # uname -s 00:19:28.053 03:14:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:28.053 03:14:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:28.053 03:14:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:28.053 03:14:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:28.053 03:14:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:28.054 03:14:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:28.054 03:14:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:28.054 03:14:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:28.054 03:14:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:28.054 03:14:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:28.054 03:14:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:28.054 03:14:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:28.054 03:14:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:28.054 03:14:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:28.054 03:14:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:28.054 03:14:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:28.054 03:14:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:28.054 03:14:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:28.054 03:14:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:28.054 03:14:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.054 03:14:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.054 03:14:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.054 03:14:30 -- paths/export.sh@5 -- # export PATH 00:19:28.054 03:14:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:28.054 03:14:30 -- nvmf/common.sh@46 -- # : 0 00:19:28.054 03:14:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:28.054 03:14:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:28.054 03:14:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:28.054 03:14:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:28.054 03:14:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:28.054 03:14:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:28.054 03:14:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:28.054 03:14:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:28.054 03:14:30 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:28.054 03:14:30 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:28.054 03:14:30 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:28.054 03:14:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:28.054 03:14:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:28.054 03:14:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:28.054 03:14:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:28.054 03:14:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:28.054 03:14:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:28.054 03:14:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:28.054 03:14:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:28.054 03:14:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:28.054 03:14:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:28.054 03:14:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:28.054 03:14:30 -- common/autotest_common.sh@10 -- # set +x 00:19:29.961 03:14:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:29.961 03:14:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:29.961 03:14:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:29.961 03:14:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:29.961 03:14:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:29.961 03:14:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:29.961 03:14:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:29.961 03:14:32 -- nvmf/common.sh@294 -- # net_devs=() 00:19:29.961 03:14:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:29.961 03:14:32 -- nvmf/common.sh@295 -- # e810=() 00:19:29.961 03:14:32 -- nvmf/common.sh@295 -- # local -ga e810 00:19:29.961 03:14:32 -- nvmf/common.sh@296 -- # x722=() 00:19:29.961 03:14:32 -- nvmf/common.sh@296 -- # local -ga x722 00:19:29.961 03:14:32 -- nvmf/common.sh@297 -- # mlx=() 00:19:29.961 03:14:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:29.961 03:14:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:29.961 03:14:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:29.961 03:14:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:29.961 03:14:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:29.961 03:14:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:29.961 03:14:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:29.961 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:29.961 03:14:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:29.961 03:14:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:29.961 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:29.961 03:14:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:29.961 03:14:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:29.961 03:14:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:29.961 03:14:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:29.961 03:14:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:29.961 03:14:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:29.961 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:29.961 03:14:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:29.961 03:14:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:29.961 03:14:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:29.961 03:14:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:29.961 03:14:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:29.961 03:14:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:29.961 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:29.961 03:14:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:29.961 03:14:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:29.961 03:14:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:29.961 03:14:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:29.961 03:14:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:29.961 03:14:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:29.961 03:14:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:29.961 03:14:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:29.961 03:14:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:29.961 03:14:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:29.961 03:14:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:29.961 03:14:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:29.961 03:14:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:29.961 03:14:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:29.961 03:14:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:29.961 03:14:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:29.961 03:14:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:29.961 03:14:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:29.961 03:14:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:29.961 03:14:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:29.961 03:14:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:29.961 03:14:32 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:29.961 03:14:32 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:29.961 03:14:32 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:29.961 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:29.961 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.365 ms 00:19:29.961 00:19:29.961 --- 10.0.0.2 ping statistics --- 00:19:29.961 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:29.961 rtt min/avg/max/mdev = 0.365/0.365/0.365/0.000 ms 00:19:29.961 03:14:32 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:29.961 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:29.961 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.147 ms 00:19:29.961 00:19:29.961 --- 10.0.0.1 ping statistics --- 00:19:29.961 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:29.961 rtt min/avg/max/mdev = 0.147/0.147/0.147/0.000 ms 00:19:29.961 03:14:32 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:29.961 03:14:32 -- nvmf/common.sh@410 -- # return 0 00:19:29.961 03:14:32 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:29.961 03:14:32 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:29.961 03:14:32 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:29.961 03:14:32 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:29.961 03:14:32 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:29.961 03:14:32 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:29.961 03:14:32 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:29.962 03:14:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:29.962 03:14:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:29.962 03:14:32 -- common/autotest_common.sh@10 -- # set +x 00:19:29.962 03:14:32 -- nvmf/common.sh@469 -- # nvmfpid=2475268 00:19:29.962 03:14:32 -- nvmf/common.sh@470 -- # waitforlisten 2475268 00:19:29.962 03:14:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:29.962 03:14:32 -- common/autotest_common.sh@829 -- # '[' -z 2475268 ']' 00:19:29.962 03:14:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:29.962 03:14:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:29.962 03:14:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:29.962 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:29.962 03:14:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:29.962 03:14:32 -- common/autotest_common.sh@10 -- # set +x 00:19:29.962 [2024-11-27 03:14:32.467275] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:29.962 [2024-11-27 03:14:32.467369] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:29.962 EAL: No free 2048 kB hugepages reported on node 1 00:19:29.962 [2024-11-27 03:14:32.545094] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:30.220 [2024-11-27 03:14:32.642160] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:30.220 [2024-11-27 03:14:32.642316] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:30.220 [2024-11-27 03:14:32.642343] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:30.220 [2024-11-27 03:14:32.642357] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:30.220 [2024-11-27 03:14:32.642441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:30.220 [2024-11-27 03:14:32.642533] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:30.220 [2024-11-27 03:14:32.642566] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:30.220 [2024-11-27 03:14:32.642569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:31.157 03:14:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:31.157 03:14:33 -- common/autotest_common.sh@862 -- # return 0 00:19:31.157 03:14:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:31.157 03:14:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:31.157 03:14:33 -- common/autotest_common.sh@10 -- # set +x 00:19:31.157 03:14:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:31.157 03:14:33 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:31.157 03:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.157 03:14:33 -- common/autotest_common.sh@10 -- # set +x 00:19:31.157 [2024-11-27 03:14:33.551408] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:31.157 03:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.157 03:14:33 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:31.157 03:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.157 03:14:33 -- common/autotest_common.sh@10 -- # set +x 00:19:31.157 Malloc0 00:19:31.157 03:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.157 03:14:33 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:31.157 03:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.157 03:14:33 -- common/autotest_common.sh@10 -- # set +x 00:19:31.157 03:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.157 03:14:33 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:31.157 03:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.157 03:14:33 -- common/autotest_common.sh@10 -- # set +x 00:19:31.157 03:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.157 03:14:33 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:31.157 03:14:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:31.157 03:14:33 -- common/autotest_common.sh@10 -- # set +x 00:19:31.157 [2024-11-27 03:14:33.605084] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:31.157 03:14:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:31.157 03:14:33 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:31.157 03:14:33 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:31.157 03:14:33 -- nvmf/common.sh@520 -- # config=() 00:19:31.157 03:14:33 -- nvmf/common.sh@520 -- # local subsystem config 00:19:31.157 03:14:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:31.157 03:14:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:31.157 { 00:19:31.157 "params": { 00:19:31.157 "name": "Nvme$subsystem", 00:19:31.157 "trtype": "$TEST_TRANSPORT", 00:19:31.157 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:31.157 "adrfam": "ipv4", 00:19:31.157 "trsvcid": "$NVMF_PORT", 00:19:31.157 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:31.157 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:31.157 "hdgst": ${hdgst:-false}, 00:19:31.157 "ddgst": ${ddgst:-false} 00:19:31.157 }, 00:19:31.157 "method": "bdev_nvme_attach_controller" 00:19:31.157 } 00:19:31.157 EOF 00:19:31.157 )") 00:19:31.157 03:14:33 -- nvmf/common.sh@542 -- # cat 00:19:31.157 03:14:33 -- nvmf/common.sh@544 -- # jq . 00:19:31.157 03:14:33 -- nvmf/common.sh@545 -- # IFS=, 00:19:31.157 03:14:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:31.157 "params": { 00:19:31.157 "name": "Nvme1", 00:19:31.157 "trtype": "tcp", 00:19:31.157 "traddr": "10.0.0.2", 00:19:31.157 "adrfam": "ipv4", 00:19:31.157 "trsvcid": "4420", 00:19:31.157 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:31.157 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:31.157 "hdgst": false, 00:19:31.157 "ddgst": false 00:19:31.157 }, 00:19:31.157 "method": "bdev_nvme_attach_controller" 00:19:31.157 }' 00:19:31.157 [2024-11-27 03:14:33.650980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:31.157 [2024-11-27 03:14:33.651046] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2475431 ] 00:19:31.157 EAL: No free 2048 kB hugepages reported on node 1 00:19:31.157 [2024-11-27 03:14:33.713564] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:31.416 [2024-11-27 03:14:33.802351] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:31.416 [2024-11-27 03:14:33.802405] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:31.416 [2024-11-27 03:14:33.802408] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:31.674 [2024-11-27 03:14:34.138949] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:31.674 [2024-11-27 03:14:34.139001] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:31.674 I/O targets: 00:19:31.674 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:31.674 00:19:31.674 00:19:31.674 CUnit - A unit testing framework for C - Version 2.1-3 00:19:31.674 http://cunit.sourceforge.net/ 00:19:31.674 00:19:31.674 00:19:31.674 Suite: bdevio tests on: Nvme1n1 00:19:31.674 Test: blockdev write read block ...passed 00:19:31.674 Test: blockdev write zeroes read block ...passed 00:19:31.674 Test: blockdev write zeroes read no split ...passed 00:19:31.674 Test: blockdev write zeroes read split ...passed 00:19:31.674 Test: blockdev write zeroes read split partial ...passed 00:19:31.674 Test: blockdev reset ...[2024-11-27 03:14:34.291503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:31.674 [2024-11-27 03:14:34.291618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e44670 (9): Bad file descriptor 00:19:31.932 [2024-11-27 03:14:34.307149] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:31.932 passed 00:19:31.932 Test: blockdev write read 8 blocks ...passed 00:19:31.932 Test: blockdev write read size > 128k ...passed 00:19:31.932 Test: blockdev write read invalid size ...passed 00:19:31.932 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:31.932 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:31.932 Test: blockdev write read max offset ...passed 00:19:31.932 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:31.932 Test: blockdev writev readv 8 blocks ...passed 00:19:31.932 Test: blockdev writev readv 30 x 1block ...passed 00:19:31.932 Test: blockdev writev readv block ...passed 00:19:31.932 Test: blockdev writev readv size > 128k ...passed 00:19:31.932 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:31.932 Test: blockdev comparev and writev ...[2024-11-27 03:14:34.519705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:31.932 [2024-11-27 03:14:34.519740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:31.932 [2024-11-27 03:14:34.519764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:31.932 [2024-11-27 03:14:34.519780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:31.932 [2024-11-27 03:14:34.520175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:31.932 [2024-11-27 03:14:34.520201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:31.932 [2024-11-27 03:14:34.520223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:31.932 [2024-11-27 03:14:34.520248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:31.932 [2024-11-27 03:14:34.520619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:31.932 [2024-11-27 03:14:34.520643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:31.932 [2024-11-27 03:14:34.520664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:31.932 [2024-11-27 03:14:34.520680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:31.932 [2024-11-27 03:14:34.521014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:31.932 [2024-11-27 03:14:34.521038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:31.932 [2024-11-27 03:14:34.521058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:31.932 [2024-11-27 03:14:34.521073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:32.190 passed 00:19:32.190 Test: blockdev nvme passthru rw ...passed 00:19:32.190 Test: blockdev nvme passthru vendor specific ...[2024-11-27 03:14:34.602814] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:32.190 [2024-11-27 03:14:34.602841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:32.190 [2024-11-27 03:14:34.602980] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:32.190 [2024-11-27 03:14:34.603004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:32.190 [2024-11-27 03:14:34.603138] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:32.190 [2024-11-27 03:14:34.603161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:32.190 [2024-11-27 03:14:34.603299] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:32.190 [2024-11-27 03:14:34.603322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:32.190 passed 00:19:32.190 Test: blockdev nvme admin passthru ...passed 00:19:32.190 Test: blockdev copy ...passed 00:19:32.190 00:19:32.190 Run Summary: Type Total Ran Passed Failed Inactive 00:19:32.190 suites 1 1 n/a 0 0 00:19:32.190 tests 23 23 23 0 0 00:19:32.190 asserts 152 152 152 0 n/a 00:19:32.190 00:19:32.190 Elapsed time = 1.048 seconds 00:19:32.451 03:14:34 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:32.451 03:14:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:32.451 03:14:34 -- common/autotest_common.sh@10 -- # set +x 00:19:32.451 03:14:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:32.451 03:14:34 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:32.451 03:14:34 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:32.451 03:14:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:32.451 03:14:34 -- nvmf/common.sh@116 -- # sync 00:19:32.451 03:14:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:32.451 03:14:34 -- nvmf/common.sh@119 -- # set +e 00:19:32.451 03:14:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:32.451 03:14:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:32.451 rmmod nvme_tcp 00:19:32.451 rmmod nvme_fabrics 00:19:32.451 rmmod nvme_keyring 00:19:32.451 03:14:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:32.451 03:14:34 -- nvmf/common.sh@123 -- # set -e 00:19:32.451 03:14:34 -- nvmf/common.sh@124 -- # return 0 00:19:32.451 03:14:34 -- nvmf/common.sh@477 -- # '[' -n 2475268 ']' 00:19:32.451 03:14:34 -- nvmf/common.sh@478 -- # killprocess 2475268 00:19:32.451 03:14:34 -- common/autotest_common.sh@936 -- # '[' -z 2475268 ']' 00:19:32.451 03:14:34 -- common/autotest_common.sh@940 -- # kill -0 2475268 00:19:32.451 03:14:34 -- common/autotest_common.sh@941 -- # uname 00:19:32.451 03:14:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:32.451 03:14:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2475268 00:19:32.451 03:14:34 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:32.451 03:14:34 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:32.451 03:14:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2475268' 00:19:32.451 killing process with pid 2475268 00:19:32.451 03:14:34 -- common/autotest_common.sh@955 -- # kill 2475268 00:19:32.451 03:14:34 -- common/autotest_common.sh@960 -- # wait 2475268 00:19:32.710 03:14:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:32.710 03:14:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:32.710 03:14:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:32.710 03:14:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:32.710 03:14:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:32.710 03:14:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:32.710 03:14:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:32.710 03:14:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:35.245 03:14:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:35.245 00:19:35.245 real 0m7.238s 00:19:35.245 user 0m13.836s 00:19:35.245 sys 0m2.148s 00:19:35.245 03:14:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:35.245 03:14:37 -- common/autotest_common.sh@10 -- # set +x 00:19:35.245 ************************************ 00:19:35.245 END TEST nvmf_bdevio 00:19:35.245 ************************************ 00:19:35.245 03:14:37 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:35.245 03:14:37 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:35.245 03:14:37 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:35.245 03:14:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:35.245 03:14:37 -- common/autotest_common.sh@10 -- # set +x 00:19:35.245 ************************************ 00:19:35.245 START TEST nvmf_bdevio_no_huge 00:19:35.245 ************************************ 00:19:35.245 03:14:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:35.245 * Looking for test storage... 00:19:35.245 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:35.245 03:14:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:35.245 03:14:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:35.245 03:14:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:35.245 03:14:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:35.245 03:14:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:35.245 03:14:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:35.245 03:14:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:35.245 03:14:37 -- scripts/common.sh@335 -- # IFS=.-: 00:19:35.245 03:14:37 -- scripts/common.sh@335 -- # read -ra ver1 00:19:35.245 03:14:37 -- scripts/common.sh@336 -- # IFS=.-: 00:19:35.245 03:14:37 -- scripts/common.sh@336 -- # read -ra ver2 00:19:35.245 03:14:37 -- scripts/common.sh@337 -- # local 'op=<' 00:19:35.245 03:14:37 -- scripts/common.sh@339 -- # ver1_l=2 00:19:35.245 03:14:37 -- scripts/common.sh@340 -- # ver2_l=1 00:19:35.245 03:14:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:35.245 03:14:37 -- scripts/common.sh@343 -- # case "$op" in 00:19:35.245 03:14:37 -- scripts/common.sh@344 -- # : 1 00:19:35.245 03:14:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:35.245 03:14:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:35.245 03:14:37 -- scripts/common.sh@364 -- # decimal 1 00:19:35.245 03:14:37 -- scripts/common.sh@352 -- # local d=1 00:19:35.245 03:14:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:35.245 03:14:37 -- scripts/common.sh@354 -- # echo 1 00:19:35.245 03:14:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:35.245 03:14:37 -- scripts/common.sh@365 -- # decimal 2 00:19:35.245 03:14:37 -- scripts/common.sh@352 -- # local d=2 00:19:35.245 03:14:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:35.245 03:14:37 -- scripts/common.sh@354 -- # echo 2 00:19:35.245 03:14:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:35.245 03:14:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:35.245 03:14:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:35.245 03:14:37 -- scripts/common.sh@367 -- # return 0 00:19:35.245 03:14:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:35.245 03:14:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:35.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:35.245 --rc genhtml_branch_coverage=1 00:19:35.245 --rc genhtml_function_coverage=1 00:19:35.245 --rc genhtml_legend=1 00:19:35.245 --rc geninfo_all_blocks=1 00:19:35.245 --rc geninfo_unexecuted_blocks=1 00:19:35.245 00:19:35.245 ' 00:19:35.245 03:14:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:35.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:35.245 --rc genhtml_branch_coverage=1 00:19:35.245 --rc genhtml_function_coverage=1 00:19:35.245 --rc genhtml_legend=1 00:19:35.245 --rc geninfo_all_blocks=1 00:19:35.245 --rc geninfo_unexecuted_blocks=1 00:19:35.245 00:19:35.245 ' 00:19:35.245 03:14:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:35.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:35.245 --rc genhtml_branch_coverage=1 00:19:35.245 --rc genhtml_function_coverage=1 00:19:35.245 --rc genhtml_legend=1 00:19:35.245 --rc geninfo_all_blocks=1 00:19:35.245 --rc geninfo_unexecuted_blocks=1 00:19:35.245 00:19:35.245 ' 00:19:35.245 03:14:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:35.245 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:35.245 --rc genhtml_branch_coverage=1 00:19:35.245 --rc genhtml_function_coverage=1 00:19:35.245 --rc genhtml_legend=1 00:19:35.245 --rc geninfo_all_blocks=1 00:19:35.245 --rc geninfo_unexecuted_blocks=1 00:19:35.245 00:19:35.245 ' 00:19:35.245 03:14:37 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:35.245 03:14:37 -- nvmf/common.sh@7 -- # uname -s 00:19:35.245 03:14:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:35.245 03:14:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:35.245 03:14:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:35.245 03:14:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:35.245 03:14:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:35.245 03:14:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:35.245 03:14:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:35.245 03:14:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:35.245 03:14:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:35.245 03:14:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:35.245 03:14:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:35.245 03:14:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:35.245 03:14:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:35.245 03:14:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:35.245 03:14:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:35.245 03:14:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:35.245 03:14:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:35.245 03:14:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:35.245 03:14:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:35.245 03:14:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:35.245 03:14:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:35.246 03:14:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:35.246 03:14:37 -- paths/export.sh@5 -- # export PATH 00:19:35.246 03:14:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:35.246 03:14:37 -- nvmf/common.sh@46 -- # : 0 00:19:35.246 03:14:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:35.246 03:14:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:35.246 03:14:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:35.246 03:14:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:35.246 03:14:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:35.246 03:14:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:35.246 03:14:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:35.246 03:14:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:35.246 03:14:37 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:35.246 03:14:37 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:35.246 03:14:37 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:35.246 03:14:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:35.246 03:14:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:35.246 03:14:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:35.246 03:14:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:35.246 03:14:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:35.246 03:14:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:35.246 03:14:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:35.246 03:14:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:35.246 03:14:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:35.246 03:14:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:35.246 03:14:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:35.246 03:14:37 -- common/autotest_common.sh@10 -- # set +x 00:19:37.150 03:14:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:37.150 03:14:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:37.150 03:14:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:37.150 03:14:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:37.150 03:14:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:37.150 03:14:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:37.150 03:14:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:37.150 03:14:39 -- nvmf/common.sh@294 -- # net_devs=() 00:19:37.150 03:14:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:37.150 03:14:39 -- nvmf/common.sh@295 -- # e810=() 00:19:37.150 03:14:39 -- nvmf/common.sh@295 -- # local -ga e810 00:19:37.150 03:14:39 -- nvmf/common.sh@296 -- # x722=() 00:19:37.150 03:14:39 -- nvmf/common.sh@296 -- # local -ga x722 00:19:37.150 03:14:39 -- nvmf/common.sh@297 -- # mlx=() 00:19:37.150 03:14:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:37.150 03:14:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:37.150 03:14:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:37.150 03:14:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:37.150 03:14:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:37.150 03:14:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:37.150 03:14:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:37.150 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:37.150 03:14:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:37.150 03:14:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:37.150 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:37.150 03:14:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:37.150 03:14:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:37.150 03:14:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:37.150 03:14:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:37.150 03:14:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:37.150 03:14:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:37.150 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:37.150 03:14:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:37.150 03:14:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:37.150 03:14:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:37.150 03:14:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:37.150 03:14:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:37.150 03:14:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:37.150 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:37.150 03:14:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:37.150 03:14:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:37.150 03:14:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:37.150 03:14:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:37.150 03:14:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:37.150 03:14:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:37.150 03:14:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:37.150 03:14:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:37.150 03:14:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:37.150 03:14:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:37.150 03:14:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:37.150 03:14:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:37.150 03:14:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:37.150 03:14:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:37.150 03:14:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:37.150 03:14:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:37.150 03:14:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:37.150 03:14:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:37.150 03:14:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:37.150 03:14:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:37.150 03:14:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:37.150 03:14:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:37.150 03:14:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:37.150 03:14:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:37.150 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:37.150 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.183 ms 00:19:37.150 00:19:37.150 --- 10.0.0.2 ping statistics --- 00:19:37.150 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:37.150 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:19:37.150 03:14:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:37.150 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:37.150 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:19:37.150 00:19:37.150 --- 10.0.0.1 ping statistics --- 00:19:37.150 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:37.150 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:19:37.150 03:14:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:37.150 03:14:39 -- nvmf/common.sh@410 -- # return 0 00:19:37.150 03:14:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:37.150 03:14:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:37.150 03:14:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:37.150 03:14:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:37.150 03:14:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:37.150 03:14:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:37.150 03:14:39 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:37.150 03:14:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:37.151 03:14:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:37.151 03:14:39 -- common/autotest_common.sh@10 -- # set +x 00:19:37.151 03:14:39 -- nvmf/common.sh@469 -- # nvmfpid=2477527 00:19:37.151 03:14:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:37.151 03:14:39 -- nvmf/common.sh@470 -- # waitforlisten 2477527 00:19:37.151 03:14:39 -- common/autotest_common.sh@829 -- # '[' -z 2477527 ']' 00:19:37.151 03:14:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:37.151 03:14:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:37.151 03:14:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:37.151 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:37.151 03:14:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:37.151 03:14:39 -- common/autotest_common.sh@10 -- # set +x 00:19:37.151 [2024-11-27 03:14:39.627342] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:37.151 [2024-11-27 03:14:39.627426] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:37.151 [2024-11-27 03:14:39.698365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:37.410 [2024-11-27 03:14:39.789836] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:37.410 [2024-11-27 03:14:39.790011] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:37.410 [2024-11-27 03:14:39.790031] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:37.410 [2024-11-27 03:14:39.790046] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:37.410 [2024-11-27 03:14:39.790132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:37.410 [2024-11-27 03:14:39.790189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:37.410 [2024-11-27 03:14:39.790223] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:37.410 [2024-11-27 03:14:39.790225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:38.346 03:14:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:38.346 03:14:40 -- common/autotest_common.sh@862 -- # return 0 00:19:38.346 03:14:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:38.346 03:14:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:38.346 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:19:38.346 03:14:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:38.346 03:14:40 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:38.346 03:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:38.346 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:19:38.346 [2024-11-27 03:14:40.645840] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:38.346 03:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:38.346 03:14:40 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:38.346 03:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:38.346 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:19:38.346 Malloc0 00:19:38.346 03:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:38.346 03:14:40 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:38.346 03:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:38.346 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:19:38.346 03:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:38.346 03:14:40 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:38.346 03:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:38.346 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:19:38.346 03:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:38.346 03:14:40 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:38.347 03:14:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:38.347 03:14:40 -- common/autotest_common.sh@10 -- # set +x 00:19:38.347 [2024-11-27 03:14:40.683777] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:38.347 03:14:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:38.347 03:14:40 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:38.347 03:14:40 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:38.347 03:14:40 -- nvmf/common.sh@520 -- # config=() 00:19:38.347 03:14:40 -- nvmf/common.sh@520 -- # local subsystem config 00:19:38.347 03:14:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:38.347 03:14:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:38.347 { 00:19:38.347 "params": { 00:19:38.347 "name": "Nvme$subsystem", 00:19:38.347 "trtype": "$TEST_TRANSPORT", 00:19:38.347 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:38.347 "adrfam": "ipv4", 00:19:38.347 "trsvcid": "$NVMF_PORT", 00:19:38.347 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:38.347 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:38.347 "hdgst": ${hdgst:-false}, 00:19:38.347 "ddgst": ${ddgst:-false} 00:19:38.347 }, 00:19:38.347 "method": "bdev_nvme_attach_controller" 00:19:38.347 } 00:19:38.347 EOF 00:19:38.347 )") 00:19:38.347 03:14:40 -- nvmf/common.sh@542 -- # cat 00:19:38.347 03:14:40 -- nvmf/common.sh@544 -- # jq . 00:19:38.347 03:14:40 -- nvmf/common.sh@545 -- # IFS=, 00:19:38.347 03:14:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:38.347 "params": { 00:19:38.347 "name": "Nvme1", 00:19:38.347 "trtype": "tcp", 00:19:38.347 "traddr": "10.0.0.2", 00:19:38.347 "adrfam": "ipv4", 00:19:38.347 "trsvcid": "4420", 00:19:38.347 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:38.347 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:38.347 "hdgst": false, 00:19:38.347 "ddgst": false 00:19:38.347 }, 00:19:38.347 "method": "bdev_nvme_attach_controller" 00:19:38.347 }' 00:19:38.347 [2024-11-27 03:14:40.724546] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:38.347 [2024-11-27 03:14:40.724622] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2477686 ] 00:19:38.347 [2024-11-27 03:14:40.785604] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:38.347 [2024-11-27 03:14:40.868906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:38.347 [2024-11-27 03:14:40.868960] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:38.347 [2024-11-27 03:14:40.868964] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:38.606 [2024-11-27 03:14:41.177605] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:38.606 [2024-11-27 03:14:41.177658] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:38.606 I/O targets: 00:19:38.606 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:38.606 00:19:38.606 00:19:38.606 CUnit - A unit testing framework for C - Version 2.1-3 00:19:38.606 http://cunit.sourceforge.net/ 00:19:38.606 00:19:38.606 00:19:38.606 Suite: bdevio tests on: Nvme1n1 00:19:38.866 Test: blockdev write read block ...passed 00:19:38.866 Test: blockdev write zeroes read block ...passed 00:19:38.866 Test: blockdev write zeroes read no split ...passed 00:19:38.866 Test: blockdev write zeroes read split ...passed 00:19:38.866 Test: blockdev write zeroes read split partial ...passed 00:19:38.866 Test: blockdev reset ...[2024-11-27 03:14:41.383923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:38.866 [2024-11-27 03:14:41.384028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x745150 (9): Bad file descriptor 00:19:38.866 [2024-11-27 03:14:41.398505] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:38.866 passed 00:19:38.866 Test: blockdev write read 8 blocks ...passed 00:19:38.866 Test: blockdev write read size > 128k ...passed 00:19:38.866 Test: blockdev write read invalid size ...passed 00:19:39.125 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:39.125 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:39.125 Test: blockdev write read max offset ...passed 00:19:39.125 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:39.125 Test: blockdev writev readv 8 blocks ...passed 00:19:39.125 Test: blockdev writev readv 30 x 1block ...passed 00:19:39.125 Test: blockdev writev readv block ...passed 00:19:39.125 Test: blockdev writev readv size > 128k ...passed 00:19:39.125 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:39.125 Test: blockdev comparev and writev ...[2024-11-27 03:14:41.655893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.125 [2024-11-27 03:14:41.655929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:39.125 [2024-11-27 03:14:41.655954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.125 [2024-11-27 03:14:41.655971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:39.125 [2024-11-27 03:14:41.656310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.125 [2024-11-27 03:14:41.656333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:39.125 [2024-11-27 03:14:41.656355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.125 [2024-11-27 03:14:41.656371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:39.125 [2024-11-27 03:14:41.656679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.125 [2024-11-27 03:14:41.656703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:39.125 [2024-11-27 03:14:41.656724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.125 [2024-11-27 03:14:41.656740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:39.125 [2024-11-27 03:14:41.657073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.125 [2024-11-27 03:14:41.657104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:39.125 [2024-11-27 03:14:41.657126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:39.125 [2024-11-27 03:14:41.657141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:39.125 passed 00:19:39.125 Test: blockdev nvme passthru rw ...passed 00:19:39.126 Test: blockdev nvme passthru vendor specific ...[2024-11-27 03:14:41.739754] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:39.126 [2024-11-27 03:14:41.739782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:39.126 [2024-11-27 03:14:41.739922] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:39.126 [2024-11-27 03:14:41.739944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:39.126 [2024-11-27 03:14:41.740093] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:39.126 [2024-11-27 03:14:41.740116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:39.126 [2024-11-27 03:14:41.740252] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:39.126 [2024-11-27 03:14:41.740274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:39.126 passed 00:19:39.385 Test: blockdev nvme admin passthru ...passed 00:19:39.385 Test: blockdev copy ...passed 00:19:39.385 00:19:39.385 Run Summary: Type Total Ran Passed Failed Inactive 00:19:39.385 suites 1 1 n/a 0 0 00:19:39.385 tests 23 23 23 0 0 00:19:39.385 asserts 152 152 152 0 n/a 00:19:39.385 00:19:39.385 Elapsed time = 1.238 seconds 00:19:39.644 03:14:42 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:39.644 03:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:39.644 03:14:42 -- common/autotest_common.sh@10 -- # set +x 00:19:39.644 03:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:39.644 03:14:42 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:39.644 03:14:42 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:39.644 03:14:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:39.644 03:14:42 -- nvmf/common.sh@116 -- # sync 00:19:39.644 03:14:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:39.644 03:14:42 -- nvmf/common.sh@119 -- # set +e 00:19:39.644 03:14:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:39.644 03:14:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:39.644 rmmod nvme_tcp 00:19:39.644 rmmod nvme_fabrics 00:19:39.644 rmmod nvme_keyring 00:19:39.644 03:14:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:39.644 03:14:42 -- nvmf/common.sh@123 -- # set -e 00:19:39.644 03:14:42 -- nvmf/common.sh@124 -- # return 0 00:19:39.644 03:14:42 -- nvmf/common.sh@477 -- # '[' -n 2477527 ']' 00:19:39.644 03:14:42 -- nvmf/common.sh@478 -- # killprocess 2477527 00:19:39.644 03:14:42 -- common/autotest_common.sh@936 -- # '[' -z 2477527 ']' 00:19:39.644 03:14:42 -- common/autotest_common.sh@940 -- # kill -0 2477527 00:19:39.644 03:14:42 -- common/autotest_common.sh@941 -- # uname 00:19:39.644 03:14:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:39.644 03:14:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2477527 00:19:39.902 03:14:42 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:39.902 03:14:42 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:39.902 03:14:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2477527' 00:19:39.902 killing process with pid 2477527 00:19:39.902 03:14:42 -- common/autotest_common.sh@955 -- # kill 2477527 00:19:39.902 03:14:42 -- common/autotest_common.sh@960 -- # wait 2477527 00:19:40.161 03:14:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:40.161 03:14:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:40.161 03:14:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:40.162 03:14:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:40.162 03:14:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:40.162 03:14:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:40.162 03:14:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:40.162 03:14:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:42.073 03:14:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:42.073 00:19:42.073 real 0m7.380s 00:19:42.073 user 0m14.580s 00:19:42.073 sys 0m2.551s 00:19:42.073 03:14:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:42.073 03:14:44 -- common/autotest_common.sh@10 -- # set +x 00:19:42.073 ************************************ 00:19:42.073 END TEST nvmf_bdevio_no_huge 00:19:42.073 ************************************ 00:19:42.339 03:14:44 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:42.339 03:14:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:42.339 03:14:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:42.339 03:14:44 -- common/autotest_common.sh@10 -- # set +x 00:19:42.339 ************************************ 00:19:42.339 START TEST nvmf_tls 00:19:42.339 ************************************ 00:19:42.339 03:14:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:19:42.339 * Looking for test storage... 00:19:42.339 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:42.339 03:14:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:42.339 03:14:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:42.339 03:14:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:42.339 03:14:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:42.339 03:14:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:42.339 03:14:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:42.339 03:14:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:42.339 03:14:44 -- scripts/common.sh@335 -- # IFS=.-: 00:19:42.339 03:14:44 -- scripts/common.sh@335 -- # read -ra ver1 00:19:42.339 03:14:44 -- scripts/common.sh@336 -- # IFS=.-: 00:19:42.339 03:14:44 -- scripts/common.sh@336 -- # read -ra ver2 00:19:42.339 03:14:44 -- scripts/common.sh@337 -- # local 'op=<' 00:19:42.339 03:14:44 -- scripts/common.sh@339 -- # ver1_l=2 00:19:42.339 03:14:44 -- scripts/common.sh@340 -- # ver2_l=1 00:19:42.339 03:14:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:42.339 03:14:44 -- scripts/common.sh@343 -- # case "$op" in 00:19:42.339 03:14:44 -- scripts/common.sh@344 -- # : 1 00:19:42.339 03:14:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:42.339 03:14:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:42.339 03:14:44 -- scripts/common.sh@364 -- # decimal 1 00:19:42.339 03:14:44 -- scripts/common.sh@352 -- # local d=1 00:19:42.339 03:14:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:42.339 03:14:44 -- scripts/common.sh@354 -- # echo 1 00:19:42.339 03:14:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:42.339 03:14:44 -- scripts/common.sh@365 -- # decimal 2 00:19:42.339 03:14:44 -- scripts/common.sh@352 -- # local d=2 00:19:42.339 03:14:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:42.339 03:14:44 -- scripts/common.sh@354 -- # echo 2 00:19:42.339 03:14:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:42.339 03:14:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:42.339 03:14:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:42.339 03:14:44 -- scripts/common.sh@367 -- # return 0 00:19:42.339 03:14:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:42.339 03:14:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:42.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:42.339 --rc genhtml_branch_coverage=1 00:19:42.339 --rc genhtml_function_coverage=1 00:19:42.339 --rc genhtml_legend=1 00:19:42.339 --rc geninfo_all_blocks=1 00:19:42.339 --rc geninfo_unexecuted_blocks=1 00:19:42.339 00:19:42.339 ' 00:19:42.339 03:14:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:42.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:42.339 --rc genhtml_branch_coverage=1 00:19:42.339 --rc genhtml_function_coverage=1 00:19:42.339 --rc genhtml_legend=1 00:19:42.339 --rc geninfo_all_blocks=1 00:19:42.339 --rc geninfo_unexecuted_blocks=1 00:19:42.339 00:19:42.339 ' 00:19:42.339 03:14:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:42.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:42.339 --rc genhtml_branch_coverage=1 00:19:42.339 --rc genhtml_function_coverage=1 00:19:42.339 --rc genhtml_legend=1 00:19:42.339 --rc geninfo_all_blocks=1 00:19:42.339 --rc geninfo_unexecuted_blocks=1 00:19:42.339 00:19:42.339 ' 00:19:42.339 03:14:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:42.339 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:42.339 --rc genhtml_branch_coverage=1 00:19:42.339 --rc genhtml_function_coverage=1 00:19:42.339 --rc genhtml_legend=1 00:19:42.339 --rc geninfo_all_blocks=1 00:19:42.339 --rc geninfo_unexecuted_blocks=1 00:19:42.339 00:19:42.339 ' 00:19:42.339 03:14:44 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:42.339 03:14:44 -- nvmf/common.sh@7 -- # uname -s 00:19:42.339 03:14:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:42.339 03:14:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:42.339 03:14:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:42.339 03:14:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:42.339 03:14:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:42.339 03:14:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:42.339 03:14:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:42.339 03:14:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:42.339 03:14:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:42.339 03:14:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:42.339 03:14:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:42.339 03:14:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:42.339 03:14:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:42.339 03:14:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:42.339 03:14:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:42.339 03:14:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:42.339 03:14:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:42.339 03:14:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:42.339 03:14:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:42.339 03:14:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:42.339 03:14:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:42.339 03:14:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:42.339 03:14:44 -- paths/export.sh@5 -- # export PATH 00:19:42.339 03:14:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:42.339 03:14:44 -- nvmf/common.sh@46 -- # : 0 00:19:42.339 03:14:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:42.339 03:14:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:42.339 03:14:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:42.339 03:14:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:42.339 03:14:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:42.339 03:14:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:42.339 03:14:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:42.339 03:14:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:42.339 03:14:44 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:42.339 03:14:44 -- target/tls.sh@71 -- # nvmftestinit 00:19:42.339 03:14:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:42.339 03:14:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:42.339 03:14:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:42.339 03:14:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:42.339 03:14:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:42.339 03:14:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:42.339 03:14:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:42.339 03:14:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:42.339 03:14:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:42.339 03:14:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:42.339 03:14:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:42.339 03:14:44 -- common/autotest_common.sh@10 -- # set +x 00:19:44.246 03:14:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:44.246 03:14:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:44.246 03:14:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:44.246 03:14:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:44.246 03:14:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:44.246 03:14:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:44.246 03:14:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:44.246 03:14:46 -- nvmf/common.sh@294 -- # net_devs=() 00:19:44.246 03:14:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:44.246 03:14:46 -- nvmf/common.sh@295 -- # e810=() 00:19:44.246 03:14:46 -- nvmf/common.sh@295 -- # local -ga e810 00:19:44.246 03:14:46 -- nvmf/common.sh@296 -- # x722=() 00:19:44.246 03:14:46 -- nvmf/common.sh@296 -- # local -ga x722 00:19:44.246 03:14:46 -- nvmf/common.sh@297 -- # mlx=() 00:19:44.246 03:14:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:44.246 03:14:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:44.246 03:14:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:44.246 03:14:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:44.246 03:14:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:44.246 03:14:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:44.246 03:14:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:44.246 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:44.246 03:14:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:44.246 03:14:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:44.246 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:44.246 03:14:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:44.246 03:14:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:44.246 03:14:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:44.247 03:14:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:44.247 03:14:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:44.247 03:14:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:44.247 03:14:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:44.247 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:44.247 03:14:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:44.247 03:14:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:44.247 03:14:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:44.247 03:14:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:44.247 03:14:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:44.247 03:14:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:44.247 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:44.247 03:14:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:44.247 03:14:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:44.247 03:14:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:44.247 03:14:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:44.247 03:14:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:44.247 03:14:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:44.247 03:14:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:44.247 03:14:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:44.247 03:14:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:44.247 03:14:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:44.247 03:14:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:44.247 03:14:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:44.247 03:14:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:44.247 03:14:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:44.247 03:14:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:44.247 03:14:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:44.247 03:14:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:44.247 03:14:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:44.247 03:14:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:44.505 03:14:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:44.505 03:14:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:44.505 03:14:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:44.505 03:14:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:44.505 03:14:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:44.505 03:14:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:44.505 03:14:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:44.505 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:44.505 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.313 ms 00:19:44.505 00:19:44.505 --- 10.0.0.2 ping statistics --- 00:19:44.505 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:44.505 rtt min/avg/max/mdev = 0.313/0.313/0.313/0.000 ms 00:19:44.505 03:14:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:44.505 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:44.505 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:19:44.505 00:19:44.505 --- 10.0.0.1 ping statistics --- 00:19:44.505 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:44.505 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:19:44.505 03:14:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:44.505 03:14:46 -- nvmf/common.sh@410 -- # return 0 00:19:44.505 03:14:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:44.505 03:14:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:44.505 03:14:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:44.505 03:14:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:44.505 03:14:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:44.505 03:14:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:44.505 03:14:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:44.505 03:14:46 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:19:44.505 03:14:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:44.505 03:14:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:44.505 03:14:46 -- common/autotest_common.sh@10 -- # set +x 00:19:44.505 03:14:46 -- nvmf/common.sh@469 -- # nvmfpid=2479896 00:19:44.505 03:14:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:19:44.505 03:14:46 -- nvmf/common.sh@470 -- # waitforlisten 2479896 00:19:44.505 03:14:46 -- common/autotest_common.sh@829 -- # '[' -z 2479896 ']' 00:19:44.505 03:14:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:44.505 03:14:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:44.505 03:14:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:44.505 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:44.505 03:14:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:44.505 03:14:46 -- common/autotest_common.sh@10 -- # set +x 00:19:44.505 [2024-11-27 03:14:47.027859] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:44.505 [2024-11-27 03:14:47.027925] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:44.505 EAL: No free 2048 kB hugepages reported on node 1 00:19:44.505 [2024-11-27 03:14:47.098017] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:44.764 [2024-11-27 03:14:47.186685] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:44.764 [2024-11-27 03:14:47.186860] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:44.764 [2024-11-27 03:14:47.186877] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:44.764 [2024-11-27 03:14:47.186889] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:44.764 [2024-11-27 03:14:47.186943] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:44.764 03:14:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:44.764 03:14:47 -- common/autotest_common.sh@862 -- # return 0 00:19:44.764 03:14:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:44.764 03:14:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:44.764 03:14:47 -- common/autotest_common.sh@10 -- # set +x 00:19:44.764 03:14:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:44.764 03:14:47 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:19:44.764 03:14:47 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:19:45.024 true 00:19:45.024 03:14:47 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:45.024 03:14:47 -- target/tls.sh@82 -- # jq -r .tls_version 00:19:45.282 03:14:47 -- target/tls.sh@82 -- # version=0 00:19:45.282 03:14:47 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:19:45.283 03:14:47 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:45.542 03:14:48 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:45.542 03:14:48 -- target/tls.sh@90 -- # jq -r .tls_version 00:19:45.801 03:14:48 -- target/tls.sh@90 -- # version=13 00:19:45.801 03:14:48 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:19:45.801 03:14:48 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:19:46.059 03:14:48 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:46.059 03:14:48 -- target/tls.sh@98 -- # jq -r .tls_version 00:19:46.318 03:14:48 -- target/tls.sh@98 -- # version=7 00:19:46.318 03:14:48 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:19:46.318 03:14:48 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:46.318 03:14:48 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:19:46.579 03:14:49 -- target/tls.sh@105 -- # ktls=false 00:19:46.579 03:14:49 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:19:46.579 03:14:49 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:19:46.838 03:14:49 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:46.838 03:14:49 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:19:47.097 03:14:49 -- target/tls.sh@113 -- # ktls=true 00:19:47.097 03:14:49 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:19:47.097 03:14:49 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:19:47.355 03:14:49 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:19:47.355 03:14:49 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:19:47.613 03:14:50 -- target/tls.sh@121 -- # ktls=false 00:19:47.613 03:14:50 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:19:47.613 03:14:50 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:19:47.613 03:14:50 -- target/tls.sh@49 -- # local key hash crc 00:19:47.613 03:14:50 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:19:47.613 03:14:50 -- target/tls.sh@51 -- # hash=01 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # gzip -1 -c 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # tail -c8 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # head -c 4 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # crc='p$H�' 00:19:47.613 03:14:50 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:47.613 03:14:50 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:19:47.613 03:14:50 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:47.613 03:14:50 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:47.613 03:14:50 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:19:47.613 03:14:50 -- target/tls.sh@49 -- # local key hash crc 00:19:47.613 03:14:50 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:19:47.613 03:14:50 -- target/tls.sh@51 -- # hash=01 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # gzip -1 -c 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # tail -c8 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # head -c 4 00:19:47.613 03:14:50 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:19:47.613 03:14:50 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:47.613 03:14:50 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:19:47.613 03:14:50 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:47.613 03:14:50 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:47.613 03:14:50 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:47.613 03:14:50 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:47.613 03:14:50 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:19:47.613 03:14:50 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:19:47.613 03:14:50 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:47.613 03:14:50 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:19:47.613 03:14:50 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:19:47.871 03:14:50 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:19:48.131 03:14:50 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:48.131 03:14:50 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:48.131 03:14:50 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:48.391 [2024-11-27 03:14:50.983837] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:48.391 03:14:50 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:48.650 03:14:51 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:48.908 [2024-11-27 03:14:51.489208] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:48.908 [2024-11-27 03:14:51.489495] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:48.908 03:14:51 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:49.166 malloc0 00:19:49.166 03:14:51 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:49.423 03:14:52 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:49.682 03:14:52 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:49.942 EAL: No free 2048 kB hugepages reported on node 1 00:19:59.928 Initializing NVMe Controllers 00:19:59.928 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:59.928 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:59.928 Initialization complete. Launching workers. 00:19:59.928 ======================================================== 00:19:59.928 Latency(us) 00:19:59.928 Device Information : IOPS MiB/s Average min max 00:19:59.928 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7806.45 30.49 8200.89 1305.74 12616.91 00:19:59.928 ======================================================== 00:19:59.928 Total : 7806.45 30.49 8200.89 1305.74 12616.91 00:19:59.928 00:19:59.928 03:15:02 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:59.928 03:15:02 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:59.928 03:15:02 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:59.928 03:15:02 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:59.928 03:15:02 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:19:59.928 03:15:02 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:59.928 03:15:02 -- target/tls.sh@28 -- # bdevperf_pid=2481844 00:19:59.928 03:15:02 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:59.928 03:15:02 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:59.928 03:15:02 -- target/tls.sh@31 -- # waitforlisten 2481844 /var/tmp/bdevperf.sock 00:19:59.928 03:15:02 -- common/autotest_common.sh@829 -- # '[' -z 2481844 ']' 00:19:59.928 03:15:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:59.928 03:15:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:59.929 03:15:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:59.929 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:59.929 03:15:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:59.929 03:15:02 -- common/autotest_common.sh@10 -- # set +x 00:19:59.929 [2024-11-27 03:15:02.421578] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:59.929 [2024-11-27 03:15:02.421661] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2481844 ] 00:19:59.929 EAL: No free 2048 kB hugepages reported on node 1 00:19:59.929 [2024-11-27 03:15:02.481718] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:00.187 [2024-11-27 03:15:02.565122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:01.133 03:15:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:01.133 03:15:03 -- common/autotest_common.sh@862 -- # return 0 00:20:01.133 03:15:03 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:01.133 [2024-11-27 03:15:03.624168] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:01.133 TLSTESTn1 00:20:01.133 03:15:03 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:01.435 Running I/O for 10 seconds... 00:20:11.419 00:20:11.419 Latency(us) 00:20:11.419 [2024-11-27T02:15:14.038Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:11.419 [2024-11-27T02:15:14.038Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:11.419 Verification LBA range: start 0x0 length 0x2000 00:20:11.419 TLSTESTn1 : 10.01 4501.49 17.58 0.00 0.00 28396.84 4029.25 46603.38 00:20:11.419 [2024-11-27T02:15:14.038Z] =================================================================================================================== 00:20:11.419 [2024-11-27T02:15:14.038Z] Total : 4501.49 17.58 0.00 0.00 28396.84 4029.25 46603.38 00:20:11.419 0 00:20:11.419 03:15:13 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:11.419 03:15:13 -- target/tls.sh@45 -- # killprocess 2481844 00:20:11.419 03:15:13 -- common/autotest_common.sh@936 -- # '[' -z 2481844 ']' 00:20:11.419 03:15:13 -- common/autotest_common.sh@940 -- # kill -0 2481844 00:20:11.419 03:15:13 -- common/autotest_common.sh@941 -- # uname 00:20:11.419 03:15:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:11.419 03:15:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2481844 00:20:11.419 03:15:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:11.419 03:15:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:11.419 03:15:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2481844' 00:20:11.419 killing process with pid 2481844 00:20:11.419 03:15:13 -- common/autotest_common.sh@955 -- # kill 2481844 00:20:11.419 Received shutdown signal, test time was about 10.000000 seconds 00:20:11.419 00:20:11.419 Latency(us) 00:20:11.419 [2024-11-27T02:15:14.038Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:11.419 [2024-11-27T02:15:14.038Z] =================================================================================================================== 00:20:11.419 [2024-11-27T02:15:14.038Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:11.419 03:15:13 -- common/autotest_common.sh@960 -- # wait 2481844 00:20:11.678 03:15:14 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:11.678 03:15:14 -- common/autotest_common.sh@650 -- # local es=0 00:20:11.678 03:15:14 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:11.678 03:15:14 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:11.678 03:15:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:11.678 03:15:14 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:11.678 03:15:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:11.678 03:15:14 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:11.678 03:15:14 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:11.678 03:15:14 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:11.678 03:15:14 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:11.678 03:15:14 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:11.678 03:15:14 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:11.678 03:15:14 -- target/tls.sh@28 -- # bdevperf_pid=2483840 00:20:11.678 03:15:14 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:11.678 03:15:14 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:11.678 03:15:14 -- target/tls.sh@31 -- # waitforlisten 2483840 /var/tmp/bdevperf.sock 00:20:11.678 03:15:14 -- common/autotest_common.sh@829 -- # '[' -z 2483840 ']' 00:20:11.678 03:15:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:11.678 03:15:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:11.678 03:15:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:11.678 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:11.678 03:15:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:11.678 03:15:14 -- common/autotest_common.sh@10 -- # set +x 00:20:11.678 [2024-11-27 03:15:14.171454] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:11.678 [2024-11-27 03:15:14.171545] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2483840 ] 00:20:11.678 EAL: No free 2048 kB hugepages reported on node 1 00:20:11.678 [2024-11-27 03:15:14.231590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:11.938 [2024-11-27 03:15:14.316760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:12.878 03:15:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:12.878 03:15:15 -- common/autotest_common.sh@862 -- # return 0 00:20:12.878 03:15:15 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:12.878 [2024-11-27 03:15:15.400340] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:12.878 [2024-11-27 03:15:15.406406] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:12.878 [2024-11-27 03:15:15.407076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x255dcf0 (107): Transport endpoint is not connected 00:20:12.878 [2024-11-27 03:15:15.408062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x255dcf0 (9): Bad file descriptor 00:20:12.878 [2024-11-27 03:15:15.409061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:12.878 [2024-11-27 03:15:15.409081] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:12.878 [2024-11-27 03:15:15.409108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:12.878 request: 00:20:12.878 { 00:20:12.878 "name": "TLSTEST", 00:20:12.878 "trtype": "tcp", 00:20:12.878 "traddr": "10.0.0.2", 00:20:12.878 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:12.878 "adrfam": "ipv4", 00:20:12.878 "trsvcid": "4420", 00:20:12.878 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:12.878 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:12.878 "method": "bdev_nvme_attach_controller", 00:20:12.878 "req_id": 1 00:20:12.878 } 00:20:12.878 Got JSON-RPC error response 00:20:12.878 response: 00:20:12.878 { 00:20:12.878 "code": -32602, 00:20:12.878 "message": "Invalid parameters" 00:20:12.878 } 00:20:12.878 03:15:15 -- target/tls.sh@36 -- # killprocess 2483840 00:20:12.878 03:15:15 -- common/autotest_common.sh@936 -- # '[' -z 2483840 ']' 00:20:12.878 03:15:15 -- common/autotest_common.sh@940 -- # kill -0 2483840 00:20:12.878 03:15:15 -- common/autotest_common.sh@941 -- # uname 00:20:12.878 03:15:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:12.878 03:15:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2483840 00:20:12.878 03:15:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:12.878 03:15:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:12.878 03:15:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2483840' 00:20:12.878 killing process with pid 2483840 00:20:12.878 03:15:15 -- common/autotest_common.sh@955 -- # kill 2483840 00:20:12.878 Received shutdown signal, test time was about 10.000000 seconds 00:20:12.878 00:20:12.878 Latency(us) 00:20:12.878 [2024-11-27T02:15:15.497Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:12.878 [2024-11-27T02:15:15.497Z] =================================================================================================================== 00:20:12.878 [2024-11-27T02:15:15.497Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:12.878 03:15:15 -- common/autotest_common.sh@960 -- # wait 2483840 00:20:13.137 03:15:15 -- target/tls.sh@37 -- # return 1 00:20:13.137 03:15:15 -- common/autotest_common.sh@653 -- # es=1 00:20:13.137 03:15:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:13.137 03:15:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:13.137 03:15:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:13.137 03:15:15 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:13.137 03:15:15 -- common/autotest_common.sh@650 -- # local es=0 00:20:13.137 03:15:15 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:13.137 03:15:15 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:13.137 03:15:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:13.137 03:15:15 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:13.137 03:15:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:13.137 03:15:15 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:13.137 03:15:15 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:13.137 03:15:15 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:13.137 03:15:15 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:13.137 03:15:15 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:13.137 03:15:15 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:13.137 03:15:15 -- target/tls.sh@28 -- # bdevperf_pid=2483992 00:20:13.137 03:15:15 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:13.137 03:15:15 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:13.137 03:15:15 -- target/tls.sh@31 -- # waitforlisten 2483992 /var/tmp/bdevperf.sock 00:20:13.137 03:15:15 -- common/autotest_common.sh@829 -- # '[' -z 2483992 ']' 00:20:13.137 03:15:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:13.137 03:15:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:13.137 03:15:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:13.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:13.137 03:15:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:13.137 03:15:15 -- common/autotest_common.sh@10 -- # set +x 00:20:13.137 [2024-11-27 03:15:15.736205] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:13.137 [2024-11-27 03:15:15.736283] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2483992 ] 00:20:13.397 EAL: No free 2048 kB hugepages reported on node 1 00:20:13.397 [2024-11-27 03:15:15.793881] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:13.397 [2024-11-27 03:15:15.875009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:14.332 03:15:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:14.332 03:15:16 -- common/autotest_common.sh@862 -- # return 0 00:20:14.332 03:15:16 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:14.592 [2024-11-27 03:15:16.970817] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:14.592 [2024-11-27 03:15:16.980337] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:14.592 [2024-11-27 03:15:16.980366] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:14.592 [2024-11-27 03:15:16.980420] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:14.592 [2024-11-27 03:15:16.980687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ad1cf0 (107): Transport endpoint is not connected 00:20:14.592 [2024-11-27 03:15:16.981678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ad1cf0 (9): Bad file descriptor 00:20:14.592 [2024-11-27 03:15:16.982676] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:14.592 [2024-11-27 03:15:16.982697] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:14.592 [2024-11-27 03:15:16.982711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:14.592 request: 00:20:14.592 { 00:20:14.592 "name": "TLSTEST", 00:20:14.592 "trtype": "tcp", 00:20:14.592 "traddr": "10.0.0.2", 00:20:14.592 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:14.592 "adrfam": "ipv4", 00:20:14.592 "trsvcid": "4420", 00:20:14.592 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:14.592 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:14.592 "method": "bdev_nvme_attach_controller", 00:20:14.592 "req_id": 1 00:20:14.592 } 00:20:14.592 Got JSON-RPC error response 00:20:14.592 response: 00:20:14.592 { 00:20:14.592 "code": -32602, 00:20:14.592 "message": "Invalid parameters" 00:20:14.592 } 00:20:14.592 03:15:17 -- target/tls.sh@36 -- # killprocess 2483992 00:20:14.592 03:15:17 -- common/autotest_common.sh@936 -- # '[' -z 2483992 ']' 00:20:14.592 03:15:17 -- common/autotest_common.sh@940 -- # kill -0 2483992 00:20:14.592 03:15:17 -- common/autotest_common.sh@941 -- # uname 00:20:14.592 03:15:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:14.592 03:15:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2483992 00:20:14.592 03:15:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:14.592 03:15:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:14.592 03:15:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2483992' 00:20:14.592 killing process with pid 2483992 00:20:14.592 03:15:17 -- common/autotest_common.sh@955 -- # kill 2483992 00:20:14.592 Received shutdown signal, test time was about 10.000000 seconds 00:20:14.592 00:20:14.592 Latency(us) 00:20:14.592 [2024-11-27T02:15:17.211Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:14.592 [2024-11-27T02:15:17.211Z] =================================================================================================================== 00:20:14.592 [2024-11-27T02:15:17.211Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:14.592 03:15:17 -- common/autotest_common.sh@960 -- # wait 2483992 00:20:14.852 03:15:17 -- target/tls.sh@37 -- # return 1 00:20:14.852 03:15:17 -- common/autotest_common.sh@653 -- # es=1 00:20:14.852 03:15:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:14.852 03:15:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:14.852 03:15:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:14.852 03:15:17 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:14.852 03:15:17 -- common/autotest_common.sh@650 -- # local es=0 00:20:14.852 03:15:17 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:14.852 03:15:17 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:14.852 03:15:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:14.852 03:15:17 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:14.852 03:15:17 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:14.852 03:15:17 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:14.852 03:15:17 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:14.852 03:15:17 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:14.852 03:15:17 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:14.852 03:15:17 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:14.852 03:15:17 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:14.852 03:15:17 -- target/tls.sh@28 -- # bdevperf_pid=2484144 00:20:14.852 03:15:17 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:14.852 03:15:17 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:14.852 03:15:17 -- target/tls.sh@31 -- # waitforlisten 2484144 /var/tmp/bdevperf.sock 00:20:14.852 03:15:17 -- common/autotest_common.sh@829 -- # '[' -z 2484144 ']' 00:20:14.852 03:15:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:14.852 03:15:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:14.852 03:15:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:14.852 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:14.852 03:15:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:14.852 03:15:17 -- common/autotest_common.sh@10 -- # set +x 00:20:14.852 [2024-11-27 03:15:17.309647] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:14.852 [2024-11-27 03:15:17.309728] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2484144 ] 00:20:14.852 EAL: No free 2048 kB hugepages reported on node 1 00:20:14.852 [2024-11-27 03:15:17.368003] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:14.852 [2024-11-27 03:15:17.450250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:15.787 03:15:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:15.787 03:15:18 -- common/autotest_common.sh@862 -- # return 0 00:20:15.787 03:15:18 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:16.045 [2024-11-27 03:15:18.609696] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:16.045 [2024-11-27 03:15:18.614829] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:16.045 [2024-11-27 03:15:18.614875] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:16.045 [2024-11-27 03:15:18.614912] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:16.045 [2024-11-27 03:15:18.615437] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d3dcf0 (107): Transport endpoint is not connected 00:20:16.045 [2024-11-27 03:15:18.616425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d3dcf0 (9): Bad file descriptor 00:20:16.045 [2024-11-27 03:15:18.617423] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:16.045 [2024-11-27 03:15:18.617441] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:16.045 [2024-11-27 03:15:18.617468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:16.045 request: 00:20:16.045 { 00:20:16.045 "name": "TLSTEST", 00:20:16.045 "trtype": "tcp", 00:20:16.045 "traddr": "10.0.0.2", 00:20:16.045 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:16.045 "adrfam": "ipv4", 00:20:16.045 "trsvcid": "4420", 00:20:16.045 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:16.045 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:16.045 "method": "bdev_nvme_attach_controller", 00:20:16.045 "req_id": 1 00:20:16.045 } 00:20:16.045 Got JSON-RPC error response 00:20:16.045 response: 00:20:16.045 { 00:20:16.045 "code": -32602, 00:20:16.045 "message": "Invalid parameters" 00:20:16.045 } 00:20:16.045 03:15:18 -- target/tls.sh@36 -- # killprocess 2484144 00:20:16.045 03:15:18 -- common/autotest_common.sh@936 -- # '[' -z 2484144 ']' 00:20:16.045 03:15:18 -- common/autotest_common.sh@940 -- # kill -0 2484144 00:20:16.045 03:15:18 -- common/autotest_common.sh@941 -- # uname 00:20:16.045 03:15:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:16.045 03:15:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2484144 00:20:16.303 03:15:18 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:16.303 03:15:18 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:16.303 03:15:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2484144' 00:20:16.303 killing process with pid 2484144 00:20:16.303 03:15:18 -- common/autotest_common.sh@955 -- # kill 2484144 00:20:16.303 Received shutdown signal, test time was about 10.000000 seconds 00:20:16.303 00:20:16.303 Latency(us) 00:20:16.303 [2024-11-27T02:15:18.922Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:16.303 [2024-11-27T02:15:18.922Z] =================================================================================================================== 00:20:16.303 [2024-11-27T02:15:18.922Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:16.303 03:15:18 -- common/autotest_common.sh@960 -- # wait 2484144 00:20:16.303 03:15:18 -- target/tls.sh@37 -- # return 1 00:20:16.303 03:15:18 -- common/autotest_common.sh@653 -- # es=1 00:20:16.303 03:15:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:16.303 03:15:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:16.303 03:15:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:16.303 03:15:18 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:16.303 03:15:18 -- common/autotest_common.sh@650 -- # local es=0 00:20:16.303 03:15:18 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:16.303 03:15:18 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:16.303 03:15:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:16.303 03:15:18 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:16.303 03:15:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:16.303 03:15:18 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:16.303 03:15:18 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:16.303 03:15:18 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:16.303 03:15:18 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:16.303 03:15:18 -- target/tls.sh@23 -- # psk= 00:20:16.303 03:15:18 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:16.303 03:15:18 -- target/tls.sh@28 -- # bdevperf_pid=2484416 00:20:16.303 03:15:18 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:16.303 03:15:18 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:16.303 03:15:18 -- target/tls.sh@31 -- # waitforlisten 2484416 /var/tmp/bdevperf.sock 00:20:16.303 03:15:18 -- common/autotest_common.sh@829 -- # '[' -z 2484416 ']' 00:20:16.303 03:15:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:16.303 03:15:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:16.303 03:15:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:16.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:16.303 03:15:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:16.303 03:15:18 -- common/autotest_common.sh@10 -- # set +x 00:20:16.562 [2024-11-27 03:15:18.934493] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:16.562 [2024-11-27 03:15:18.934581] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2484416 ] 00:20:16.562 EAL: No free 2048 kB hugepages reported on node 1 00:20:16.562 [2024-11-27 03:15:18.993360] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:16.562 [2024-11-27 03:15:19.073679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:17.507 03:15:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:17.507 03:15:19 -- common/autotest_common.sh@862 -- # return 0 00:20:17.507 03:15:19 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:17.767 [2024-11-27 03:15:20.158670] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:17.767 [2024-11-27 03:15:20.160738] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b79720 (9): Bad file descriptor 00:20:17.767 [2024-11-27 03:15:20.161735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:17.767 [2024-11-27 03:15:20.161755] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:17.767 [2024-11-27 03:15:20.161769] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:17.767 request: 00:20:17.767 { 00:20:17.767 "name": "TLSTEST", 00:20:17.767 "trtype": "tcp", 00:20:17.767 "traddr": "10.0.0.2", 00:20:17.767 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:17.767 "adrfam": "ipv4", 00:20:17.767 "trsvcid": "4420", 00:20:17.767 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:17.767 "method": "bdev_nvme_attach_controller", 00:20:17.767 "req_id": 1 00:20:17.767 } 00:20:17.767 Got JSON-RPC error response 00:20:17.767 response: 00:20:17.767 { 00:20:17.767 "code": -32602, 00:20:17.767 "message": "Invalid parameters" 00:20:17.767 } 00:20:17.767 03:15:20 -- target/tls.sh@36 -- # killprocess 2484416 00:20:17.767 03:15:20 -- common/autotest_common.sh@936 -- # '[' -z 2484416 ']' 00:20:17.767 03:15:20 -- common/autotest_common.sh@940 -- # kill -0 2484416 00:20:17.767 03:15:20 -- common/autotest_common.sh@941 -- # uname 00:20:17.767 03:15:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:17.767 03:15:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2484416 00:20:17.767 03:15:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:17.767 03:15:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:17.767 03:15:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2484416' 00:20:17.767 killing process with pid 2484416 00:20:17.767 03:15:20 -- common/autotest_common.sh@955 -- # kill 2484416 00:20:17.767 Received shutdown signal, test time was about 10.000000 seconds 00:20:17.768 00:20:17.768 Latency(us) 00:20:17.768 [2024-11-27T02:15:20.387Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:17.768 [2024-11-27T02:15:20.387Z] =================================================================================================================== 00:20:17.768 [2024-11-27T02:15:20.387Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:17.768 03:15:20 -- common/autotest_common.sh@960 -- # wait 2484416 00:20:18.028 03:15:20 -- target/tls.sh@37 -- # return 1 00:20:18.028 03:15:20 -- common/autotest_common.sh@653 -- # es=1 00:20:18.028 03:15:20 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:18.028 03:15:20 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:18.028 03:15:20 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:18.028 03:15:20 -- target/tls.sh@167 -- # killprocess 2479896 00:20:18.028 03:15:20 -- common/autotest_common.sh@936 -- # '[' -z 2479896 ']' 00:20:18.028 03:15:20 -- common/autotest_common.sh@940 -- # kill -0 2479896 00:20:18.028 03:15:20 -- common/autotest_common.sh@941 -- # uname 00:20:18.028 03:15:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:18.028 03:15:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2479896 00:20:18.028 03:15:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:18.028 03:15:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:18.028 03:15:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2479896' 00:20:18.028 killing process with pid 2479896 00:20:18.028 03:15:20 -- common/autotest_common.sh@955 -- # kill 2479896 00:20:18.028 03:15:20 -- common/autotest_common.sh@960 -- # wait 2479896 00:20:18.287 03:15:20 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:18.287 03:15:20 -- target/tls.sh@49 -- # local key hash crc 00:20:18.287 03:15:20 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:18.287 03:15:20 -- target/tls.sh@51 -- # hash=02 00:20:18.287 03:15:20 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:18.287 03:15:20 -- target/tls.sh@52 -- # gzip -1 -c 00:20:18.287 03:15:20 -- target/tls.sh@52 -- # tail -c8 00:20:18.287 03:15:20 -- target/tls.sh@52 -- # head -c 4 00:20:18.287 03:15:20 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:18.287 03:15:20 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:18.287 03:15:20 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:18.287 03:15:20 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:18.287 03:15:20 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:18.287 03:15:20 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:18.287 03:15:20 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:18.287 03:15:20 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:18.287 03:15:20 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:18.287 03:15:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:18.287 03:15:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:18.287 03:15:20 -- common/autotest_common.sh@10 -- # set +x 00:20:18.287 03:15:20 -- nvmf/common.sh@469 -- # nvmfpid=2484620 00:20:18.287 03:15:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:18.287 03:15:20 -- nvmf/common.sh@470 -- # waitforlisten 2484620 00:20:18.287 03:15:20 -- common/autotest_common.sh@829 -- # '[' -z 2484620 ']' 00:20:18.287 03:15:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:18.287 03:15:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:18.287 03:15:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:18.287 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:18.287 03:15:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:18.287 03:15:20 -- common/autotest_common.sh@10 -- # set +x 00:20:18.287 [2024-11-27 03:15:20.809017] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:18.287 [2024-11-27 03:15:20.809106] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:18.287 EAL: No free 2048 kB hugepages reported on node 1 00:20:18.287 [2024-11-27 03:15:20.875977] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:18.548 [2024-11-27 03:15:20.961402] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:18.548 [2024-11-27 03:15:20.961559] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:18.548 [2024-11-27 03:15:20.961593] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:18.548 [2024-11-27 03:15:20.961607] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:18.548 [2024-11-27 03:15:20.961634] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:19.486 03:15:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:19.486 03:15:21 -- common/autotest_common.sh@862 -- # return 0 00:20:19.486 03:15:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:19.486 03:15:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:19.486 03:15:21 -- common/autotest_common.sh@10 -- # set +x 00:20:19.486 03:15:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:19.486 03:15:21 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:19.486 03:15:21 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:19.486 03:15:21 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:19.745 [2024-11-27 03:15:22.125470] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:19.745 03:15:22 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:20.003 03:15:22 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:20.003 [2024-11-27 03:15:22.618752] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:20.003 [2024-11-27 03:15:22.619003] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:20.261 03:15:22 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:20.261 malloc0 00:20:20.521 03:15:22 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:20.781 03:15:23 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:21.040 03:15:23 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:21.040 03:15:23 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:21.040 03:15:23 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:21.040 03:15:23 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:21.040 03:15:23 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:21.040 03:15:23 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:21.040 03:15:23 -- target/tls.sh@28 -- # bdevperf_pid=2485014 00:20:21.040 03:15:23 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:21.040 03:15:23 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:21.040 03:15:23 -- target/tls.sh@31 -- # waitforlisten 2485014 /var/tmp/bdevperf.sock 00:20:21.040 03:15:23 -- common/autotest_common.sh@829 -- # '[' -z 2485014 ']' 00:20:21.040 03:15:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:21.040 03:15:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:21.040 03:15:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:21.040 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:21.040 03:15:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:21.040 03:15:23 -- common/autotest_common.sh@10 -- # set +x 00:20:21.040 [2024-11-27 03:15:23.446399] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:21.040 [2024-11-27 03:15:23.446470] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2485014 ] 00:20:21.040 EAL: No free 2048 kB hugepages reported on node 1 00:20:21.040 [2024-11-27 03:15:23.503494] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:21.040 [2024-11-27 03:15:23.584545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:21.977 03:15:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:21.977 03:15:24 -- common/autotest_common.sh@862 -- # return 0 00:20:21.977 03:15:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:22.295 [2024-11-27 03:15:24.648937] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:22.295 TLSTESTn1 00:20:22.295 03:15:24 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:22.295 Running I/O for 10 seconds... 00:20:32.280 00:20:32.280 Latency(us) 00:20:32.280 [2024-11-27T02:15:34.899Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:32.280 [2024-11-27T02:15:34.899Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:32.280 Verification LBA range: start 0x0 length 0x2000 00:20:32.280 TLSTESTn1 : 10.02 3907.84 15.26 0.00 0.00 32695.63 7475.96 55147.33 00:20:32.280 [2024-11-27T02:15:34.899Z] =================================================================================================================== 00:20:32.280 [2024-11-27T02:15:34.899Z] Total : 3907.84 15.26 0.00 0.00 32695.63 7475.96 55147.33 00:20:32.280 0 00:20:32.538 03:15:34 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:32.538 03:15:34 -- target/tls.sh@45 -- # killprocess 2485014 00:20:32.538 03:15:34 -- common/autotest_common.sh@936 -- # '[' -z 2485014 ']' 00:20:32.538 03:15:34 -- common/autotest_common.sh@940 -- # kill -0 2485014 00:20:32.539 03:15:34 -- common/autotest_common.sh@941 -- # uname 00:20:32.539 03:15:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:32.539 03:15:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2485014 00:20:32.539 03:15:34 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:32.539 03:15:34 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:32.539 03:15:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2485014' 00:20:32.539 killing process with pid 2485014 00:20:32.539 03:15:34 -- common/autotest_common.sh@955 -- # kill 2485014 00:20:32.539 Received shutdown signal, test time was about 10.000000 seconds 00:20:32.539 00:20:32.539 Latency(us) 00:20:32.539 [2024-11-27T02:15:35.158Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:32.539 [2024-11-27T02:15:35.158Z] =================================================================================================================== 00:20:32.539 [2024-11-27T02:15:35.158Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:32.539 03:15:34 -- common/autotest_common.sh@960 -- # wait 2485014 00:20:32.797 03:15:35 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.797 03:15:35 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.797 03:15:35 -- common/autotest_common.sh@650 -- # local es=0 00:20:32.797 03:15:35 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.797 03:15:35 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:32.797 03:15:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:32.797 03:15:35 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:32.797 03:15:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:32.797 03:15:35 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:32.797 03:15:35 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:32.797 03:15:35 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:32.797 03:15:35 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:32.797 03:15:35 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:32.797 03:15:35 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:32.797 03:15:35 -- target/tls.sh@28 -- # bdevperf_pid=2486386 00:20:32.797 03:15:35 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:32.797 03:15:35 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:32.797 03:15:35 -- target/tls.sh@31 -- # waitforlisten 2486386 /var/tmp/bdevperf.sock 00:20:32.797 03:15:35 -- common/autotest_common.sh@829 -- # '[' -z 2486386 ']' 00:20:32.797 03:15:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:32.797 03:15:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:32.797 03:15:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:32.797 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:32.797 03:15:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:32.797 03:15:35 -- common/autotest_common.sh@10 -- # set +x 00:20:32.797 [2024-11-27 03:15:35.209548] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:32.797 [2024-11-27 03:15:35.209627] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2486386 ] 00:20:32.797 EAL: No free 2048 kB hugepages reported on node 1 00:20:32.797 [2024-11-27 03:15:35.267761] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:32.797 [2024-11-27 03:15:35.351397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:33.734 03:15:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:33.734 03:15:36 -- common/autotest_common.sh@862 -- # return 0 00:20:33.734 03:15:36 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:33.993 [2024-11-27 03:15:36.512060] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:33.993 [2024-11-27 03:15:36.512126] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:33.993 request: 00:20:33.993 { 00:20:33.993 "name": "TLSTEST", 00:20:33.993 "trtype": "tcp", 00:20:33.993 "traddr": "10.0.0.2", 00:20:33.993 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:33.993 "adrfam": "ipv4", 00:20:33.993 "trsvcid": "4420", 00:20:33.993 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:33.993 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:33.993 "method": "bdev_nvme_attach_controller", 00:20:33.993 "req_id": 1 00:20:33.993 } 00:20:33.993 Got JSON-RPC error response 00:20:33.993 response: 00:20:33.993 { 00:20:33.993 "code": -22, 00:20:33.993 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:33.993 } 00:20:33.993 03:15:36 -- target/tls.sh@36 -- # killprocess 2486386 00:20:33.993 03:15:36 -- common/autotest_common.sh@936 -- # '[' -z 2486386 ']' 00:20:33.993 03:15:36 -- common/autotest_common.sh@940 -- # kill -0 2486386 00:20:33.993 03:15:36 -- common/autotest_common.sh@941 -- # uname 00:20:33.993 03:15:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:33.993 03:15:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2486386 00:20:33.993 03:15:36 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:33.993 03:15:36 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:33.993 03:15:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2486386' 00:20:33.993 killing process with pid 2486386 00:20:33.993 03:15:36 -- common/autotest_common.sh@955 -- # kill 2486386 00:20:33.993 Received shutdown signal, test time was about 10.000000 seconds 00:20:33.993 00:20:33.993 Latency(us) 00:20:33.993 [2024-11-27T02:15:36.612Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:33.993 [2024-11-27T02:15:36.612Z] =================================================================================================================== 00:20:33.993 [2024-11-27T02:15:36.612Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:33.993 03:15:36 -- common/autotest_common.sh@960 -- # wait 2486386 00:20:34.251 03:15:36 -- target/tls.sh@37 -- # return 1 00:20:34.251 03:15:36 -- common/autotest_common.sh@653 -- # es=1 00:20:34.251 03:15:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:34.251 03:15:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:34.251 03:15:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:34.251 03:15:36 -- target/tls.sh@183 -- # killprocess 2484620 00:20:34.251 03:15:36 -- common/autotest_common.sh@936 -- # '[' -z 2484620 ']' 00:20:34.251 03:15:36 -- common/autotest_common.sh@940 -- # kill -0 2484620 00:20:34.251 03:15:36 -- common/autotest_common.sh@941 -- # uname 00:20:34.251 03:15:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:34.251 03:15:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2484620 00:20:34.251 03:15:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:34.251 03:15:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:34.251 03:15:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2484620' 00:20:34.251 killing process with pid 2484620 00:20:34.251 03:15:36 -- common/autotest_common.sh@955 -- # kill 2484620 00:20:34.251 03:15:36 -- common/autotest_common.sh@960 -- # wait 2484620 00:20:34.509 03:15:37 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:34.509 03:15:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:34.509 03:15:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:34.509 03:15:37 -- common/autotest_common.sh@10 -- # set +x 00:20:34.509 03:15:37 -- nvmf/common.sh@469 -- # nvmfpid=2486663 00:20:34.509 03:15:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:34.509 03:15:37 -- nvmf/common.sh@470 -- # waitforlisten 2486663 00:20:34.509 03:15:37 -- common/autotest_common.sh@829 -- # '[' -z 2486663 ']' 00:20:34.509 03:15:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:34.509 03:15:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:34.509 03:15:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:34.509 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:34.509 03:15:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:34.509 03:15:37 -- common/autotest_common.sh@10 -- # set +x 00:20:34.509 [2024-11-27 03:15:37.087235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:34.509 [2024-11-27 03:15:37.087322] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:34.509 EAL: No free 2048 kB hugepages reported on node 1 00:20:34.769 [2024-11-27 03:15:37.152775] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:34.769 [2024-11-27 03:15:37.237389] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:34.769 [2024-11-27 03:15:37.237592] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:34.769 [2024-11-27 03:15:37.237627] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:34.769 [2024-11-27 03:15:37.237640] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:34.769 [2024-11-27 03:15:37.237668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:35.707 03:15:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:35.707 03:15:38 -- common/autotest_common.sh@862 -- # return 0 00:20:35.707 03:15:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:35.707 03:15:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:35.707 03:15:38 -- common/autotest_common.sh@10 -- # set +x 00:20:35.707 03:15:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:35.707 03:15:38 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.707 03:15:38 -- common/autotest_common.sh@650 -- # local es=0 00:20:35.708 03:15:38 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.708 03:15:38 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:35.708 03:15:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:35.708 03:15:38 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:35.708 03:15:38 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:35.708 03:15:38 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.708 03:15:38 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:35.708 03:15:38 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:35.708 [2024-11-27 03:15:38.315887] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:35.967 03:15:38 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:35.967 03:15:38 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:36.225 [2024-11-27 03:15:38.805248] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:36.225 [2024-11-27 03:15:38.805503] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:36.225 03:15:38 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:36.792 malloc0 00:20:36.792 03:15:39 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:36.792 03:15:39 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.050 [2024-11-27 03:15:39.627064] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:37.050 [2024-11-27 03:15:39.627105] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:37.050 [2024-11-27 03:15:39.627130] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:37.050 request: 00:20:37.050 { 00:20:37.050 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:37.050 "host": "nqn.2016-06.io.spdk:host1", 00:20:37.050 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:37.050 "method": "nvmf_subsystem_add_host", 00:20:37.050 "req_id": 1 00:20:37.050 } 00:20:37.050 Got JSON-RPC error response 00:20:37.050 response: 00:20:37.050 { 00:20:37.050 "code": -32603, 00:20:37.050 "message": "Internal error" 00:20:37.050 } 00:20:37.050 03:15:39 -- common/autotest_common.sh@653 -- # es=1 00:20:37.050 03:15:39 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:37.050 03:15:39 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:37.050 03:15:39 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:37.050 03:15:39 -- target/tls.sh@189 -- # killprocess 2486663 00:20:37.050 03:15:39 -- common/autotest_common.sh@936 -- # '[' -z 2486663 ']' 00:20:37.050 03:15:39 -- common/autotest_common.sh@940 -- # kill -0 2486663 00:20:37.050 03:15:39 -- common/autotest_common.sh@941 -- # uname 00:20:37.050 03:15:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:37.050 03:15:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2486663 00:20:37.308 03:15:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:37.308 03:15:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:37.308 03:15:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2486663' 00:20:37.308 killing process with pid 2486663 00:20:37.308 03:15:39 -- common/autotest_common.sh@955 -- # kill 2486663 00:20:37.308 03:15:39 -- common/autotest_common.sh@960 -- # wait 2486663 00:20:37.566 03:15:39 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.566 03:15:39 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:37.566 03:15:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:37.566 03:15:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:37.566 03:15:39 -- common/autotest_common.sh@10 -- # set +x 00:20:37.566 03:15:39 -- nvmf/common.sh@469 -- # nvmfpid=2486978 00:20:37.566 03:15:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:37.566 03:15:39 -- nvmf/common.sh@470 -- # waitforlisten 2486978 00:20:37.566 03:15:39 -- common/autotest_common.sh@829 -- # '[' -z 2486978 ']' 00:20:37.566 03:15:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:37.566 03:15:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:37.566 03:15:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:37.566 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:37.566 03:15:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:37.566 03:15:39 -- common/autotest_common.sh@10 -- # set +x 00:20:37.566 [2024-11-27 03:15:39.984064] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:37.566 [2024-11-27 03:15:39.984140] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:37.566 EAL: No free 2048 kB hugepages reported on node 1 00:20:37.566 [2024-11-27 03:15:40.060230] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:37.566 [2024-11-27 03:15:40.155153] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:37.566 [2024-11-27 03:15:40.155316] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:37.566 [2024-11-27 03:15:40.155335] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:37.566 [2024-11-27 03:15:40.155350] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:37.566 [2024-11-27 03:15:40.155387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:38.504 03:15:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:38.504 03:15:41 -- common/autotest_common.sh@862 -- # return 0 00:20:38.504 03:15:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:38.504 03:15:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:38.504 03:15:41 -- common/autotest_common.sh@10 -- # set +x 00:20:38.504 03:15:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:38.504 03:15:41 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.504 03:15:41 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:38.504 03:15:41 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:38.764 [2024-11-27 03:15:41.361153] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:38.764 03:15:41 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:39.331 03:15:41 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:39.331 [2024-11-27 03:15:41.870476] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:39.331 [2024-11-27 03:15:41.870744] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:39.331 03:15:41 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:39.592 malloc0 00:20:39.592 03:15:42 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:39.882 03:15:42 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.167 03:15:42 -- target/tls.sh@197 -- # bdevperf_pid=2487403 00:20:40.167 03:15:42 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:40.167 03:15:42 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:40.167 03:15:42 -- target/tls.sh@200 -- # waitforlisten 2487403 /var/tmp/bdevperf.sock 00:20:40.167 03:15:42 -- common/autotest_common.sh@829 -- # '[' -z 2487403 ']' 00:20:40.167 03:15:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:40.167 03:15:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:40.167 03:15:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:40.167 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:40.167 03:15:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:40.167 03:15:42 -- common/autotest_common.sh@10 -- # set +x 00:20:40.167 [2024-11-27 03:15:42.693783] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:40.167 [2024-11-27 03:15:42.693870] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2487403 ] 00:20:40.167 EAL: No free 2048 kB hugepages reported on node 1 00:20:40.167 [2024-11-27 03:15:42.755036] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:40.425 [2024-11-27 03:15:42.837159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:41.359 03:15:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:41.359 03:15:43 -- common/autotest_common.sh@862 -- # return 0 00:20:41.359 03:15:43 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:41.359 [2024-11-27 03:15:43.881181] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:41.359 TLSTESTn1 00:20:41.359 03:15:43 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:41.929 03:15:44 -- target/tls.sh@205 -- # tgtconf='{ 00:20:41.929 "subsystems": [ 00:20:41.929 { 00:20:41.929 "subsystem": "iobuf", 00:20:41.929 "config": [ 00:20:41.929 { 00:20:41.929 "method": "iobuf_set_options", 00:20:41.929 "params": { 00:20:41.929 "small_pool_count": 8192, 00:20:41.929 "large_pool_count": 1024, 00:20:41.929 "small_bufsize": 8192, 00:20:41.929 "large_bufsize": 135168 00:20:41.929 } 00:20:41.929 } 00:20:41.929 ] 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "subsystem": "sock", 00:20:41.929 "config": [ 00:20:41.929 { 00:20:41.929 "method": "sock_impl_set_options", 00:20:41.929 "params": { 00:20:41.929 "impl_name": "posix", 00:20:41.929 "recv_buf_size": 2097152, 00:20:41.929 "send_buf_size": 2097152, 00:20:41.929 "enable_recv_pipe": true, 00:20:41.929 "enable_quickack": false, 00:20:41.929 "enable_placement_id": 0, 00:20:41.929 "enable_zerocopy_send_server": true, 00:20:41.929 "enable_zerocopy_send_client": false, 00:20:41.929 "zerocopy_threshold": 0, 00:20:41.929 "tls_version": 0, 00:20:41.929 "enable_ktls": false 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "sock_impl_set_options", 00:20:41.929 "params": { 00:20:41.929 "impl_name": "ssl", 00:20:41.929 "recv_buf_size": 4096, 00:20:41.929 "send_buf_size": 4096, 00:20:41.929 "enable_recv_pipe": true, 00:20:41.929 "enable_quickack": false, 00:20:41.929 "enable_placement_id": 0, 00:20:41.929 "enable_zerocopy_send_server": true, 00:20:41.929 "enable_zerocopy_send_client": false, 00:20:41.929 "zerocopy_threshold": 0, 00:20:41.929 "tls_version": 0, 00:20:41.929 "enable_ktls": false 00:20:41.929 } 00:20:41.929 } 00:20:41.929 ] 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "subsystem": "vmd", 00:20:41.929 "config": [] 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "subsystem": "accel", 00:20:41.929 "config": [ 00:20:41.929 { 00:20:41.929 "method": "accel_set_options", 00:20:41.929 "params": { 00:20:41.929 "small_cache_size": 128, 00:20:41.929 "large_cache_size": 16, 00:20:41.929 "task_count": 2048, 00:20:41.929 "sequence_count": 2048, 00:20:41.929 "buf_count": 2048 00:20:41.929 } 00:20:41.929 } 00:20:41.929 ] 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "subsystem": "bdev", 00:20:41.929 "config": [ 00:20:41.929 { 00:20:41.929 "method": "bdev_set_options", 00:20:41.929 "params": { 00:20:41.929 "bdev_io_pool_size": 65535, 00:20:41.929 "bdev_io_cache_size": 256, 00:20:41.929 "bdev_auto_examine": true, 00:20:41.929 "iobuf_small_cache_size": 128, 00:20:41.929 "iobuf_large_cache_size": 16 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "bdev_raid_set_options", 00:20:41.929 "params": { 00:20:41.929 "process_window_size_kb": 1024 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "bdev_iscsi_set_options", 00:20:41.929 "params": { 00:20:41.929 "timeout_sec": 30 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "bdev_nvme_set_options", 00:20:41.929 "params": { 00:20:41.929 "action_on_timeout": "none", 00:20:41.929 "timeout_us": 0, 00:20:41.929 "timeout_admin_us": 0, 00:20:41.929 "keep_alive_timeout_ms": 10000, 00:20:41.929 "transport_retry_count": 4, 00:20:41.929 "arbitration_burst": 0, 00:20:41.929 "low_priority_weight": 0, 00:20:41.929 "medium_priority_weight": 0, 00:20:41.929 "high_priority_weight": 0, 00:20:41.929 "nvme_adminq_poll_period_us": 10000, 00:20:41.929 "nvme_ioq_poll_period_us": 0, 00:20:41.929 "io_queue_requests": 0, 00:20:41.929 "delay_cmd_submit": true, 00:20:41.929 "bdev_retry_count": 3, 00:20:41.929 "transport_ack_timeout": 0, 00:20:41.929 "ctrlr_loss_timeout_sec": 0, 00:20:41.929 "reconnect_delay_sec": 0, 00:20:41.929 "fast_io_fail_timeout_sec": 0, 00:20:41.929 "generate_uuids": false, 00:20:41.929 "transport_tos": 0, 00:20:41.929 "io_path_stat": false, 00:20:41.929 "allow_accel_sequence": false 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "bdev_nvme_set_hotplug", 00:20:41.929 "params": { 00:20:41.929 "period_us": 100000, 00:20:41.929 "enable": false 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "bdev_malloc_create", 00:20:41.929 "params": { 00:20:41.929 "name": "malloc0", 00:20:41.929 "num_blocks": 8192, 00:20:41.929 "block_size": 4096, 00:20:41.929 "physical_block_size": 4096, 00:20:41.929 "uuid": "1b25834a-5d74-4ded-9376-e9e909c8243e", 00:20:41.929 "optimal_io_boundary": 0 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "bdev_wait_for_examine" 00:20:41.929 } 00:20:41.929 ] 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "subsystem": "nbd", 00:20:41.929 "config": [] 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "subsystem": "scheduler", 00:20:41.929 "config": [ 00:20:41.929 { 00:20:41.929 "method": "framework_set_scheduler", 00:20:41.929 "params": { 00:20:41.929 "name": "static" 00:20:41.929 } 00:20:41.929 } 00:20:41.929 ] 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "subsystem": "nvmf", 00:20:41.929 "config": [ 00:20:41.929 { 00:20:41.929 "method": "nvmf_set_config", 00:20:41.929 "params": { 00:20:41.929 "discovery_filter": "match_any", 00:20:41.929 "admin_cmd_passthru": { 00:20:41.929 "identify_ctrlr": false 00:20:41.929 } 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "nvmf_set_max_subsystems", 00:20:41.929 "params": { 00:20:41.929 "max_subsystems": 1024 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "nvmf_set_crdt", 00:20:41.929 "params": { 00:20:41.929 "crdt1": 0, 00:20:41.929 "crdt2": 0, 00:20:41.929 "crdt3": 0 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "nvmf_create_transport", 00:20:41.929 "params": { 00:20:41.929 "trtype": "TCP", 00:20:41.929 "max_queue_depth": 128, 00:20:41.929 "max_io_qpairs_per_ctrlr": 127, 00:20:41.929 "in_capsule_data_size": 4096, 00:20:41.929 "max_io_size": 131072, 00:20:41.929 "io_unit_size": 131072, 00:20:41.929 "max_aq_depth": 128, 00:20:41.929 "num_shared_buffers": 511, 00:20:41.929 "buf_cache_size": 4294967295, 00:20:41.929 "dif_insert_or_strip": false, 00:20:41.929 "zcopy": false, 00:20:41.929 "c2h_success": false, 00:20:41.929 "sock_priority": 0, 00:20:41.929 "abort_timeout_sec": 1 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "nvmf_create_subsystem", 00:20:41.929 "params": { 00:20:41.929 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:41.929 "allow_any_host": false, 00:20:41.929 "serial_number": "SPDK00000000000001", 00:20:41.929 "model_number": "SPDK bdev Controller", 00:20:41.929 "max_namespaces": 10, 00:20:41.929 "min_cntlid": 1, 00:20:41.929 "max_cntlid": 65519, 00:20:41.929 "ana_reporting": false 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "nvmf_subsystem_add_host", 00:20:41.929 "params": { 00:20:41.929 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:41.929 "host": "nqn.2016-06.io.spdk:host1", 00:20:41.929 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:41.929 } 00:20:41.929 }, 00:20:41.929 { 00:20:41.929 "method": "nvmf_subsystem_add_ns", 00:20:41.930 "params": { 00:20:41.930 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:41.930 "namespace": { 00:20:41.930 "nsid": 1, 00:20:41.930 "bdev_name": "malloc0", 00:20:41.930 "nguid": "1B25834A5D744DED9376E9E909C8243E", 00:20:41.930 "uuid": "1b25834a-5d74-4ded-9376-e9e909c8243e" 00:20:41.930 } 00:20:41.930 } 00:20:41.930 }, 00:20:41.930 { 00:20:41.930 "method": "nvmf_subsystem_add_listener", 00:20:41.930 "params": { 00:20:41.930 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:41.930 "listen_address": { 00:20:41.930 "trtype": "TCP", 00:20:41.930 "adrfam": "IPv4", 00:20:41.930 "traddr": "10.0.0.2", 00:20:41.930 "trsvcid": "4420" 00:20:41.930 }, 00:20:41.930 "secure_channel": true 00:20:41.930 } 00:20:41.930 } 00:20:41.930 ] 00:20:41.930 } 00:20:41.930 ] 00:20:41.930 }' 00:20:41.930 03:15:44 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:42.188 03:15:44 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:42.188 "subsystems": [ 00:20:42.188 { 00:20:42.188 "subsystem": "iobuf", 00:20:42.188 "config": [ 00:20:42.188 { 00:20:42.188 "method": "iobuf_set_options", 00:20:42.188 "params": { 00:20:42.188 "small_pool_count": 8192, 00:20:42.188 "large_pool_count": 1024, 00:20:42.188 "small_bufsize": 8192, 00:20:42.188 "large_bufsize": 135168 00:20:42.188 } 00:20:42.188 } 00:20:42.188 ] 00:20:42.188 }, 00:20:42.188 { 00:20:42.188 "subsystem": "sock", 00:20:42.188 "config": [ 00:20:42.188 { 00:20:42.188 "method": "sock_impl_set_options", 00:20:42.188 "params": { 00:20:42.188 "impl_name": "posix", 00:20:42.188 "recv_buf_size": 2097152, 00:20:42.188 "send_buf_size": 2097152, 00:20:42.188 "enable_recv_pipe": true, 00:20:42.188 "enable_quickack": false, 00:20:42.188 "enable_placement_id": 0, 00:20:42.188 "enable_zerocopy_send_server": true, 00:20:42.188 "enable_zerocopy_send_client": false, 00:20:42.188 "zerocopy_threshold": 0, 00:20:42.188 "tls_version": 0, 00:20:42.188 "enable_ktls": false 00:20:42.188 } 00:20:42.188 }, 00:20:42.188 { 00:20:42.188 "method": "sock_impl_set_options", 00:20:42.188 "params": { 00:20:42.188 "impl_name": "ssl", 00:20:42.188 "recv_buf_size": 4096, 00:20:42.188 "send_buf_size": 4096, 00:20:42.188 "enable_recv_pipe": true, 00:20:42.188 "enable_quickack": false, 00:20:42.188 "enable_placement_id": 0, 00:20:42.188 "enable_zerocopy_send_server": true, 00:20:42.188 "enable_zerocopy_send_client": false, 00:20:42.188 "zerocopy_threshold": 0, 00:20:42.188 "tls_version": 0, 00:20:42.188 "enable_ktls": false 00:20:42.188 } 00:20:42.188 } 00:20:42.188 ] 00:20:42.188 }, 00:20:42.188 { 00:20:42.188 "subsystem": "vmd", 00:20:42.188 "config": [] 00:20:42.188 }, 00:20:42.188 { 00:20:42.188 "subsystem": "accel", 00:20:42.188 "config": [ 00:20:42.188 { 00:20:42.188 "method": "accel_set_options", 00:20:42.188 "params": { 00:20:42.188 "small_cache_size": 128, 00:20:42.188 "large_cache_size": 16, 00:20:42.188 "task_count": 2048, 00:20:42.188 "sequence_count": 2048, 00:20:42.188 "buf_count": 2048 00:20:42.188 } 00:20:42.188 } 00:20:42.188 ] 00:20:42.188 }, 00:20:42.188 { 00:20:42.188 "subsystem": "bdev", 00:20:42.188 "config": [ 00:20:42.188 { 00:20:42.188 "method": "bdev_set_options", 00:20:42.188 "params": { 00:20:42.188 "bdev_io_pool_size": 65535, 00:20:42.188 "bdev_io_cache_size": 256, 00:20:42.188 "bdev_auto_examine": true, 00:20:42.188 "iobuf_small_cache_size": 128, 00:20:42.188 "iobuf_large_cache_size": 16 00:20:42.188 } 00:20:42.188 }, 00:20:42.188 { 00:20:42.188 "method": "bdev_raid_set_options", 00:20:42.188 "params": { 00:20:42.188 "process_window_size_kb": 1024 00:20:42.188 } 00:20:42.188 }, 00:20:42.188 { 00:20:42.188 "method": "bdev_iscsi_set_options", 00:20:42.188 "params": { 00:20:42.188 "timeout_sec": 30 00:20:42.188 } 00:20:42.188 }, 00:20:42.188 { 00:20:42.188 "method": "bdev_nvme_set_options", 00:20:42.188 "params": { 00:20:42.188 "action_on_timeout": "none", 00:20:42.188 "timeout_us": 0, 00:20:42.188 "timeout_admin_us": 0, 00:20:42.188 "keep_alive_timeout_ms": 10000, 00:20:42.188 "transport_retry_count": 4, 00:20:42.188 "arbitration_burst": 0, 00:20:42.188 "low_priority_weight": 0, 00:20:42.188 "medium_priority_weight": 0, 00:20:42.188 "high_priority_weight": 0, 00:20:42.188 "nvme_adminq_poll_period_us": 10000, 00:20:42.188 "nvme_ioq_poll_period_us": 0, 00:20:42.188 "io_queue_requests": 512, 00:20:42.188 "delay_cmd_submit": true, 00:20:42.188 "bdev_retry_count": 3, 00:20:42.188 "transport_ack_timeout": 0, 00:20:42.188 "ctrlr_loss_timeout_sec": 0, 00:20:42.188 "reconnect_delay_sec": 0, 00:20:42.189 "fast_io_fail_timeout_sec": 0, 00:20:42.189 "generate_uuids": false, 00:20:42.189 "transport_tos": 0, 00:20:42.189 "io_path_stat": false, 00:20:42.189 "allow_accel_sequence": false 00:20:42.189 } 00:20:42.189 }, 00:20:42.189 { 00:20:42.189 "method": "bdev_nvme_attach_controller", 00:20:42.189 "params": { 00:20:42.189 "name": "TLSTEST", 00:20:42.189 "trtype": "TCP", 00:20:42.189 "adrfam": "IPv4", 00:20:42.189 "traddr": "10.0.0.2", 00:20:42.189 "trsvcid": "4420", 00:20:42.189 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.189 "prchk_reftag": false, 00:20:42.189 "prchk_guard": false, 00:20:42.189 "ctrlr_loss_timeout_sec": 0, 00:20:42.189 "reconnect_delay_sec": 0, 00:20:42.189 "fast_io_fail_timeout_sec": 0, 00:20:42.189 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:42.189 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:42.189 "hdgst": false, 00:20:42.189 "ddgst": false 00:20:42.189 } 00:20:42.189 }, 00:20:42.189 { 00:20:42.189 "method": "bdev_nvme_set_hotplug", 00:20:42.189 "params": { 00:20:42.189 "period_us": 100000, 00:20:42.189 "enable": false 00:20:42.189 } 00:20:42.189 }, 00:20:42.189 { 00:20:42.189 "method": "bdev_wait_for_examine" 00:20:42.189 } 00:20:42.189 ] 00:20:42.189 }, 00:20:42.189 { 00:20:42.189 "subsystem": "nbd", 00:20:42.189 "config": [] 00:20:42.189 } 00:20:42.189 ] 00:20:42.189 }' 00:20:42.189 03:15:44 -- target/tls.sh@208 -- # killprocess 2487403 00:20:42.189 03:15:44 -- common/autotest_common.sh@936 -- # '[' -z 2487403 ']' 00:20:42.189 03:15:44 -- common/autotest_common.sh@940 -- # kill -0 2487403 00:20:42.189 03:15:44 -- common/autotest_common.sh@941 -- # uname 00:20:42.189 03:15:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:42.189 03:15:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2487403 00:20:42.189 03:15:44 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:42.189 03:15:44 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:42.189 03:15:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2487403' 00:20:42.189 killing process with pid 2487403 00:20:42.189 03:15:44 -- common/autotest_common.sh@955 -- # kill 2487403 00:20:42.189 Received shutdown signal, test time was about 10.000000 seconds 00:20:42.189 00:20:42.189 Latency(us) 00:20:42.189 [2024-11-27T02:15:44.808Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:42.189 [2024-11-27T02:15:44.808Z] =================================================================================================================== 00:20:42.189 [2024-11-27T02:15:44.808Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:42.189 03:15:44 -- common/autotest_common.sh@960 -- # wait 2487403 00:20:42.447 03:15:44 -- target/tls.sh@209 -- # killprocess 2486978 00:20:42.447 03:15:44 -- common/autotest_common.sh@936 -- # '[' -z 2486978 ']' 00:20:42.447 03:15:44 -- common/autotest_common.sh@940 -- # kill -0 2486978 00:20:42.447 03:15:44 -- common/autotest_common.sh@941 -- # uname 00:20:42.447 03:15:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:42.447 03:15:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2486978 00:20:42.447 03:15:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:42.447 03:15:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:42.447 03:15:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2486978' 00:20:42.447 killing process with pid 2486978 00:20:42.447 03:15:44 -- common/autotest_common.sh@955 -- # kill 2486978 00:20:42.447 03:15:44 -- common/autotest_common.sh@960 -- # wait 2486978 00:20:42.706 03:15:45 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:20:42.706 03:15:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:42.706 03:15:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:42.706 03:15:45 -- common/autotest_common.sh@10 -- # set +x 00:20:42.706 03:15:45 -- target/tls.sh@212 -- # echo '{ 00:20:42.706 "subsystems": [ 00:20:42.706 { 00:20:42.706 "subsystem": "iobuf", 00:20:42.706 "config": [ 00:20:42.706 { 00:20:42.706 "method": "iobuf_set_options", 00:20:42.706 "params": { 00:20:42.706 "small_pool_count": 8192, 00:20:42.706 "large_pool_count": 1024, 00:20:42.706 "small_bufsize": 8192, 00:20:42.706 "large_bufsize": 135168 00:20:42.706 } 00:20:42.706 } 00:20:42.706 ] 00:20:42.706 }, 00:20:42.706 { 00:20:42.706 "subsystem": "sock", 00:20:42.706 "config": [ 00:20:42.706 { 00:20:42.706 "method": "sock_impl_set_options", 00:20:42.706 "params": { 00:20:42.706 "impl_name": "posix", 00:20:42.706 "recv_buf_size": 2097152, 00:20:42.706 "send_buf_size": 2097152, 00:20:42.706 "enable_recv_pipe": true, 00:20:42.706 "enable_quickack": false, 00:20:42.706 "enable_placement_id": 0, 00:20:42.706 "enable_zerocopy_send_server": true, 00:20:42.706 "enable_zerocopy_send_client": false, 00:20:42.706 "zerocopy_threshold": 0, 00:20:42.706 "tls_version": 0, 00:20:42.706 "enable_ktls": false 00:20:42.706 } 00:20:42.706 }, 00:20:42.706 { 00:20:42.706 "method": "sock_impl_set_options", 00:20:42.706 "params": { 00:20:42.706 "impl_name": "ssl", 00:20:42.706 "recv_buf_size": 4096, 00:20:42.706 "send_buf_size": 4096, 00:20:42.706 "enable_recv_pipe": true, 00:20:42.706 "enable_quickack": false, 00:20:42.706 "enable_placement_id": 0, 00:20:42.706 "enable_zerocopy_send_server": true, 00:20:42.706 "enable_zerocopy_send_client": false, 00:20:42.706 "zerocopy_threshold": 0, 00:20:42.706 "tls_version": 0, 00:20:42.706 "enable_ktls": false 00:20:42.706 } 00:20:42.706 } 00:20:42.706 ] 00:20:42.706 }, 00:20:42.706 { 00:20:42.706 "subsystem": "vmd", 00:20:42.706 "config": [] 00:20:42.706 }, 00:20:42.706 { 00:20:42.706 "subsystem": "accel", 00:20:42.706 "config": [ 00:20:42.706 { 00:20:42.706 "method": "accel_set_options", 00:20:42.706 "params": { 00:20:42.706 "small_cache_size": 128, 00:20:42.706 "large_cache_size": 16, 00:20:42.706 "task_count": 2048, 00:20:42.706 "sequence_count": 2048, 00:20:42.706 "buf_count": 2048 00:20:42.706 } 00:20:42.706 } 00:20:42.706 ] 00:20:42.706 }, 00:20:42.706 { 00:20:42.706 "subsystem": "bdev", 00:20:42.706 "config": [ 00:20:42.706 { 00:20:42.706 "method": "bdev_set_options", 00:20:42.706 "params": { 00:20:42.706 "bdev_io_pool_size": 65535, 00:20:42.706 "bdev_io_cache_size": 256, 00:20:42.707 "bdev_auto_examine": true, 00:20:42.707 "iobuf_small_cache_size": 128, 00:20:42.707 "iobuf_large_cache_size": 16 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "bdev_raid_set_options", 00:20:42.707 "params": { 00:20:42.707 "process_window_size_kb": 1024 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "bdev_iscsi_set_options", 00:20:42.707 "params": { 00:20:42.707 "timeout_sec": 30 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "bdev_nvme_set_options", 00:20:42.707 "params": { 00:20:42.707 "action_on_timeout": "none", 00:20:42.707 "timeout_us": 0, 00:20:42.707 "timeout_admin_us": 0, 00:20:42.707 "keep_alive_timeout_ms": 10000, 00:20:42.707 "transport_retry_count": 4, 00:20:42.707 "arbitration_burst": 0, 00:20:42.707 "low_priority_weight": 0, 00:20:42.707 "medium_priority_weight": 0, 00:20:42.707 "high_priority_weight": 0, 00:20:42.707 "nvme_adminq_poll_period_us": 10000, 00:20:42.707 "nvme_ioq_poll_period_us": 0, 00:20:42.707 "io_queue_requests": 0, 00:20:42.707 "delay_cmd_submit": true, 00:20:42.707 "bdev_retry_count": 3, 00:20:42.707 "transport_ack_timeout": 0, 00:20:42.707 "ctrlr_loss_timeout_sec": 0, 00:20:42.707 "reconnect_delay_sec": 0, 00:20:42.707 "fast_io_fail_timeout_sec": 0, 00:20:42.707 "generate_uuids": false, 00:20:42.707 "transport_tos": 0, 00:20:42.707 "io_path_stat": false, 00:20:42.707 "allow_accel_sequence": false 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "bdev_nvme_set_hotplug", 00:20:42.707 "params": { 00:20:42.707 "period_us": 100000, 00:20:42.707 "enable": false 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "bdev_malloc_create", 00:20:42.707 "params": { 00:20:42.707 "name": "malloc0", 00:20:42.707 "num_blocks": 8192, 00:20:42.707 "block_size": 4096, 00:20:42.707 "physical_block_size": 4096, 00:20:42.707 "uuid": "1b25834a-5d74-4ded-9376-e9e909c8243e", 00:20:42.707 "optimal_io_boundary": 0 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "bdev_wait_for_examine" 00:20:42.707 } 00:20:42.707 ] 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "subsystem": "nbd", 00:20:42.707 "config": [] 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "subsystem": "scheduler", 00:20:42.707 "config": [ 00:20:42.707 { 00:20:42.707 "method": "framework_set_scheduler", 00:20:42.707 "params": { 00:20:42.707 "name": "static" 00:20:42.707 } 00:20:42.707 } 00:20:42.707 ] 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "subsystem": "nvmf", 00:20:42.707 "config": [ 00:20:42.707 { 00:20:42.707 "method": "nvmf_set_config", 00:20:42.707 "params": { 00:20:42.707 "discovery_filter": "match_any", 00:20:42.707 "admin_cmd_passthru": { 00:20:42.707 "identify_ctrlr": false 00:20:42.707 } 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "nvmf_set_max_subsystems", 00:20:42.707 "params": { 00:20:42.707 "max_subsystems": 1024 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "nvmf_set_crdt", 00:20:42.707 "params": { 00:20:42.707 "crdt1": 0, 00:20:42.707 "crdt2": 0, 00:20:42.707 "crdt3": 0 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "nvmf_create_transport", 00:20:42.707 "params": { 00:20:42.707 "trtype": "TCP", 00:20:42.707 "max_queue_depth": 128, 00:20:42.707 "max_io_qpairs_per_ctrlr": 127, 00:20:42.707 "in_capsule_data_size": 4096, 00:20:42.707 "max_io_size": 131072, 00:20:42.707 "io_unit_size": 131072, 00:20:42.707 "max_aq_depth": 128, 00:20:42.707 "num_shared_buffers": 511, 00:20:42.707 "buf_cache_size": 4294967295, 00:20:42.707 "dif_insert_or_strip": false, 00:20:42.707 "zcopy": false, 00:20:42.707 "c2h_success": false, 00:20:42.707 "sock_priority": 0, 00:20:42.707 "abort_timeout_sec": 1 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "nvmf_create_subsystem", 00:20:42.707 "params": { 00:20:42.707 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.707 "allow_any_host": false, 00:20:42.707 "serial_number": "SPDK00000000000001", 00:20:42.707 "model_number": "SPDK bdev Controller", 00:20:42.707 "max_namespaces": 10, 00:20:42.707 "min_cntlid": 1, 00:20:42.707 "max_cntlid": 65519, 00:20:42.707 "ana_reporting": false 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "nvmf_subsystem_add_host", 00:20:42.707 "params": { 00:20:42.707 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.707 "host": "nqn.2016-06.io.spdk:host1", 00:20:42.707 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "nvmf_subsystem_add_ns", 00:20:42.707 "params": { 00:20:42.707 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.707 "namespace": { 00:20:42.707 "nsid": 1, 00:20:42.707 "bdev_name": "malloc0", 00:20:42.707 "nguid": "1B25834A5D744DED9376E9E909C8243E", 00:20:42.707 "uuid": "1b25834a-5d74-4ded-9376-e9e909c8243e" 00:20:42.707 } 00:20:42.707 } 00:20:42.707 }, 00:20:42.707 { 00:20:42.707 "method": "nvmf_subsystem_add_listener", 00:20:42.707 "params": { 00:20:42.707 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:42.707 "listen_address": { 00:20:42.707 "trtype": "TCP", 00:20:42.707 "adrfam": "IPv4", 00:20:42.707 "traddr": "10.0.0.2", 00:20:42.707 "trsvcid": "4420" 00:20:42.707 }, 00:20:42.707 "secure_channel": true 00:20:42.707 } 00:20:42.707 } 00:20:42.707 ] 00:20:42.707 } 00:20:42.707 ] 00:20:42.707 }' 00:20:42.707 03:15:45 -- nvmf/common.sh@469 -- # nvmfpid=2487696 00:20:42.707 03:15:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:20:42.707 03:15:45 -- nvmf/common.sh@470 -- # waitforlisten 2487696 00:20:42.707 03:15:45 -- common/autotest_common.sh@829 -- # '[' -z 2487696 ']' 00:20:42.707 03:15:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:42.707 03:15:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:42.707 03:15:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:42.707 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:42.707 03:15:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:42.707 03:15:45 -- common/autotest_common.sh@10 -- # set +x 00:20:42.707 [2024-11-27 03:15:45.126015] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:42.707 [2024-11-27 03:15:45.126108] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:42.707 EAL: No free 2048 kB hugepages reported on node 1 00:20:42.707 [2024-11-27 03:15:45.190986] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:42.707 [2024-11-27 03:15:45.279369] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:42.707 [2024-11-27 03:15:45.279544] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:42.707 [2024-11-27 03:15:45.279572] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:42.707 [2024-11-27 03:15:45.279584] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:42.707 [2024-11-27 03:15:45.279616] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:42.966 [2024-11-27 03:15:45.508508] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:42.966 [2024-11-27 03:15:45.540534] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:42.966 [2024-11-27 03:15:45.540801] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:43.535 03:15:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:43.535 03:15:46 -- common/autotest_common.sh@862 -- # return 0 00:20:43.535 03:15:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:43.535 03:15:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:43.535 03:15:46 -- common/autotest_common.sh@10 -- # set +x 00:20:43.535 03:15:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:43.535 03:15:46 -- target/tls.sh@216 -- # bdevperf_pid=2487849 00:20:43.535 03:15:46 -- target/tls.sh@217 -- # waitforlisten 2487849 /var/tmp/bdevperf.sock 00:20:43.535 03:15:46 -- common/autotest_common.sh@829 -- # '[' -z 2487849 ']' 00:20:43.535 03:15:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:43.535 03:15:46 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:20:43.535 03:15:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:43.535 03:15:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:43.535 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:43.535 03:15:46 -- target/tls.sh@213 -- # echo '{ 00:20:43.535 "subsystems": [ 00:20:43.535 { 00:20:43.535 "subsystem": "iobuf", 00:20:43.535 "config": [ 00:20:43.535 { 00:20:43.535 "method": "iobuf_set_options", 00:20:43.535 "params": { 00:20:43.535 "small_pool_count": 8192, 00:20:43.535 "large_pool_count": 1024, 00:20:43.535 "small_bufsize": 8192, 00:20:43.535 "large_bufsize": 135168 00:20:43.535 } 00:20:43.535 } 00:20:43.535 ] 00:20:43.535 }, 00:20:43.535 { 00:20:43.535 "subsystem": "sock", 00:20:43.535 "config": [ 00:20:43.535 { 00:20:43.535 "method": "sock_impl_set_options", 00:20:43.535 "params": { 00:20:43.535 "impl_name": "posix", 00:20:43.535 "recv_buf_size": 2097152, 00:20:43.535 "send_buf_size": 2097152, 00:20:43.535 "enable_recv_pipe": true, 00:20:43.535 "enable_quickack": false, 00:20:43.535 "enable_placement_id": 0, 00:20:43.535 "enable_zerocopy_send_server": true, 00:20:43.535 "enable_zerocopy_send_client": false, 00:20:43.535 "zerocopy_threshold": 0, 00:20:43.535 "tls_version": 0, 00:20:43.535 "enable_ktls": false 00:20:43.535 } 00:20:43.535 }, 00:20:43.535 { 00:20:43.535 "method": "sock_impl_set_options", 00:20:43.535 "params": { 00:20:43.535 "impl_name": "ssl", 00:20:43.535 "recv_buf_size": 4096, 00:20:43.535 "send_buf_size": 4096, 00:20:43.535 "enable_recv_pipe": true, 00:20:43.535 "enable_quickack": false, 00:20:43.535 "enable_placement_id": 0, 00:20:43.535 "enable_zerocopy_send_server": true, 00:20:43.535 "enable_zerocopy_send_client": false, 00:20:43.535 "zerocopy_threshold": 0, 00:20:43.535 "tls_version": 0, 00:20:43.535 "enable_ktls": false 00:20:43.535 } 00:20:43.535 } 00:20:43.535 ] 00:20:43.535 }, 00:20:43.535 { 00:20:43.535 "subsystem": "vmd", 00:20:43.535 "config": [] 00:20:43.535 }, 00:20:43.535 { 00:20:43.535 "subsystem": "accel", 00:20:43.535 "config": [ 00:20:43.535 { 00:20:43.535 "method": "accel_set_options", 00:20:43.535 "params": { 00:20:43.535 "small_cache_size": 128, 00:20:43.535 "large_cache_size": 16, 00:20:43.535 "task_count": 2048, 00:20:43.535 "sequence_count": 2048, 00:20:43.535 "buf_count": 2048 00:20:43.535 } 00:20:43.535 } 00:20:43.535 ] 00:20:43.535 }, 00:20:43.535 { 00:20:43.535 "subsystem": "bdev", 00:20:43.535 "config": [ 00:20:43.535 { 00:20:43.535 "method": "bdev_set_options", 00:20:43.535 "params": { 00:20:43.535 "bdev_io_pool_size": 65535, 00:20:43.535 "bdev_io_cache_size": 256, 00:20:43.535 "bdev_auto_examine": true, 00:20:43.535 "iobuf_small_cache_size": 128, 00:20:43.535 "iobuf_large_cache_size": 16 00:20:43.535 } 00:20:43.535 }, 00:20:43.535 { 00:20:43.535 "method": "bdev_raid_set_options", 00:20:43.535 "params": { 00:20:43.535 "process_window_size_kb": 1024 00:20:43.535 } 00:20:43.535 }, 00:20:43.535 { 00:20:43.535 "method": "bdev_iscsi_set_options", 00:20:43.535 "params": { 00:20:43.535 "timeout_sec": 30 00:20:43.535 } 00:20:43.535 }, 00:20:43.535 { 00:20:43.535 "method": "bdev_nvme_set_options", 00:20:43.535 "params": { 00:20:43.535 "action_on_timeout": "none", 00:20:43.535 "timeout_us": 0, 00:20:43.535 "timeout_admin_us": 0, 00:20:43.535 "keep_alive_timeout_ms": 10000, 00:20:43.535 "transport_retry_count": 4, 00:20:43.535 "arbitration_burst": 0, 00:20:43.535 "low_priority_weight": 0, 00:20:43.535 "medium_priority_weight": 0, 00:20:43.535 "high_priority_weight": 0, 00:20:43.535 "nvme_adminq_poll_period_us": 10000, 00:20:43.535 "nvme_ioq_poll_period_us": 0, 00:20:43.535 "io_queue_requests": 512, 00:20:43.535 "delay_cmd_submit": true, 00:20:43.535 "bdev_retry_count": 3, 00:20:43.536 "transport_ack_timeout": 0, 00:20:43.536 "ctrlr_loss_timeout_sec": 0, 00:20:43.536 "reconnect_delay_sec": 0, 00:20:43.536 "fast_io_fail_timeout_sec": 0, 00:20:43.536 "generate_uuids": false, 00:20:43.536 "transport_tos": 0, 00:20:43.536 "io_path_stat": false, 00:20:43.536 "allow_accel_sequence": false 00:20:43.536 } 00:20:43.536 }, 00:20:43.536 { 00:20:43.536 "method": "bdev_nvme_attach_controller", 00:20:43.536 "params": { 00:20:43.536 "name": "TLSTEST", 00:20:43.536 "trtype": "TCP", 00:20:43.536 "adrfam": "IPv4", 00:20:43.536 "traddr": "10.0.0.2", 00:20:43.536 "trsvcid": "4420", 00:20:43.536 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:43.536 "prchk_reftag": false, 00:20:43.536 "prchk_guard": false, 00:20:43.536 "ctrlr_loss_timeout_sec": 0, 00:20:43.536 "reconnect_delay_sec": 0, 00:20:43.536 "fast_io_fail_timeout_sec": 0, 00:20:43.536 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:43.536 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:43.536 "hdgst": false, 00:20:43.536 "ddgst": false 00:20:43.536 } 00:20:43.536 }, 00:20:43.536 { 00:20:43.536 "method": "bdev_nvme_set_hotplug", 00:20:43.536 "params": { 00:20:43.536 "period_us": 100000, 00:20:43.536 "enable": false 00:20:43.536 } 00:20:43.536 }, 00:20:43.536 { 00:20:43.536 "method": "bdev_wait_for_examine" 00:20:43.536 } 00:20:43.536 ] 00:20:43.536 }, 00:20:43.536 { 00:20:43.536 "subsystem": "nbd", 00:20:43.536 "config": [] 00:20:43.536 } 00:20:43.536 ] 00:20:43.536 }' 00:20:43.536 03:15:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:43.536 03:15:46 -- common/autotest_common.sh@10 -- # set +x 00:20:43.794 [2024-11-27 03:15:46.155736] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:43.794 [2024-11-27 03:15:46.155846] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2487849 ] 00:20:43.794 EAL: No free 2048 kB hugepages reported on node 1 00:20:43.794 [2024-11-27 03:15:46.215851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:43.794 [2024-11-27 03:15:46.299776] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:44.053 [2024-11-27 03:15:46.448996] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:44.620 03:15:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:44.620 03:15:47 -- common/autotest_common.sh@862 -- # return 0 00:20:44.620 03:15:47 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:44.620 Running I/O for 10 seconds... 00:20:56.836 00:20:56.836 Latency(us) 00:20:56.836 [2024-11-27T02:15:59.455Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:56.836 [2024-11-27T02:15:59.455Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:56.836 Verification LBA range: start 0x0 length 0x2000 00:20:56.836 TLSTESTn1 : 10.02 4105.47 16.04 0.00 0.00 31128.36 8058.50 40195.41 00:20:56.836 [2024-11-27T02:15:59.455Z] =================================================================================================================== 00:20:56.836 [2024-11-27T02:15:59.455Z] Total : 4105.47 16.04 0.00 0.00 31128.36 8058.50 40195.41 00:20:56.836 0 00:20:56.836 03:15:57 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:56.836 03:15:57 -- target/tls.sh@223 -- # killprocess 2487849 00:20:56.836 03:15:57 -- common/autotest_common.sh@936 -- # '[' -z 2487849 ']' 00:20:56.836 03:15:57 -- common/autotest_common.sh@940 -- # kill -0 2487849 00:20:56.836 03:15:57 -- common/autotest_common.sh@941 -- # uname 00:20:56.836 03:15:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:56.836 03:15:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2487849 00:20:56.836 03:15:57 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:56.836 03:15:57 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:56.836 03:15:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2487849' 00:20:56.836 killing process with pid 2487849 00:20:56.836 03:15:57 -- common/autotest_common.sh@955 -- # kill 2487849 00:20:56.836 Received shutdown signal, test time was about 10.000000 seconds 00:20:56.836 00:20:56.836 Latency(us) 00:20:56.836 [2024-11-27T02:15:59.455Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:56.836 [2024-11-27T02:15:59.455Z] =================================================================================================================== 00:20:56.836 [2024-11-27T02:15:59.455Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:56.836 03:15:57 -- common/autotest_common.sh@960 -- # wait 2487849 00:20:56.836 03:15:57 -- target/tls.sh@224 -- # killprocess 2487696 00:20:56.836 03:15:57 -- common/autotest_common.sh@936 -- # '[' -z 2487696 ']' 00:20:56.836 03:15:57 -- common/autotest_common.sh@940 -- # kill -0 2487696 00:20:56.836 03:15:57 -- common/autotest_common.sh@941 -- # uname 00:20:56.836 03:15:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:56.836 03:15:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2487696 00:20:56.836 03:15:57 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:56.836 03:15:57 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:56.836 03:15:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2487696' 00:20:56.836 killing process with pid 2487696 00:20:56.836 03:15:57 -- common/autotest_common.sh@955 -- # kill 2487696 00:20:56.836 03:15:57 -- common/autotest_common.sh@960 -- # wait 2487696 00:20:56.836 03:15:57 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:20:56.836 03:15:57 -- target/tls.sh@227 -- # cleanup 00:20:56.836 03:15:57 -- target/tls.sh@15 -- # process_shm --id 0 00:20:56.836 03:15:57 -- common/autotest_common.sh@806 -- # type=--id 00:20:56.836 03:15:57 -- common/autotest_common.sh@807 -- # id=0 00:20:56.836 03:15:57 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:20:56.836 03:15:57 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:20:56.836 03:15:57 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:20:56.836 03:15:57 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:20:56.836 03:15:57 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:20:56.836 03:15:57 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:20:56.836 nvmf_trace.0 00:20:56.836 03:15:57 -- common/autotest_common.sh@821 -- # return 0 00:20:56.836 03:15:57 -- target/tls.sh@16 -- # killprocess 2487849 00:20:56.836 03:15:57 -- common/autotest_common.sh@936 -- # '[' -z 2487849 ']' 00:20:56.836 03:15:57 -- common/autotest_common.sh@940 -- # kill -0 2487849 00:20:56.836 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2487849) - No such process 00:20:56.836 03:15:57 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2487849 is not found' 00:20:56.836 Process with pid 2487849 is not found 00:20:56.836 03:15:57 -- target/tls.sh@17 -- # nvmftestfini 00:20:56.836 03:15:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:56.836 03:15:57 -- nvmf/common.sh@116 -- # sync 00:20:56.836 03:15:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:56.836 03:15:57 -- nvmf/common.sh@119 -- # set +e 00:20:56.836 03:15:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:56.836 03:15:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:56.836 rmmod nvme_tcp 00:20:56.836 rmmod nvme_fabrics 00:20:56.836 rmmod nvme_keyring 00:20:56.836 03:15:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:56.836 03:15:57 -- nvmf/common.sh@123 -- # set -e 00:20:56.836 03:15:57 -- nvmf/common.sh@124 -- # return 0 00:20:56.836 03:15:57 -- nvmf/common.sh@477 -- # '[' -n 2487696 ']' 00:20:56.836 03:15:57 -- nvmf/common.sh@478 -- # killprocess 2487696 00:20:56.836 03:15:57 -- common/autotest_common.sh@936 -- # '[' -z 2487696 ']' 00:20:56.836 03:15:57 -- common/autotest_common.sh@940 -- # kill -0 2487696 00:20:56.836 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2487696) - No such process 00:20:56.836 03:15:57 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2487696 is not found' 00:20:56.836 Process with pid 2487696 is not found 00:20:56.836 03:15:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:56.836 03:15:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:56.836 03:15:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:56.836 03:15:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:56.836 03:15:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:56.836 03:15:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:56.836 03:15:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:56.836 03:15:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:57.404 03:15:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:57.404 03:15:59 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:57.404 00:20:57.404 real 1m15.255s 00:20:57.404 user 1m57.150s 00:20:57.404 sys 0m24.651s 00:20:57.404 03:15:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:57.404 03:15:59 -- common/autotest_common.sh@10 -- # set +x 00:20:57.404 ************************************ 00:20:57.404 END TEST nvmf_tls 00:20:57.404 ************************************ 00:20:57.404 03:15:59 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:57.404 03:15:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:57.404 03:15:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:57.404 03:15:59 -- common/autotest_common.sh@10 -- # set +x 00:20:57.404 ************************************ 00:20:57.404 START TEST nvmf_fips 00:20:57.404 ************************************ 00:20:57.405 03:16:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:20:57.663 * Looking for test storage... 00:20:57.663 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:20:57.663 03:16:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:57.663 03:16:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:57.663 03:16:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:57.663 03:16:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:57.663 03:16:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:57.663 03:16:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:57.663 03:16:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:57.663 03:16:00 -- scripts/common.sh@335 -- # IFS=.-: 00:20:57.663 03:16:00 -- scripts/common.sh@335 -- # read -ra ver1 00:20:57.663 03:16:00 -- scripts/common.sh@336 -- # IFS=.-: 00:20:57.663 03:16:00 -- scripts/common.sh@336 -- # read -ra ver2 00:20:57.663 03:16:00 -- scripts/common.sh@337 -- # local 'op=<' 00:20:57.663 03:16:00 -- scripts/common.sh@339 -- # ver1_l=2 00:20:57.663 03:16:00 -- scripts/common.sh@340 -- # ver2_l=1 00:20:57.663 03:16:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:57.663 03:16:00 -- scripts/common.sh@343 -- # case "$op" in 00:20:57.663 03:16:00 -- scripts/common.sh@344 -- # : 1 00:20:57.663 03:16:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:57.663 03:16:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:57.663 03:16:00 -- scripts/common.sh@364 -- # decimal 1 00:20:57.663 03:16:00 -- scripts/common.sh@352 -- # local d=1 00:20:57.663 03:16:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:57.663 03:16:00 -- scripts/common.sh@354 -- # echo 1 00:20:57.663 03:16:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:57.663 03:16:00 -- scripts/common.sh@365 -- # decimal 2 00:20:57.663 03:16:00 -- scripts/common.sh@352 -- # local d=2 00:20:57.663 03:16:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:57.663 03:16:00 -- scripts/common.sh@354 -- # echo 2 00:20:57.664 03:16:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:57.664 03:16:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:57.664 03:16:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:57.664 03:16:00 -- scripts/common.sh@367 -- # return 0 00:20:57.664 03:16:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:57.664 03:16:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:57.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:57.664 --rc genhtml_branch_coverage=1 00:20:57.664 --rc genhtml_function_coverage=1 00:20:57.664 --rc genhtml_legend=1 00:20:57.664 --rc geninfo_all_blocks=1 00:20:57.664 --rc geninfo_unexecuted_blocks=1 00:20:57.664 00:20:57.664 ' 00:20:57.664 03:16:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:57.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:57.664 --rc genhtml_branch_coverage=1 00:20:57.664 --rc genhtml_function_coverage=1 00:20:57.664 --rc genhtml_legend=1 00:20:57.664 --rc geninfo_all_blocks=1 00:20:57.664 --rc geninfo_unexecuted_blocks=1 00:20:57.664 00:20:57.664 ' 00:20:57.664 03:16:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:57.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:57.664 --rc genhtml_branch_coverage=1 00:20:57.664 --rc genhtml_function_coverage=1 00:20:57.664 --rc genhtml_legend=1 00:20:57.664 --rc geninfo_all_blocks=1 00:20:57.664 --rc geninfo_unexecuted_blocks=1 00:20:57.664 00:20:57.664 ' 00:20:57.664 03:16:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:57.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:57.664 --rc genhtml_branch_coverage=1 00:20:57.664 --rc genhtml_function_coverage=1 00:20:57.664 --rc genhtml_legend=1 00:20:57.664 --rc geninfo_all_blocks=1 00:20:57.664 --rc geninfo_unexecuted_blocks=1 00:20:57.664 00:20:57.664 ' 00:20:57.664 03:16:00 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:57.664 03:16:00 -- nvmf/common.sh@7 -- # uname -s 00:20:57.664 03:16:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:57.664 03:16:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:57.664 03:16:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:57.664 03:16:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:57.664 03:16:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:57.664 03:16:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:57.664 03:16:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:57.664 03:16:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:57.664 03:16:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:57.664 03:16:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:57.664 03:16:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:57.664 03:16:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:57.664 03:16:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:57.664 03:16:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:57.664 03:16:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:57.664 03:16:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:57.664 03:16:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:57.664 03:16:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:57.664 03:16:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:57.664 03:16:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:57.664 03:16:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:57.664 03:16:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:57.664 03:16:00 -- paths/export.sh@5 -- # export PATH 00:20:57.664 03:16:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:57.664 03:16:00 -- nvmf/common.sh@46 -- # : 0 00:20:57.664 03:16:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:57.664 03:16:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:57.664 03:16:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:57.664 03:16:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:57.664 03:16:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:57.664 03:16:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:57.664 03:16:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:57.664 03:16:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:57.664 03:16:00 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:57.664 03:16:00 -- fips/fips.sh@89 -- # check_openssl_version 00:20:57.664 03:16:00 -- fips/fips.sh@83 -- # local target=3.0.0 00:20:57.664 03:16:00 -- fips/fips.sh@85 -- # openssl version 00:20:57.664 03:16:00 -- fips/fips.sh@85 -- # awk '{print $2}' 00:20:57.664 03:16:00 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:20:57.664 03:16:00 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:20:57.664 03:16:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:57.664 03:16:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:57.664 03:16:00 -- scripts/common.sh@335 -- # IFS=.-: 00:20:57.664 03:16:00 -- scripts/common.sh@335 -- # read -ra ver1 00:20:57.664 03:16:00 -- scripts/common.sh@336 -- # IFS=.-: 00:20:57.664 03:16:00 -- scripts/common.sh@336 -- # read -ra ver2 00:20:57.664 03:16:00 -- scripts/common.sh@337 -- # local 'op=>=' 00:20:57.664 03:16:00 -- scripts/common.sh@339 -- # ver1_l=3 00:20:57.664 03:16:00 -- scripts/common.sh@340 -- # ver2_l=3 00:20:57.664 03:16:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:57.664 03:16:00 -- scripts/common.sh@343 -- # case "$op" in 00:20:57.664 03:16:00 -- scripts/common.sh@347 -- # : 1 00:20:57.664 03:16:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:57.664 03:16:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:57.664 03:16:00 -- scripts/common.sh@364 -- # decimal 3 00:20:57.664 03:16:00 -- scripts/common.sh@352 -- # local d=3 00:20:57.664 03:16:00 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:57.664 03:16:00 -- scripts/common.sh@354 -- # echo 3 00:20:57.664 03:16:00 -- scripts/common.sh@364 -- # ver1[v]=3 00:20:57.664 03:16:00 -- scripts/common.sh@365 -- # decimal 3 00:20:57.664 03:16:00 -- scripts/common.sh@352 -- # local d=3 00:20:57.664 03:16:00 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:20:57.664 03:16:00 -- scripts/common.sh@354 -- # echo 3 00:20:57.664 03:16:00 -- scripts/common.sh@365 -- # ver2[v]=3 00:20:57.664 03:16:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:57.664 03:16:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:57.664 03:16:00 -- scripts/common.sh@363 -- # (( v++ )) 00:20:57.664 03:16:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:57.664 03:16:00 -- scripts/common.sh@364 -- # decimal 1 00:20:57.664 03:16:00 -- scripts/common.sh@352 -- # local d=1 00:20:57.664 03:16:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:57.664 03:16:00 -- scripts/common.sh@354 -- # echo 1 00:20:57.664 03:16:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:57.664 03:16:00 -- scripts/common.sh@365 -- # decimal 0 00:20:57.664 03:16:00 -- scripts/common.sh@352 -- # local d=0 00:20:57.664 03:16:00 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:20:57.664 03:16:00 -- scripts/common.sh@354 -- # echo 0 00:20:57.664 03:16:00 -- scripts/common.sh@365 -- # ver2[v]=0 00:20:57.664 03:16:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:57.664 03:16:00 -- scripts/common.sh@366 -- # return 0 00:20:57.664 03:16:00 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:20:57.664 03:16:00 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:20:57.664 03:16:00 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:20:57.664 03:16:00 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:20:57.664 03:16:00 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:20:57.664 03:16:00 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:20:57.664 03:16:00 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:20:57.664 03:16:00 -- fips/fips.sh@113 -- # build_openssl_config 00:20:57.664 03:16:00 -- fips/fips.sh@37 -- # cat 00:20:57.664 03:16:00 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:20:57.664 03:16:00 -- fips/fips.sh@58 -- # cat - 00:20:57.664 03:16:00 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:20:57.664 03:16:00 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:20:57.665 03:16:00 -- fips/fips.sh@116 -- # mapfile -t providers 00:20:57.665 03:16:00 -- fips/fips.sh@116 -- # openssl list -providers 00:20:57.665 03:16:00 -- fips/fips.sh@116 -- # grep name 00:20:57.665 03:16:00 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:20:57.665 03:16:00 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:20:57.665 03:16:00 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:20:57.665 03:16:00 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:20:57.665 03:16:00 -- fips/fips.sh@127 -- # : 00:20:57.665 03:16:00 -- common/autotest_common.sh@650 -- # local es=0 00:20:57.665 03:16:00 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:20:57.665 03:16:00 -- common/autotest_common.sh@638 -- # local arg=openssl 00:20:57.665 03:16:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:57.665 03:16:00 -- common/autotest_common.sh@642 -- # type -t openssl 00:20:57.665 03:16:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:57.665 03:16:00 -- common/autotest_common.sh@644 -- # type -P openssl 00:20:57.665 03:16:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:57.665 03:16:00 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:20:57.665 03:16:00 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:20:57.665 03:16:00 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:20:57.923 Error setting digest 00:20:57.923 40129CCE4B7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:20:57.923 40129CCE4B7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:20:57.923 03:16:00 -- common/autotest_common.sh@653 -- # es=1 00:20:57.923 03:16:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:57.923 03:16:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:57.923 03:16:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:57.923 03:16:00 -- fips/fips.sh@130 -- # nvmftestinit 00:20:57.923 03:16:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:57.923 03:16:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:57.923 03:16:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:57.923 03:16:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:57.923 03:16:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:57.923 03:16:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:57.923 03:16:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:57.923 03:16:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:57.923 03:16:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:57.924 03:16:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:57.924 03:16:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:57.924 03:16:00 -- common/autotest_common.sh@10 -- # set +x 00:20:59.833 03:16:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:59.833 03:16:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:59.833 03:16:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:59.833 03:16:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:59.833 03:16:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:59.833 03:16:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:59.833 03:16:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:59.833 03:16:02 -- nvmf/common.sh@294 -- # net_devs=() 00:20:59.833 03:16:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:59.833 03:16:02 -- nvmf/common.sh@295 -- # e810=() 00:20:59.833 03:16:02 -- nvmf/common.sh@295 -- # local -ga e810 00:20:59.833 03:16:02 -- nvmf/common.sh@296 -- # x722=() 00:20:59.833 03:16:02 -- nvmf/common.sh@296 -- # local -ga x722 00:20:59.833 03:16:02 -- nvmf/common.sh@297 -- # mlx=() 00:20:59.833 03:16:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:59.833 03:16:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:59.833 03:16:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:59.833 03:16:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:59.833 03:16:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:59.833 03:16:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:59.833 03:16:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:59.833 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:59.833 03:16:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:59.833 03:16:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:59.833 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:59.833 03:16:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:59.833 03:16:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:59.833 03:16:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:59.833 03:16:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:59.833 03:16:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:59.833 03:16:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:59.833 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:59.833 03:16:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:59.833 03:16:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:59.833 03:16:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:59.833 03:16:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:59.833 03:16:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:59.833 03:16:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:59.833 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:59.833 03:16:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:59.833 03:16:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:59.833 03:16:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:59.833 03:16:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:59.833 03:16:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:59.833 03:16:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:59.833 03:16:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:59.833 03:16:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:59.833 03:16:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:59.833 03:16:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:59.833 03:16:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:59.833 03:16:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:59.833 03:16:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:59.833 03:16:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:59.833 03:16:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:59.833 03:16:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:59.833 03:16:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:59.833 03:16:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:00.092 03:16:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:00.092 03:16:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:00.092 03:16:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:00.092 03:16:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:00.092 03:16:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:00.092 03:16:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:00.092 03:16:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:00.092 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:00.092 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.288 ms 00:21:00.092 00:21:00.092 --- 10.0.0.2 ping statistics --- 00:21:00.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:00.092 rtt min/avg/max/mdev = 0.288/0.288/0.288/0.000 ms 00:21:00.092 03:16:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:00.092 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:00.092 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.130 ms 00:21:00.092 00:21:00.092 --- 10.0.0.1 ping statistics --- 00:21:00.092 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:00.092 rtt min/avg/max/mdev = 0.130/0.130/0.130/0.000 ms 00:21:00.092 03:16:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:00.092 03:16:02 -- nvmf/common.sh@410 -- # return 0 00:21:00.092 03:16:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:00.092 03:16:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:00.092 03:16:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:00.092 03:16:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:00.092 03:16:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:00.092 03:16:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:00.092 03:16:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:00.092 03:16:02 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:00.092 03:16:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:00.092 03:16:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:00.092 03:16:02 -- common/autotest_common.sh@10 -- # set +x 00:21:00.092 03:16:02 -- nvmf/common.sh@469 -- # nvmfpid=2491194 00:21:00.092 03:16:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:00.092 03:16:02 -- nvmf/common.sh@470 -- # waitforlisten 2491194 00:21:00.092 03:16:02 -- common/autotest_common.sh@829 -- # '[' -z 2491194 ']' 00:21:00.092 03:16:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:00.092 03:16:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:00.092 03:16:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:00.092 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:00.092 03:16:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:00.092 03:16:02 -- common/autotest_common.sh@10 -- # set +x 00:21:00.092 [2024-11-27 03:16:02.641477] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:00.092 [2024-11-27 03:16:02.641597] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:00.092 EAL: No free 2048 kB hugepages reported on node 1 00:21:00.092 [2024-11-27 03:16:02.709495] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.353 [2024-11-27 03:16:02.794554] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:00.353 [2024-11-27 03:16:02.794713] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:00.353 [2024-11-27 03:16:02.794730] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:00.353 [2024-11-27 03:16:02.794742] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:00.353 [2024-11-27 03:16:02.794768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:01.291 03:16:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:01.291 03:16:03 -- common/autotest_common.sh@862 -- # return 0 00:21:01.291 03:16:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:01.291 03:16:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:01.291 03:16:03 -- common/autotest_common.sh@10 -- # set +x 00:21:01.291 03:16:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:01.291 03:16:03 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:01.291 03:16:03 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:01.291 03:16:03 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:01.291 03:16:03 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:01.291 03:16:03 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:01.291 03:16:03 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:01.291 03:16:03 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:01.291 03:16:03 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:01.291 [2024-11-27 03:16:03.896760] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:01.550 [2024-11-27 03:16:03.912810] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:01.550 [2024-11-27 03:16:03.913061] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:01.550 malloc0 00:21:01.550 03:16:03 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:01.550 03:16:03 -- fips/fips.sh@147 -- # bdevperf_pid=2491470 00:21:01.550 03:16:03 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:01.550 03:16:03 -- fips/fips.sh@148 -- # waitforlisten 2491470 /var/tmp/bdevperf.sock 00:21:01.550 03:16:03 -- common/autotest_common.sh@829 -- # '[' -z 2491470 ']' 00:21:01.550 03:16:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:01.550 03:16:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:01.550 03:16:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:01.550 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:01.550 03:16:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:01.550 03:16:03 -- common/autotest_common.sh@10 -- # set +x 00:21:01.550 [2024-11-27 03:16:04.034056] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:01.550 [2024-11-27 03:16:04.034141] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2491470 ] 00:21:01.550 EAL: No free 2048 kB hugepages reported on node 1 00:21:01.550 [2024-11-27 03:16:04.098456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:01.809 [2024-11-27 03:16:04.190586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:02.377 03:16:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:02.377 03:16:04 -- common/autotest_common.sh@862 -- # return 0 00:21:02.377 03:16:04 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:02.637 [2024-11-27 03:16:05.204942] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:02.897 TLSTESTn1 00:21:02.897 03:16:05 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:02.897 Running I/O for 10 seconds... 00:21:12.887 00:21:12.887 Latency(us) 00:21:12.887 [2024-11-27T02:16:15.506Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:12.887 [2024-11-27T02:16:15.506Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:12.887 Verification LBA range: start 0x0 length 0x2000 00:21:12.887 TLSTESTn1 : 10.02 4632.34 18.10 0.00 0.00 27589.38 6650.69 48351.00 00:21:12.887 [2024-11-27T02:16:15.506Z] =================================================================================================================== 00:21:12.887 [2024-11-27T02:16:15.506Z] Total : 4632.34 18.10 0.00 0.00 27589.38 6650.69 48351.00 00:21:12.887 0 00:21:12.887 03:16:15 -- fips/fips.sh@1 -- # cleanup 00:21:12.887 03:16:15 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:12.887 03:16:15 -- common/autotest_common.sh@806 -- # type=--id 00:21:12.887 03:16:15 -- common/autotest_common.sh@807 -- # id=0 00:21:12.887 03:16:15 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:12.887 03:16:15 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:12.887 03:16:15 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:12.887 03:16:15 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:12.887 03:16:15 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:12.887 03:16:15 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:12.887 nvmf_trace.0 00:21:13.146 03:16:15 -- common/autotest_common.sh@821 -- # return 0 00:21:13.146 03:16:15 -- fips/fips.sh@16 -- # killprocess 2491470 00:21:13.146 03:16:15 -- common/autotest_common.sh@936 -- # '[' -z 2491470 ']' 00:21:13.146 03:16:15 -- common/autotest_common.sh@940 -- # kill -0 2491470 00:21:13.146 03:16:15 -- common/autotest_common.sh@941 -- # uname 00:21:13.146 03:16:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:13.146 03:16:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2491470 00:21:13.146 03:16:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:13.146 03:16:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:13.146 03:16:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2491470' 00:21:13.146 killing process with pid 2491470 00:21:13.146 03:16:15 -- common/autotest_common.sh@955 -- # kill 2491470 00:21:13.146 Received shutdown signal, test time was about 10.000000 seconds 00:21:13.146 00:21:13.146 Latency(us) 00:21:13.146 [2024-11-27T02:16:15.765Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:13.146 [2024-11-27T02:16:15.765Z] =================================================================================================================== 00:21:13.146 [2024-11-27T02:16:15.765Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:13.146 03:16:15 -- common/autotest_common.sh@960 -- # wait 2491470 00:21:13.146 03:16:15 -- fips/fips.sh@17 -- # nvmftestfini 00:21:13.146 03:16:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:13.146 03:16:15 -- nvmf/common.sh@116 -- # sync 00:21:13.146 03:16:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:13.146 03:16:15 -- nvmf/common.sh@119 -- # set +e 00:21:13.146 03:16:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:13.146 03:16:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:13.405 rmmod nvme_tcp 00:21:13.405 rmmod nvme_fabrics 00:21:13.405 rmmod nvme_keyring 00:21:13.405 03:16:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:13.405 03:16:15 -- nvmf/common.sh@123 -- # set -e 00:21:13.405 03:16:15 -- nvmf/common.sh@124 -- # return 0 00:21:13.405 03:16:15 -- nvmf/common.sh@477 -- # '[' -n 2491194 ']' 00:21:13.405 03:16:15 -- nvmf/common.sh@478 -- # killprocess 2491194 00:21:13.405 03:16:15 -- common/autotest_common.sh@936 -- # '[' -z 2491194 ']' 00:21:13.405 03:16:15 -- common/autotest_common.sh@940 -- # kill -0 2491194 00:21:13.405 03:16:15 -- common/autotest_common.sh@941 -- # uname 00:21:13.405 03:16:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:13.405 03:16:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2491194 00:21:13.405 03:16:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:13.405 03:16:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:13.405 03:16:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2491194' 00:21:13.405 killing process with pid 2491194 00:21:13.405 03:16:15 -- common/autotest_common.sh@955 -- # kill 2491194 00:21:13.405 03:16:15 -- common/autotest_common.sh@960 -- # wait 2491194 00:21:13.664 03:16:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:13.664 03:16:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:13.664 03:16:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:13.664 03:16:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:13.664 03:16:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:13.664 03:16:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:13.664 03:16:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:13.664 03:16:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:15.571 03:16:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:15.571 03:16:18 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:15.571 00:21:15.571 real 0m18.122s 00:21:15.571 user 0m24.023s 00:21:15.571 sys 0m5.589s 00:21:15.571 03:16:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:15.571 03:16:18 -- common/autotest_common.sh@10 -- # set +x 00:21:15.571 ************************************ 00:21:15.571 END TEST nvmf_fips 00:21:15.571 ************************************ 00:21:15.571 03:16:18 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:15.571 03:16:18 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:15.571 03:16:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:15.571 03:16:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:15.571 03:16:18 -- common/autotest_common.sh@10 -- # set +x 00:21:15.571 ************************************ 00:21:15.571 START TEST nvmf_fuzz 00:21:15.571 ************************************ 00:21:15.571 03:16:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:15.829 * Looking for test storage... 00:21:15.829 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:15.829 03:16:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:15.829 03:16:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:15.829 03:16:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:15.829 03:16:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:15.829 03:16:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:15.829 03:16:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:15.829 03:16:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:15.829 03:16:18 -- scripts/common.sh@335 -- # IFS=.-: 00:21:15.829 03:16:18 -- scripts/common.sh@335 -- # read -ra ver1 00:21:15.829 03:16:18 -- scripts/common.sh@336 -- # IFS=.-: 00:21:15.829 03:16:18 -- scripts/common.sh@336 -- # read -ra ver2 00:21:15.829 03:16:18 -- scripts/common.sh@337 -- # local 'op=<' 00:21:15.829 03:16:18 -- scripts/common.sh@339 -- # ver1_l=2 00:21:15.829 03:16:18 -- scripts/common.sh@340 -- # ver2_l=1 00:21:15.829 03:16:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:15.829 03:16:18 -- scripts/common.sh@343 -- # case "$op" in 00:21:15.829 03:16:18 -- scripts/common.sh@344 -- # : 1 00:21:15.829 03:16:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:15.829 03:16:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:15.829 03:16:18 -- scripts/common.sh@364 -- # decimal 1 00:21:15.829 03:16:18 -- scripts/common.sh@352 -- # local d=1 00:21:15.829 03:16:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:15.829 03:16:18 -- scripts/common.sh@354 -- # echo 1 00:21:15.829 03:16:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:15.829 03:16:18 -- scripts/common.sh@365 -- # decimal 2 00:21:15.829 03:16:18 -- scripts/common.sh@352 -- # local d=2 00:21:15.829 03:16:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:15.829 03:16:18 -- scripts/common.sh@354 -- # echo 2 00:21:15.829 03:16:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:15.829 03:16:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:15.829 03:16:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:15.829 03:16:18 -- scripts/common.sh@367 -- # return 0 00:21:15.829 03:16:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:15.829 03:16:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:15.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:15.829 --rc genhtml_branch_coverage=1 00:21:15.829 --rc genhtml_function_coverage=1 00:21:15.829 --rc genhtml_legend=1 00:21:15.829 --rc geninfo_all_blocks=1 00:21:15.829 --rc geninfo_unexecuted_blocks=1 00:21:15.829 00:21:15.829 ' 00:21:15.829 03:16:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:15.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:15.829 --rc genhtml_branch_coverage=1 00:21:15.829 --rc genhtml_function_coverage=1 00:21:15.829 --rc genhtml_legend=1 00:21:15.829 --rc geninfo_all_blocks=1 00:21:15.829 --rc geninfo_unexecuted_blocks=1 00:21:15.829 00:21:15.829 ' 00:21:15.829 03:16:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:15.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:15.829 --rc genhtml_branch_coverage=1 00:21:15.829 --rc genhtml_function_coverage=1 00:21:15.829 --rc genhtml_legend=1 00:21:15.829 --rc geninfo_all_blocks=1 00:21:15.829 --rc geninfo_unexecuted_blocks=1 00:21:15.829 00:21:15.829 ' 00:21:15.829 03:16:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:15.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:15.829 --rc genhtml_branch_coverage=1 00:21:15.829 --rc genhtml_function_coverage=1 00:21:15.829 --rc genhtml_legend=1 00:21:15.829 --rc geninfo_all_blocks=1 00:21:15.829 --rc geninfo_unexecuted_blocks=1 00:21:15.829 00:21:15.829 ' 00:21:15.829 03:16:18 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:15.829 03:16:18 -- nvmf/common.sh@7 -- # uname -s 00:21:15.829 03:16:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:15.829 03:16:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:15.829 03:16:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:15.829 03:16:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:15.829 03:16:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:15.829 03:16:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:15.830 03:16:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:15.830 03:16:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:15.830 03:16:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:15.830 03:16:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:15.830 03:16:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:15.830 03:16:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:15.830 03:16:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:15.830 03:16:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:15.830 03:16:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:15.830 03:16:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:15.830 03:16:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:15.830 03:16:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:15.830 03:16:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:15.830 03:16:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.830 03:16:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.830 03:16:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.830 03:16:18 -- paths/export.sh@5 -- # export PATH 00:21:15.830 03:16:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.830 03:16:18 -- nvmf/common.sh@46 -- # : 0 00:21:15.830 03:16:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:15.830 03:16:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:15.830 03:16:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:15.830 03:16:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:15.830 03:16:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:15.830 03:16:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:15.830 03:16:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:15.830 03:16:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:15.830 03:16:18 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:15.830 03:16:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:15.830 03:16:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:15.830 03:16:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:15.830 03:16:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:15.830 03:16:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:15.830 03:16:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:15.830 03:16:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:15.830 03:16:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:15.830 03:16:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:15.830 03:16:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:15.830 03:16:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:15.830 03:16:18 -- common/autotest_common.sh@10 -- # set +x 00:21:18.362 03:16:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:18.362 03:16:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:18.362 03:16:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:18.362 03:16:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:18.362 03:16:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:18.362 03:16:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:18.362 03:16:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:18.362 03:16:20 -- nvmf/common.sh@294 -- # net_devs=() 00:21:18.362 03:16:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:18.362 03:16:20 -- nvmf/common.sh@295 -- # e810=() 00:21:18.362 03:16:20 -- nvmf/common.sh@295 -- # local -ga e810 00:21:18.362 03:16:20 -- nvmf/common.sh@296 -- # x722=() 00:21:18.362 03:16:20 -- nvmf/common.sh@296 -- # local -ga x722 00:21:18.362 03:16:20 -- nvmf/common.sh@297 -- # mlx=() 00:21:18.362 03:16:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:18.362 03:16:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:18.362 03:16:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:18.362 03:16:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:18.362 03:16:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:18.362 03:16:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:18.362 03:16:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:18.362 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:18.362 03:16:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:18.362 03:16:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:18.362 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:18.362 03:16:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:18.362 03:16:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:18.362 03:16:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:18.362 03:16:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:18.362 03:16:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:18.362 03:16:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:18.362 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:18.362 03:16:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:18.362 03:16:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:18.362 03:16:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:18.362 03:16:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:18.362 03:16:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:18.362 03:16:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:18.362 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:18.362 03:16:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:18.362 03:16:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:18.362 03:16:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:18.362 03:16:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:18.362 03:16:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:18.362 03:16:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:18.362 03:16:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:18.362 03:16:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:18.362 03:16:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:18.362 03:16:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:18.362 03:16:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:18.362 03:16:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:18.362 03:16:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:18.362 03:16:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:18.362 03:16:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:18.362 03:16:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:18.362 03:16:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:18.362 03:16:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:18.362 03:16:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:18.362 03:16:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:18.363 03:16:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:18.363 03:16:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:18.363 03:16:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:18.363 03:16:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:18.363 03:16:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:18.363 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:18.363 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.202 ms 00:21:18.363 00:21:18.363 --- 10.0.0.2 ping statistics --- 00:21:18.363 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:18.363 rtt min/avg/max/mdev = 0.202/0.202/0.202/0.000 ms 00:21:18.363 03:16:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:18.363 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:18.363 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:21:18.363 00:21:18.363 --- 10.0.0.1 ping statistics --- 00:21:18.363 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:18.363 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:21:18.363 03:16:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:18.363 03:16:20 -- nvmf/common.sh@410 -- # return 0 00:21:18.363 03:16:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:18.363 03:16:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:18.363 03:16:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:18.363 03:16:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:18.363 03:16:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:18.363 03:16:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:18.363 03:16:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:18.363 03:16:20 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2494788 00:21:18.363 03:16:20 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:18.363 03:16:20 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:18.363 03:16:20 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2494788 00:21:18.363 03:16:20 -- common/autotest_common.sh@829 -- # '[' -z 2494788 ']' 00:21:18.363 03:16:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:18.363 03:16:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:18.363 03:16:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:18.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:18.363 03:16:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:18.363 03:16:20 -- common/autotest_common.sh@10 -- # set +x 00:21:19.301 03:16:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:19.301 03:16:21 -- common/autotest_common.sh@862 -- # return 0 00:21:19.301 03:16:21 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:19.301 03:16:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.301 03:16:21 -- common/autotest_common.sh@10 -- # set +x 00:21:19.301 03:16:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.301 03:16:21 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:19.301 03:16:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.301 03:16:21 -- common/autotest_common.sh@10 -- # set +x 00:21:19.301 Malloc0 00:21:19.301 03:16:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.301 03:16:21 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:19.301 03:16:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.301 03:16:21 -- common/autotest_common.sh@10 -- # set +x 00:21:19.301 03:16:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.301 03:16:21 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:19.301 03:16:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.301 03:16:21 -- common/autotest_common.sh@10 -- # set +x 00:21:19.301 03:16:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.301 03:16:21 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:19.301 03:16:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:19.301 03:16:21 -- common/autotest_common.sh@10 -- # set +x 00:21:19.301 03:16:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:19.301 03:16:21 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:19.301 03:16:21 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:21:51.422 Fuzzing completed. Shutting down the fuzz application 00:21:51.422 00:21:51.422 Dumping successful admin opcodes: 00:21:51.422 8, 9, 10, 24, 00:21:51.422 Dumping successful io opcodes: 00:21:51.422 0, 9, 00:21:51.422 NS: 0x200003aeff00 I/O qp, Total commands completed: 475098, total successful commands: 2744, random_seed: 1382593728 00:21:51.422 NS: 0x200003aeff00 admin qp, Total commands completed: 56848, total successful commands: 453, random_seed: 4221545344 00:21:51.422 03:16:52 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:21:51.422 Fuzzing completed. Shutting down the fuzz application 00:21:51.422 00:21:51.422 Dumping successful admin opcodes: 00:21:51.422 24, 00:21:51.422 Dumping successful io opcodes: 00:21:51.422 00:21:51.422 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 129534379 00:21:51.422 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 129655151 00:21:51.422 03:16:53 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:51.422 03:16:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:51.422 03:16:53 -- common/autotest_common.sh@10 -- # set +x 00:21:51.422 03:16:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:51.422 03:16:53 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:21:51.422 03:16:53 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:21:51.422 03:16:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:51.422 03:16:53 -- nvmf/common.sh@116 -- # sync 00:21:51.422 03:16:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:51.422 03:16:53 -- nvmf/common.sh@119 -- # set +e 00:21:51.422 03:16:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:51.422 03:16:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:51.422 rmmod nvme_tcp 00:21:51.422 rmmod nvme_fabrics 00:21:51.422 rmmod nvme_keyring 00:21:51.422 03:16:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:51.422 03:16:53 -- nvmf/common.sh@123 -- # set -e 00:21:51.422 03:16:53 -- nvmf/common.sh@124 -- # return 0 00:21:51.422 03:16:53 -- nvmf/common.sh@477 -- # '[' -n 2494788 ']' 00:21:51.422 03:16:53 -- nvmf/common.sh@478 -- # killprocess 2494788 00:21:51.422 03:16:53 -- common/autotest_common.sh@936 -- # '[' -z 2494788 ']' 00:21:51.422 03:16:53 -- common/autotest_common.sh@940 -- # kill -0 2494788 00:21:51.422 03:16:53 -- common/autotest_common.sh@941 -- # uname 00:21:51.422 03:16:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:51.422 03:16:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2494788 00:21:51.422 03:16:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:51.422 03:16:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:51.422 03:16:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2494788' 00:21:51.422 killing process with pid 2494788 00:21:51.422 03:16:53 -- common/autotest_common.sh@955 -- # kill 2494788 00:21:51.422 03:16:53 -- common/autotest_common.sh@960 -- # wait 2494788 00:21:51.422 03:16:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:51.422 03:16:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:51.422 03:16:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:51.422 03:16:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:51.422 03:16:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:51.422 03:16:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:51.422 03:16:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:51.422 03:16:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:53.330 03:16:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:53.330 03:16:55 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:21:53.330 00:21:53.330 real 0m37.793s 00:21:53.330 user 0m52.544s 00:21:53.330 sys 0m14.375s 00:21:53.330 03:16:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:53.330 03:16:55 -- common/autotest_common.sh@10 -- # set +x 00:21:53.330 ************************************ 00:21:53.330 END TEST nvmf_fuzz 00:21:53.330 ************************************ 00:21:53.589 03:16:55 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:53.589 03:16:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:53.589 03:16:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:53.589 03:16:55 -- common/autotest_common.sh@10 -- # set +x 00:21:53.589 ************************************ 00:21:53.589 START TEST nvmf_multiconnection 00:21:53.589 ************************************ 00:21:53.589 03:16:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:21:53.589 * Looking for test storage... 00:21:53.589 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:53.589 03:16:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:53.589 03:16:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:53.589 03:16:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:53.589 03:16:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:53.589 03:16:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:53.589 03:16:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:53.589 03:16:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:53.589 03:16:56 -- scripts/common.sh@335 -- # IFS=.-: 00:21:53.589 03:16:56 -- scripts/common.sh@335 -- # read -ra ver1 00:21:53.589 03:16:56 -- scripts/common.sh@336 -- # IFS=.-: 00:21:53.589 03:16:56 -- scripts/common.sh@336 -- # read -ra ver2 00:21:53.589 03:16:56 -- scripts/common.sh@337 -- # local 'op=<' 00:21:53.589 03:16:56 -- scripts/common.sh@339 -- # ver1_l=2 00:21:53.589 03:16:56 -- scripts/common.sh@340 -- # ver2_l=1 00:21:53.589 03:16:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:53.589 03:16:56 -- scripts/common.sh@343 -- # case "$op" in 00:21:53.589 03:16:56 -- scripts/common.sh@344 -- # : 1 00:21:53.589 03:16:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:53.589 03:16:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:53.589 03:16:56 -- scripts/common.sh@364 -- # decimal 1 00:21:53.589 03:16:56 -- scripts/common.sh@352 -- # local d=1 00:21:53.589 03:16:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:53.589 03:16:56 -- scripts/common.sh@354 -- # echo 1 00:21:53.589 03:16:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:53.589 03:16:56 -- scripts/common.sh@365 -- # decimal 2 00:21:53.589 03:16:56 -- scripts/common.sh@352 -- # local d=2 00:21:53.589 03:16:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:53.589 03:16:56 -- scripts/common.sh@354 -- # echo 2 00:21:53.589 03:16:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:53.589 03:16:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:53.589 03:16:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:53.589 03:16:56 -- scripts/common.sh@367 -- # return 0 00:21:53.589 03:16:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:53.589 03:16:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:53.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:53.589 --rc genhtml_branch_coverage=1 00:21:53.589 --rc genhtml_function_coverage=1 00:21:53.589 --rc genhtml_legend=1 00:21:53.589 --rc geninfo_all_blocks=1 00:21:53.589 --rc geninfo_unexecuted_blocks=1 00:21:53.589 00:21:53.589 ' 00:21:53.589 03:16:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:53.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:53.589 --rc genhtml_branch_coverage=1 00:21:53.589 --rc genhtml_function_coverage=1 00:21:53.589 --rc genhtml_legend=1 00:21:53.589 --rc geninfo_all_blocks=1 00:21:53.589 --rc geninfo_unexecuted_blocks=1 00:21:53.589 00:21:53.589 ' 00:21:53.589 03:16:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:53.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:53.589 --rc genhtml_branch_coverage=1 00:21:53.589 --rc genhtml_function_coverage=1 00:21:53.589 --rc genhtml_legend=1 00:21:53.589 --rc geninfo_all_blocks=1 00:21:53.589 --rc geninfo_unexecuted_blocks=1 00:21:53.589 00:21:53.589 ' 00:21:53.589 03:16:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:53.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:53.589 --rc genhtml_branch_coverage=1 00:21:53.589 --rc genhtml_function_coverage=1 00:21:53.589 --rc genhtml_legend=1 00:21:53.589 --rc geninfo_all_blocks=1 00:21:53.589 --rc geninfo_unexecuted_blocks=1 00:21:53.589 00:21:53.589 ' 00:21:53.589 03:16:56 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:53.589 03:16:56 -- nvmf/common.sh@7 -- # uname -s 00:21:53.590 03:16:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:53.590 03:16:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:53.590 03:16:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:53.590 03:16:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:53.590 03:16:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:53.590 03:16:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:53.590 03:16:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:53.590 03:16:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:53.590 03:16:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:53.590 03:16:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:53.590 03:16:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.590 03:16:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:53.590 03:16:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:53.590 03:16:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:53.590 03:16:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:53.590 03:16:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:53.590 03:16:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:53.590 03:16:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:53.590 03:16:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:53.590 03:16:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.590 03:16:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.590 03:16:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.590 03:16:56 -- paths/export.sh@5 -- # export PATH 00:21:53.590 03:16:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:53.590 03:16:56 -- nvmf/common.sh@46 -- # : 0 00:21:53.590 03:16:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:53.590 03:16:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:53.590 03:16:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:53.590 03:16:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:53.590 03:16:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:53.590 03:16:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:53.590 03:16:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:53.590 03:16:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:53.590 03:16:56 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:53.590 03:16:56 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:53.590 03:16:56 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:21:53.590 03:16:56 -- target/multiconnection.sh@16 -- # nvmftestinit 00:21:53.590 03:16:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:53.590 03:16:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:53.590 03:16:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:53.590 03:16:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:53.590 03:16:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:53.590 03:16:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:53.590 03:16:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:53.590 03:16:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:53.590 03:16:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:53.590 03:16:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:53.590 03:16:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:53.590 03:16:56 -- common/autotest_common.sh@10 -- # set +x 00:21:55.504 03:16:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:55.504 03:16:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:55.504 03:16:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:55.504 03:16:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:55.505 03:16:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:55.505 03:16:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:55.505 03:16:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:55.505 03:16:58 -- nvmf/common.sh@294 -- # net_devs=() 00:21:55.505 03:16:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:55.505 03:16:58 -- nvmf/common.sh@295 -- # e810=() 00:21:55.505 03:16:58 -- nvmf/common.sh@295 -- # local -ga e810 00:21:55.505 03:16:58 -- nvmf/common.sh@296 -- # x722=() 00:21:55.505 03:16:58 -- nvmf/common.sh@296 -- # local -ga x722 00:21:55.505 03:16:58 -- nvmf/common.sh@297 -- # mlx=() 00:21:55.505 03:16:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:55.505 03:16:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:55.505 03:16:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:55.505 03:16:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:55.505 03:16:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:55.505 03:16:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.505 03:16:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:55.505 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:55.505 03:16:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:55.505 03:16:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:55.505 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:55.505 03:16:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:55.505 03:16:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.505 03:16:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.505 03:16:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.505 03:16:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.505 03:16:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:55.505 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:55.505 03:16:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.505 03:16:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:55.505 03:16:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:55.505 03:16:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:55.505 03:16:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:55.505 03:16:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:55.505 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:55.505 03:16:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:55.505 03:16:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:55.505 03:16:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:55.505 03:16:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:55.505 03:16:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:55.505 03:16:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:55.505 03:16:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:55.505 03:16:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:55.505 03:16:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:55.505 03:16:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:55.505 03:16:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:55.505 03:16:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:55.505 03:16:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:55.505 03:16:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:55.505 03:16:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:55.505 03:16:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:55.505 03:16:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:55.505 03:16:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:55.764 03:16:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:55.764 03:16:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:55.764 03:16:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:55.764 03:16:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:55.764 03:16:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:55.764 03:16:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:55.764 03:16:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:55.764 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:55.764 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.220 ms 00:21:55.764 00:21:55.764 --- 10.0.0.2 ping statistics --- 00:21:55.764 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:55.764 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:21:55.764 03:16:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:55.764 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:55.764 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:21:55.764 00:21:55.764 --- 10.0.0.1 ping statistics --- 00:21:55.764 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:55.764 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:21:55.764 03:16:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:55.764 03:16:58 -- nvmf/common.sh@410 -- # return 0 00:21:55.764 03:16:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:55.764 03:16:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:55.764 03:16:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:55.764 03:16:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:55.764 03:16:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:55.764 03:16:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:55.764 03:16:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:55.764 03:16:58 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:21:55.764 03:16:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:55.764 03:16:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:55.764 03:16:58 -- common/autotest_common.sh@10 -- # set +x 00:21:55.764 03:16:58 -- nvmf/common.sh@469 -- # nvmfpid=2500771 00:21:55.764 03:16:58 -- nvmf/common.sh@470 -- # waitforlisten 2500771 00:21:55.764 03:16:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:55.764 03:16:58 -- common/autotest_common.sh@829 -- # '[' -z 2500771 ']' 00:21:55.764 03:16:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:55.764 03:16:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:55.764 03:16:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:55.764 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:55.764 03:16:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:55.764 03:16:58 -- common/autotest_common.sh@10 -- # set +x 00:21:55.764 [2024-11-27 03:16:58.304133] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:55.764 [2024-11-27 03:16:58.304218] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:55.764 EAL: No free 2048 kB hugepages reported on node 1 00:21:55.764 [2024-11-27 03:16:58.375946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:56.022 [2024-11-27 03:16:58.470444] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:56.022 [2024-11-27 03:16:58.470634] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:56.022 [2024-11-27 03:16:58.470657] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:56.022 [2024-11-27 03:16:58.470672] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:56.022 [2024-11-27 03:16:58.470752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:56.022 [2024-11-27 03:16:58.470810] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:56.022 [2024-11-27 03:16:58.470865] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:56.022 [2024-11-27 03:16:58.470868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:56.959 03:16:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:56.959 03:16:59 -- common/autotest_common.sh@862 -- # return 0 00:21:56.959 03:16:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:56.959 03:16:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:56.959 03:16:59 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 [2024-11-27 03:16:59.274078] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@21 -- # seq 1 11 00:21:56.959 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:56.959 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 Malloc1 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 [2024-11-27 03:16:59.330217] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:56.959 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 Malloc2 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:56.959 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 Malloc3 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:56.959 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 Malloc4 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:56.959 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 Malloc5 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:56.959 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 Malloc6 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:56.959 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:56.959 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:21:56.959 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:56.959 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.218 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.218 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.218 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:21:57.218 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.218 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.218 Malloc7 00:21:57.218 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.218 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:21:57.218 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.218 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.218 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.218 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:21:57.218 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.218 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.218 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.218 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:21:57.218 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.218 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.218 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.218 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.218 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:21:57.218 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.218 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.218 Malloc8 00:21:57.218 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.218 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:21:57.218 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.218 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.218 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.218 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:21:57.218 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.218 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.219 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 Malloc9 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.219 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 Malloc10 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.219 03:16:59 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 Malloc11 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:21:57.219 03:16:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.219 03:16:59 -- common/autotest_common.sh@10 -- # set +x 00:21:57.219 03:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.219 03:16:59 -- target/multiconnection.sh@28 -- # seq 1 11 00:21:57.219 03:16:59 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:57.219 03:16:59 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:21:58.155 03:17:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:21:58.155 03:17:00 -- common/autotest_common.sh@1187 -- # local i=0 00:21:58.155 03:17:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:58.155 03:17:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:58.155 03:17:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:00.059 03:17:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:00.060 03:17:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:00.060 03:17:02 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:00.060 03:17:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:00.060 03:17:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:00.060 03:17:02 -- common/autotest_common.sh@1197 -- # return 0 00:22:00.060 03:17:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:00.060 03:17:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:00.630 03:17:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:00.630 03:17:03 -- common/autotest_common.sh@1187 -- # local i=0 00:22:00.630 03:17:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:00.630 03:17:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:00.630 03:17:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:02.537 03:17:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:02.537 03:17:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:02.537 03:17:05 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:02.537 03:17:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:02.537 03:17:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:02.537 03:17:05 -- common/autotest_common.sh@1197 -- # return 0 00:22:02.537 03:17:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:02.537 03:17:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:03.473 03:17:05 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:03.473 03:17:05 -- common/autotest_common.sh@1187 -- # local i=0 00:22:03.473 03:17:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:03.473 03:17:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:03.473 03:17:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:05.378 03:17:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:05.378 03:17:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:05.378 03:17:07 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:05.378 03:17:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:05.378 03:17:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:05.378 03:17:07 -- common/autotest_common.sh@1197 -- # return 0 00:22:05.378 03:17:07 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:05.379 03:17:07 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:05.949 03:17:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:05.949 03:17:08 -- common/autotest_common.sh@1187 -- # local i=0 00:22:05.949 03:17:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:05.949 03:17:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:05.949 03:17:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:08.485 03:17:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:08.485 03:17:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:08.485 03:17:10 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:08.485 03:17:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:08.485 03:17:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:08.485 03:17:10 -- common/autotest_common.sh@1197 -- # return 0 00:22:08.485 03:17:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:08.485 03:17:10 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:08.745 03:17:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:08.745 03:17:11 -- common/autotest_common.sh@1187 -- # local i=0 00:22:08.745 03:17:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:08.745 03:17:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:08.745 03:17:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:10.650 03:17:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:10.650 03:17:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:10.650 03:17:13 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:10.650 03:17:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:10.650 03:17:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:10.650 03:17:13 -- common/autotest_common.sh@1197 -- # return 0 00:22:10.650 03:17:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:10.650 03:17:13 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:11.586 03:17:13 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:11.586 03:17:13 -- common/autotest_common.sh@1187 -- # local i=0 00:22:11.587 03:17:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:11.587 03:17:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:11.587 03:17:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:13.493 03:17:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:13.493 03:17:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:13.493 03:17:15 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:13.493 03:17:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:13.493 03:17:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:13.493 03:17:15 -- common/autotest_common.sh@1197 -- # return 0 00:22:13.493 03:17:15 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:13.493 03:17:15 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:14.429 03:17:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:14.429 03:17:16 -- common/autotest_common.sh@1187 -- # local i=0 00:22:14.429 03:17:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:14.429 03:17:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:14.429 03:17:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:16.332 03:17:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:16.332 03:17:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:16.332 03:17:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:16.332 03:17:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:16.332 03:17:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:16.332 03:17:18 -- common/autotest_common.sh@1197 -- # return 0 00:22:16.332 03:17:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:16.332 03:17:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:17.270 03:17:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:17.270 03:17:19 -- common/autotest_common.sh@1187 -- # local i=0 00:22:17.270 03:17:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:17.270 03:17:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:17.270 03:17:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:19.219 03:17:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:19.219 03:17:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:19.219 03:17:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:19.219 03:17:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:19.219 03:17:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:19.219 03:17:21 -- common/autotest_common.sh@1197 -- # return 0 00:22:19.219 03:17:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:19.219 03:17:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:20.181 03:17:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:20.181 03:17:22 -- common/autotest_common.sh@1187 -- # local i=0 00:22:20.181 03:17:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:20.181 03:17:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:20.181 03:17:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:22.090 03:17:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:22.090 03:17:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:22.090 03:17:24 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:22.090 03:17:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:22.090 03:17:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:22.090 03:17:24 -- common/autotest_common.sh@1197 -- # return 0 00:22:22.090 03:17:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:22.090 03:17:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:23.027 03:17:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:23.027 03:17:25 -- common/autotest_common.sh@1187 -- # local i=0 00:22:23.027 03:17:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:23.027 03:17:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:23.027 03:17:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:24.934 03:17:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:24.934 03:17:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:24.934 03:17:27 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:24.934 03:17:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:24.934 03:17:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:24.934 03:17:27 -- common/autotest_common.sh@1197 -- # return 0 00:22:24.934 03:17:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:24.934 03:17:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:25.874 03:17:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:25.874 03:17:28 -- common/autotest_common.sh@1187 -- # local i=0 00:22:25.874 03:17:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:25.874 03:17:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:25.874 03:17:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:27.776 03:17:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:27.777 03:17:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:27.777 03:17:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:27.777 03:17:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:27.777 03:17:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:27.777 03:17:30 -- common/autotest_common.sh@1197 -- # return 0 00:22:27.777 03:17:30 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:27.777 [global] 00:22:27.777 thread=1 00:22:27.777 invalidate=1 00:22:27.777 rw=read 00:22:27.777 time_based=1 00:22:27.777 runtime=10 00:22:27.777 ioengine=libaio 00:22:27.777 direct=1 00:22:27.777 bs=262144 00:22:27.777 iodepth=64 00:22:27.777 norandommap=1 00:22:27.777 numjobs=1 00:22:27.777 00:22:27.777 [job0] 00:22:27.777 filename=/dev/nvme0n1 00:22:27.777 [job1] 00:22:27.777 filename=/dev/nvme10n1 00:22:27.777 [job2] 00:22:27.777 filename=/dev/nvme1n1 00:22:27.777 [job3] 00:22:27.777 filename=/dev/nvme2n1 00:22:28.035 [job4] 00:22:28.035 filename=/dev/nvme3n1 00:22:28.035 [job5] 00:22:28.035 filename=/dev/nvme4n1 00:22:28.035 [job6] 00:22:28.035 filename=/dev/nvme5n1 00:22:28.035 [job7] 00:22:28.035 filename=/dev/nvme6n1 00:22:28.035 [job8] 00:22:28.035 filename=/dev/nvme7n1 00:22:28.035 [job9] 00:22:28.035 filename=/dev/nvme8n1 00:22:28.035 [job10] 00:22:28.035 filename=/dev/nvme9n1 00:22:28.035 Could not set queue depth (nvme0n1) 00:22:28.035 Could not set queue depth (nvme10n1) 00:22:28.035 Could not set queue depth (nvme1n1) 00:22:28.035 Could not set queue depth (nvme2n1) 00:22:28.035 Could not set queue depth (nvme3n1) 00:22:28.035 Could not set queue depth (nvme4n1) 00:22:28.035 Could not set queue depth (nvme5n1) 00:22:28.035 Could not set queue depth (nvme6n1) 00:22:28.035 Could not set queue depth (nvme7n1) 00:22:28.035 Could not set queue depth (nvme8n1) 00:22:28.035 Could not set queue depth (nvme9n1) 00:22:28.300 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:28.300 fio-3.35 00:22:28.300 Starting 11 threads 00:22:40.501 00:22:40.501 job0: (groupid=0, jobs=1): err= 0: pid=2505163: Wed Nov 27 03:17:41 2024 00:22:40.501 read: IOPS=723, BW=181MiB/s (190MB/s)(1822MiB/10073msec) 00:22:40.501 slat (usec): min=10, max=75173, avg=1035.10, stdev=3632.82 00:22:40.501 clat (msec): min=3, max=220, avg=87.34, stdev=37.61 00:22:40.501 lat (msec): min=5, max=221, avg=88.38, stdev=38.12 00:22:40.501 clat percentiles (msec): 00:22:40.501 | 1.00th=[ 13], 5.00th=[ 31], 10.00th=[ 39], 20.00th=[ 54], 00:22:40.501 | 30.00th=[ 64], 40.00th=[ 73], 50.00th=[ 84], 60.00th=[ 99], 00:22:40.501 | 70.00th=[ 111], 80.00th=[ 123], 90.00th=[ 136], 95.00th=[ 150], 00:22:40.501 | 99.00th=[ 174], 99.50th=[ 182], 99.90th=[ 197], 99.95th=[ 207], 00:22:40.501 | 99.99th=[ 222] 00:22:40.501 bw ( KiB/s): min=120832, max=316416, per=8.70%, avg=184985.60, stdev=59406.19, samples=20 00:22:40.501 iops : min= 472, max= 1236, avg=722.60, stdev=232.06, samples=20 00:22:40.501 lat (msec) : 4=0.01%, 10=0.66%, 20=1.34%, 50=14.71%, 100=44.45% 00:22:40.501 lat (msec) : 250=38.83% 00:22:40.501 cpu : usr=0.40%, sys=2.20%, ctx=1618, majf=0, minf=4097 00:22:40.501 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:22:40.501 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.501 issued rwts: total=7289,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.501 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.501 job1: (groupid=0, jobs=1): err= 0: pid=2505170: Wed Nov 27 03:17:41 2024 00:22:40.501 read: IOPS=786, BW=197MiB/s (206MB/s)(1982MiB/10077msec) 00:22:40.501 slat (usec): min=8, max=101909, avg=884.13, stdev=3888.64 00:22:40.501 clat (usec): min=1376, max=234360, avg=80420.61, stdev=45034.07 00:22:40.501 lat (usec): min=1408, max=256208, avg=81304.74, stdev=45596.06 00:22:40.501 clat percentiles (msec): 00:22:40.501 | 1.00th=[ 6], 5.00th=[ 16], 10.00th=[ 27], 20.00th=[ 34], 00:22:40.501 | 30.00th=[ 49], 40.00th=[ 63], 50.00th=[ 80], 60.00th=[ 94], 00:22:40.501 | 70.00th=[ 107], 80.00th=[ 120], 90.00th=[ 142], 95.00th=[ 157], 00:22:40.501 | 99.00th=[ 194], 99.50th=[ 205], 99.90th=[ 224], 99.95th=[ 224], 00:22:40.501 | 99.99th=[ 234] 00:22:40.501 bw ( KiB/s): min=116224, max=539136, per=9.47%, avg=201292.80, stdev=99762.55, samples=20 00:22:40.501 iops : min= 454, max= 2106, avg=786.30, stdev=389.70, samples=20 00:22:40.501 lat (msec) : 2=0.04%, 4=0.25%, 10=2.13%, 20=4.29%, 50=24.00% 00:22:40.501 lat (msec) : 100=33.67%, 250=35.62% 00:22:40.501 cpu : usr=0.42%, sys=2.06%, ctx=1762, majf=0, minf=4097 00:22:40.501 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:40.501 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.501 issued rwts: total=7926,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.501 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.501 job2: (groupid=0, jobs=1): err= 0: pid=2505173: Wed Nov 27 03:17:41 2024 00:22:40.501 read: IOPS=662, BW=166MiB/s (174MB/s)(1668MiB/10064msec) 00:22:40.501 slat (usec): min=9, max=108199, avg=1103.23, stdev=4336.62 00:22:40.501 clat (msec): min=2, max=211, avg=95.39, stdev=39.56 00:22:40.501 lat (msec): min=2, max=294, avg=96.49, stdev=40.19 00:22:40.501 clat percentiles (msec): 00:22:40.501 | 1.00th=[ 10], 5.00th=[ 27], 10.00th=[ 43], 20.00th=[ 63], 00:22:40.501 | 30.00th=[ 73], 40.00th=[ 86], 50.00th=[ 97], 60.00th=[ 107], 00:22:40.501 | 70.00th=[ 118], 80.00th=[ 129], 90.00th=[ 142], 95.00th=[ 161], 00:22:40.501 | 99.00th=[ 192], 99.50th=[ 201], 99.90th=[ 207], 99.95th=[ 209], 00:22:40.501 | 99.99th=[ 211] 00:22:40.501 bw ( KiB/s): min=101888, max=257536, per=7.96%, avg=169153.00, stdev=41787.79, samples=20 00:22:40.501 iops : min= 398, max= 1006, avg=660.75, stdev=163.24, samples=20 00:22:40.501 lat (msec) : 4=0.07%, 10=0.94%, 20=2.58%, 50=9.33%, 100=39.78% 00:22:40.501 lat (msec) : 250=47.30% 00:22:40.501 cpu : usr=0.38%, sys=1.90%, ctx=1483, majf=0, minf=4097 00:22:40.501 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:40.501 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.501 issued rwts: total=6670,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.501 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.501 job3: (groupid=0, jobs=1): err= 0: pid=2505174: Wed Nov 27 03:17:41 2024 00:22:40.501 read: IOPS=685, BW=171MiB/s (180MB/s)(1726MiB/10067msec) 00:22:40.501 slat (usec): min=9, max=95197, avg=1058.38, stdev=3742.90 00:22:40.501 clat (msec): min=6, max=241, avg=92.20, stdev=35.37 00:22:40.501 lat (msec): min=6, max=270, avg=93.25, stdev=35.93 00:22:40.501 clat percentiles (msec): 00:22:40.501 | 1.00th=[ 17], 5.00th=[ 31], 10.00th=[ 50], 20.00th=[ 64], 00:22:40.501 | 30.00th=[ 72], 40.00th=[ 82], 50.00th=[ 90], 60.00th=[ 102], 00:22:40.501 | 70.00th=[ 111], 80.00th=[ 123], 90.00th=[ 138], 95.00th=[ 153], 00:22:40.501 | 99.00th=[ 178], 99.50th=[ 182], 99.90th=[ 190], 99.95th=[ 194], 00:22:40.501 | 99.99th=[ 243] 00:22:40.501 bw ( KiB/s): min=124928, max=248832, per=8.24%, avg=175104.00, stdev=35496.90, samples=20 00:22:40.501 iops : min= 488, max= 972, avg=684.00, stdev=138.66, samples=20 00:22:40.501 lat (msec) : 10=0.22%, 20=1.12%, 50=8.78%, 100=49.05%, 250=40.84% 00:22:40.501 cpu : usr=0.37%, sys=2.22%, ctx=1553, majf=0, minf=3727 00:22:40.501 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:40.501 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.501 issued rwts: total=6903,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.501 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.501 job4: (groupid=0, jobs=1): err= 0: pid=2505175: Wed Nov 27 03:17:41 2024 00:22:40.501 read: IOPS=770, BW=193MiB/s (202MB/s)(1941MiB/10073msec) 00:22:40.501 slat (usec): min=9, max=65420, avg=1008.92, stdev=3535.79 00:22:40.501 clat (usec): min=574, max=228422, avg=81957.78, stdev=41235.38 00:22:40.501 lat (usec): min=594, max=252077, avg=82966.70, stdev=41753.26 00:22:40.501 clat percentiles (msec): 00:22:40.501 | 1.00th=[ 11], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 47], 00:22:40.501 | 30.00th=[ 57], 40.00th=[ 64], 50.00th=[ 74], 60.00th=[ 87], 00:22:40.501 | 70.00th=[ 103], 80.00th=[ 121], 90.00th=[ 140], 95.00th=[ 161], 00:22:40.501 | 99.00th=[ 184], 99.50th=[ 192], 99.90th=[ 211], 99.95th=[ 228], 00:22:40.501 | 99.99th=[ 228] 00:22:40.501 bw ( KiB/s): min=102912, max=366592, per=9.28%, avg=197167.20, stdev=72389.06, samples=20 00:22:40.501 iops : min= 402, max= 1432, avg=770.15, stdev=282.76, samples=20 00:22:40.501 lat (usec) : 750=0.01%, 1000=0.01% 00:22:40.501 lat (msec) : 2=0.01%, 4=0.19%, 10=0.71%, 20=1.78%, 50=19.18% 00:22:40.501 lat (msec) : 100=47.04%, 250=31.07% 00:22:40.501 cpu : usr=0.56%, sys=2.26%, ctx=1682, majf=0, minf=4097 00:22:40.501 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:40.501 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.501 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.501 issued rwts: total=7764,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.501 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.501 job5: (groupid=0, jobs=1): err= 0: pid=2505178: Wed Nov 27 03:17:41 2024 00:22:40.501 read: IOPS=684, BW=171MiB/s (179MB/s)(1725MiB/10076msec) 00:22:40.501 slat (usec): min=10, max=106571, avg=1205.09, stdev=4003.11 00:22:40.501 clat (msec): min=3, max=224, avg=92.19, stdev=38.51 00:22:40.501 lat (msec): min=3, max=236, avg=93.40, stdev=39.13 00:22:40.502 clat percentiles (msec): 00:22:40.502 | 1.00th=[ 15], 5.00th=[ 32], 10.00th=[ 46], 20.00th=[ 58], 00:22:40.502 | 30.00th=[ 68], 40.00th=[ 81], 50.00th=[ 91], 60.00th=[ 101], 00:22:40.502 | 70.00th=[ 114], 80.00th=[ 127], 90.00th=[ 140], 95.00th=[ 159], 00:22:40.502 | 99.00th=[ 186], 99.50th=[ 190], 99.90th=[ 201], 99.95th=[ 203], 00:22:40.502 | 99.99th=[ 226] 00:22:40.502 bw ( KiB/s): min=100352, max=289280, per=8.23%, avg=174993.20, stdev=50787.72, samples=20 00:22:40.502 iops : min= 392, max= 1130, avg=683.55, stdev=198.39, samples=20 00:22:40.502 lat (msec) : 4=0.06%, 10=0.49%, 20=1.75%, 50=11.44%, 100=45.90% 00:22:40.502 lat (msec) : 250=40.36% 00:22:40.502 cpu : usr=0.42%, sys=2.25%, ctx=1500, majf=0, minf=4097 00:22:40.502 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:40.502 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.502 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.502 issued rwts: total=6898,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.502 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.502 job6: (groupid=0, jobs=1): err= 0: pid=2505179: Wed Nov 27 03:17:41 2024 00:22:40.502 read: IOPS=820, BW=205MiB/s (215MB/s)(2065MiB/10064msec) 00:22:40.502 slat (usec): min=13, max=61711, avg=1124.15, stdev=3422.57 00:22:40.502 clat (usec): min=1271, max=196115, avg=76810.99, stdev=36323.10 00:22:40.502 lat (usec): min=1319, max=213922, avg=77935.14, stdev=36907.86 00:22:40.502 clat percentiles (msec): 00:22:40.502 | 1.00th=[ 13], 5.00th=[ 30], 10.00th=[ 32], 20.00th=[ 36], 00:22:40.502 | 30.00th=[ 56], 40.00th=[ 66], 50.00th=[ 74], 60.00th=[ 83], 00:22:40.502 | 70.00th=[ 94], 80.00th=[ 112], 90.00th=[ 129], 95.00th=[ 140], 00:22:40.502 | 99.00th=[ 165], 99.50th=[ 169], 99.90th=[ 182], 99.95th=[ 188], 00:22:40.502 | 99.99th=[ 197] 00:22:40.502 bw ( KiB/s): min=121856, max=473600, per=9.87%, avg=209792.00, stdev=98334.29, samples=20 00:22:40.502 iops : min= 476, max= 1850, avg=819.50, stdev=384.12, samples=20 00:22:40.502 lat (msec) : 2=0.10%, 4=0.38%, 10=0.35%, 20=0.78%, 50=24.92% 00:22:40.502 lat (msec) : 100=47.23%, 250=26.25% 00:22:40.502 cpu : usr=0.59%, sys=2.71%, ctx=1620, majf=0, minf=4098 00:22:40.502 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:40.502 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.502 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.502 issued rwts: total=8258,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.502 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.502 job7: (groupid=0, jobs=1): err= 0: pid=2505180: Wed Nov 27 03:17:41 2024 00:22:40.502 read: IOPS=644, BW=161MiB/s (169MB/s)(1622MiB/10071msec) 00:22:40.502 slat (usec): min=9, max=85610, avg=1019.76, stdev=3922.25 00:22:40.502 clat (msec): min=8, max=255, avg=98.26, stdev=37.82 00:22:40.502 lat (msec): min=8, max=255, avg=99.28, stdev=38.42 00:22:40.502 clat percentiles (msec): 00:22:40.502 | 1.00th=[ 20], 5.00th=[ 37], 10.00th=[ 45], 20.00th=[ 63], 00:22:40.502 | 30.00th=[ 79], 40.00th=[ 90], 50.00th=[ 101], 60.00th=[ 110], 00:22:40.502 | 70.00th=[ 122], 80.00th=[ 131], 90.00th=[ 146], 95.00th=[ 161], 00:22:40.502 | 99.00th=[ 182], 99.50th=[ 188], 99.90th=[ 194], 99.95th=[ 194], 00:22:40.502 | 99.99th=[ 257] 00:22:40.502 bw ( KiB/s): min=110592, max=246272, per=7.74%, avg=164442.05, stdev=40575.62, samples=20 00:22:40.502 iops : min= 432, max= 962, avg=642.45, stdev=158.46, samples=20 00:22:40.502 lat (msec) : 10=0.05%, 20=1.03%, 50=11.93%, 100=37.04%, 250=49.93% 00:22:40.502 lat (msec) : 500=0.02% 00:22:40.502 cpu : usr=0.28%, sys=1.71%, ctx=1597, majf=0, minf=4097 00:22:40.502 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:40.502 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.502 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.502 issued rwts: total=6487,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.502 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.502 job8: (groupid=0, jobs=1): err= 0: pid=2505181: Wed Nov 27 03:17:41 2024 00:22:40.502 read: IOPS=701, BW=175MiB/s (184MB/s)(1768MiB/10075msec) 00:22:40.502 slat (usec): min=9, max=132260, avg=1031.90, stdev=4165.53 00:22:40.502 clat (msec): min=6, max=214, avg=90.07, stdev=39.01 00:22:40.502 lat (msec): min=6, max=301, avg=91.10, stdev=39.56 00:22:40.502 clat percentiles (msec): 00:22:40.502 | 1.00th=[ 15], 5.00th=[ 33], 10.00th=[ 41], 20.00th=[ 56], 00:22:40.502 | 30.00th=[ 68], 40.00th=[ 78], 50.00th=[ 86], 60.00th=[ 96], 00:22:40.502 | 70.00th=[ 112], 80.00th=[ 126], 90.00th=[ 142], 95.00th=[ 157], 00:22:40.502 | 99.00th=[ 192], 99.50th=[ 199], 99.90th=[ 209], 99.95th=[ 211], 00:22:40.502 | 99.99th=[ 215] 00:22:40.502 bw ( KiB/s): min=95744, max=296448, per=8.44%, avg=179430.40, stdev=50035.97, samples=20 00:22:40.502 iops : min= 374, max= 1158, avg=700.90, stdev=195.45, samples=20 00:22:40.502 lat (msec) : 10=0.34%, 20=1.20%, 50=14.72%, 100=45.94%, 250=37.80% 00:22:40.502 cpu : usr=0.35%, sys=2.20%, ctx=1626, majf=0, minf=4097 00:22:40.502 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:40.502 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.502 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.502 issued rwts: total=7072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.502 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.502 job9: (groupid=0, jobs=1): err= 0: pid=2505186: Wed Nov 27 03:17:41 2024 00:22:40.502 read: IOPS=966, BW=242MiB/s (253MB/s)(2445MiB/10114msec) 00:22:40.502 slat (usec): min=13, max=57087, avg=864.85, stdev=2941.26 00:22:40.502 clat (usec): min=1595, max=276264, avg=65258.28, stdev=41632.33 00:22:40.502 lat (usec): min=1658, max=276282, avg=66123.13, stdev=42185.38 00:22:40.502 clat percentiles (msec): 00:22:40.502 | 1.00th=[ 7], 5.00th=[ 20], 10.00th=[ 29], 20.00th=[ 32], 00:22:40.502 | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 52], 60.00th=[ 67], 00:22:40.502 | 70.00th=[ 88], 80.00th=[ 106], 90.00th=[ 123], 95.00th=[ 142], 00:22:40.502 | 99.00th=[ 182], 99.50th=[ 192], 99.90th=[ 275], 99.95th=[ 275], 00:22:40.502 | 99.99th=[ 275] 00:22:40.502 bw ( KiB/s): min=105984, max=443904, per=11.71%, avg=248755.20, stdev=105206.02, samples=20 00:22:40.502 iops : min= 414, max= 1734, avg=971.70, stdev=410.96, samples=20 00:22:40.502 lat (msec) : 2=0.03%, 4=0.57%, 10=1.51%, 20=2.89%, 50=44.08% 00:22:40.502 lat (msec) : 100=27.63%, 250=23.10%, 500=0.18% 00:22:40.502 cpu : usr=0.62%, sys=3.13%, ctx=1995, majf=0, minf=4097 00:22:40.502 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:22:40.502 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.502 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.502 issued rwts: total=9780,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.502 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.502 job10: (groupid=0, jobs=1): err= 0: pid=2505196: Wed Nov 27 03:17:41 2024 00:22:40.502 read: IOPS=889, BW=222MiB/s (233MB/s)(2229MiB/10026msec) 00:22:40.502 slat (usec): min=10, max=135787, avg=1005.03, stdev=3292.85 00:22:40.502 clat (usec): min=718, max=226942, avg=70919.93, stdev=35364.89 00:22:40.502 lat (usec): min=740, max=304399, avg=71924.96, stdev=35836.34 00:22:40.502 clat percentiles (msec): 00:22:40.502 | 1.00th=[ 5], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 34], 00:22:40.502 | 30.00th=[ 50], 40.00th=[ 61], 50.00th=[ 68], 60.00th=[ 78], 00:22:40.502 | 70.00th=[ 88], 80.00th=[ 100], 90.00th=[ 123], 95.00th=[ 136], 00:22:40.502 | 99.00th=[ 157], 99.50th=[ 178], 99.90th=[ 222], 99.95th=[ 222], 00:22:40.502 | 99.99th=[ 228] 00:22:40.503 bw ( KiB/s): min=118272, max=402432, per=10.66%, avg=226585.60, stdev=78732.69, samples=20 00:22:40.503 iops : min= 462, max= 1572, avg=885.10, stdev=307.55, samples=20 00:22:40.503 lat (usec) : 750=0.02%, 1000=0.06% 00:22:40.503 lat (msec) : 2=0.38%, 4=0.45%, 10=1.01%, 20=1.22%, 50=27.48% 00:22:40.503 lat (msec) : 100=50.18%, 250=19.19% 00:22:40.503 cpu : usr=0.50%, sys=2.86%, ctx=1780, majf=0, minf=4098 00:22:40.503 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:22:40.503 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:40.503 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:40.503 issued rwts: total=8914,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:40.503 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:40.503 00:22:40.503 Run status group 0 (all jobs): 00:22:40.503 READ: bw=2075MiB/s (2176MB/s), 161MiB/s-242MiB/s (169MB/s-253MB/s), io=20.5GiB (22.0GB), run=10026-10114msec 00:22:40.503 00:22:40.503 Disk stats (read/write): 00:22:40.503 nvme0n1: ios=14338/0, merge=0/0, ticks=1234198/0, in_queue=1234198, util=97.09% 00:22:40.503 nvme10n1: ios=15664/0, merge=0/0, ticks=1234293/0, in_queue=1234293, util=97.31% 00:22:40.503 nvme1n1: ios=13110/0, merge=0/0, ticks=1230829/0, in_queue=1230829, util=97.60% 00:22:40.503 nvme2n1: ios=13575/0, merge=0/0, ticks=1233906/0, in_queue=1233906, util=97.76% 00:22:40.503 nvme3n1: ios=15290/0, merge=0/0, ticks=1235747/0, in_queue=1235747, util=97.83% 00:22:40.503 nvme4n1: ios=13600/0, merge=0/0, ticks=1232036/0, in_queue=1232036, util=98.19% 00:22:40.503 nvme5n1: ios=16301/0, merge=0/0, ticks=1230033/0, in_queue=1230033, util=98.36% 00:22:40.503 nvme6n1: ios=12745/0, merge=0/0, ticks=1236107/0, in_queue=1236107, util=98.47% 00:22:40.503 nvme7n1: ios=13942/0, merge=0/0, ticks=1231963/0, in_queue=1231963, util=98.90% 00:22:40.503 nvme8n1: ios=19380/0, merge=0/0, ticks=1230736/0, in_queue=1230736, util=99.11% 00:22:40.503 nvme9n1: ios=17323/0, merge=0/0, ticks=1228405/0, in_queue=1228405, util=99.25% 00:22:40.503 03:17:41 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:40.503 [global] 00:22:40.503 thread=1 00:22:40.503 invalidate=1 00:22:40.503 rw=randwrite 00:22:40.503 time_based=1 00:22:40.503 runtime=10 00:22:40.503 ioengine=libaio 00:22:40.503 direct=1 00:22:40.503 bs=262144 00:22:40.503 iodepth=64 00:22:40.503 norandommap=1 00:22:40.503 numjobs=1 00:22:40.503 00:22:40.503 [job0] 00:22:40.503 filename=/dev/nvme0n1 00:22:40.503 [job1] 00:22:40.503 filename=/dev/nvme10n1 00:22:40.503 [job2] 00:22:40.503 filename=/dev/nvme1n1 00:22:40.503 [job3] 00:22:40.503 filename=/dev/nvme2n1 00:22:40.503 [job4] 00:22:40.503 filename=/dev/nvme3n1 00:22:40.503 [job5] 00:22:40.503 filename=/dev/nvme4n1 00:22:40.503 [job6] 00:22:40.503 filename=/dev/nvme5n1 00:22:40.503 [job7] 00:22:40.503 filename=/dev/nvme6n1 00:22:40.503 [job8] 00:22:40.503 filename=/dev/nvme7n1 00:22:40.503 [job9] 00:22:40.503 filename=/dev/nvme8n1 00:22:40.503 [job10] 00:22:40.503 filename=/dev/nvme9n1 00:22:40.503 Could not set queue depth (nvme0n1) 00:22:40.503 Could not set queue depth (nvme10n1) 00:22:40.503 Could not set queue depth (nvme1n1) 00:22:40.503 Could not set queue depth (nvme2n1) 00:22:40.503 Could not set queue depth (nvme3n1) 00:22:40.503 Could not set queue depth (nvme4n1) 00:22:40.503 Could not set queue depth (nvme5n1) 00:22:40.503 Could not set queue depth (nvme6n1) 00:22:40.503 Could not set queue depth (nvme7n1) 00:22:40.503 Could not set queue depth (nvme8n1) 00:22:40.503 Could not set queue depth (nvme9n1) 00:22:40.503 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:40.503 fio-3.35 00:22:40.503 Starting 11 threads 00:22:50.470 00:22:50.470 job0: (groupid=0, jobs=1): err= 0: pid=2506372: Wed Nov 27 03:17:52 2024 00:22:50.470 write: IOPS=529, BW=132MiB/s (139MB/s)(1331MiB/10064msec); 0 zone resets 00:22:50.470 slat (usec): min=18, max=46532, avg=1244.83, stdev=3619.12 00:22:50.470 clat (usec): min=927, max=378343, avg=119671.14, stdev=69314.65 00:22:50.470 lat (usec): min=994, max=382312, avg=120915.97, stdev=70228.64 00:22:50.470 clat percentiles (msec): 00:22:50.470 | 1.00th=[ 6], 5.00th=[ 15], 10.00th=[ 26], 20.00th=[ 48], 00:22:50.470 | 30.00th=[ 81], 40.00th=[ 106], 50.00th=[ 120], 60.00th=[ 138], 00:22:50.470 | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 203], 95.00th=[ 236], 00:22:50.470 | 99.00th=[ 326], 99.50th=[ 355], 99.90th=[ 376], 99.95th=[ 380], 00:22:50.470 | 99.99th=[ 380] 00:22:50.470 bw ( KiB/s): min=74240, max=285696, per=9.40%, avg=134673.55, stdev=58299.16, samples=20 00:22:50.470 iops : min= 290, max= 1116, avg=525.95, stdev=227.64, samples=20 00:22:50.470 lat (usec) : 1000=0.02% 00:22:50.470 lat (msec) : 2=0.06%, 4=0.41%, 10=2.63%, 20=4.30%, 50=13.16% 00:22:50.470 lat (msec) : 100=17.45%, 250=58.61%, 500=3.36% 00:22:50.470 cpu : usr=1.52%, sys=1.74%, ctx=3225, majf=0, minf=1 00:22:50.470 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:50.470 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.470 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.471 issued rwts: total=0,5325,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.471 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.471 job1: (groupid=0, jobs=1): err= 0: pid=2506373: Wed Nov 27 03:17:52 2024 00:22:50.471 write: IOPS=549, BW=137MiB/s (144MB/s)(1387MiB/10102msec); 0 zone resets 00:22:50.471 slat (usec): min=13, max=46960, avg=1304.00, stdev=3485.31 00:22:50.471 clat (usec): min=748, max=342085, avg=115228.06, stdev=69800.41 00:22:50.471 lat (usec): min=778, max=342124, avg=116532.06, stdev=70579.43 00:22:50.471 clat percentiles (msec): 00:22:50.471 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 24], 20.00th=[ 40], 00:22:50.471 | 30.00th=[ 63], 40.00th=[ 104], 50.00th=[ 124], 60.00th=[ 140], 00:22:50.471 | 70.00th=[ 153], 80.00th=[ 171], 90.00th=[ 203], 95.00th=[ 236], 00:22:50.471 | 99.00th=[ 292], 99.50th=[ 305], 99.90th=[ 330], 99.95th=[ 334], 00:22:50.471 | 99.99th=[ 342] 00:22:50.471 bw ( KiB/s): min=79872, max=256000, per=9.80%, avg=140346.75, stdev=49241.04, samples=20 00:22:50.471 iops : min= 312, max= 1000, avg=548.15, stdev=192.36, samples=20 00:22:50.471 lat (usec) : 750=0.02%, 1000=0.11% 00:22:50.471 lat (msec) : 2=0.41%, 4=1.12%, 10=2.92%, 20=4.00%, 50=18.27% 00:22:50.471 lat (msec) : 100=11.85%, 250=57.55%, 500=3.75% 00:22:50.471 cpu : usr=1.83%, sys=1.76%, ctx=3014, majf=0, minf=1 00:22:50.471 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:22:50.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.471 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.471 issued rwts: total=0,5546,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.471 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.471 job2: (groupid=0, jobs=1): err= 0: pid=2506374: Wed Nov 27 03:17:52 2024 00:22:50.471 write: IOPS=456, BW=114MiB/s (120MB/s)(1165MiB/10208msec); 0 zone resets 00:22:50.471 slat (usec): min=16, max=83997, avg=1819.58, stdev=4519.93 00:22:50.471 clat (usec): min=724, max=469114, avg=138266.65, stdev=74280.11 00:22:50.471 lat (usec): min=755, max=469146, avg=140086.23, stdev=75135.37 00:22:50.471 clat percentiles (msec): 00:22:50.471 | 1.00th=[ 3], 5.00th=[ 17], 10.00th=[ 39], 20.00th=[ 82], 00:22:50.471 | 30.00th=[ 104], 40.00th=[ 122], 50.00th=[ 134], 60.00th=[ 150], 00:22:50.471 | 70.00th=[ 169], 80.00th=[ 190], 90.00th=[ 222], 95.00th=[ 275], 00:22:50.471 | 99.00th=[ 355], 99.50th=[ 393], 99.90th=[ 456], 99.95th=[ 456], 00:22:50.471 | 99.99th=[ 468] 00:22:50.471 bw ( KiB/s): min=53248, max=200704, per=8.21%, avg=117604.35, stdev=37905.39, samples=20 00:22:50.471 iops : min= 208, max= 784, avg=459.35, stdev=148.09, samples=20 00:22:50.471 lat (usec) : 750=0.06%, 1000=0.04% 00:22:50.471 lat (msec) : 2=0.45%, 4=0.99%, 10=1.61%, 20=2.51%, 50=6.63% 00:22:50.471 lat (msec) : 100=16.10%, 250=64.28%, 500=7.32% 00:22:50.471 cpu : usr=1.43%, sys=1.44%, ctx=1979, majf=0, minf=1 00:22:50.471 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:22:50.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.471 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.471 issued rwts: total=0,4658,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.471 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.471 job3: (groupid=0, jobs=1): err= 0: pid=2506386: Wed Nov 27 03:17:52 2024 00:22:50.471 write: IOPS=592, BW=148MiB/s (155MB/s)(1498MiB/10108msec); 0 zone resets 00:22:50.471 slat (usec): min=16, max=79902, avg=1152.82, stdev=3344.56 00:22:50.471 clat (usec): min=765, max=416279, avg=106793.44, stdev=73509.47 00:22:50.471 lat (usec): min=793, max=428660, avg=107946.26, stdev=74302.70 00:22:50.471 clat percentiles (msec): 00:22:50.471 | 1.00th=[ 5], 5.00th=[ 16], 10.00th=[ 35], 20.00th=[ 47], 00:22:50.471 | 30.00th=[ 50], 40.00th=[ 71], 50.00th=[ 89], 60.00th=[ 114], 00:22:50.471 | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 241], 00:22:50.471 | 99.00th=[ 363], 99.50th=[ 393], 99.90th=[ 409], 99.95th=[ 409], 00:22:50.471 | 99.99th=[ 418] 00:22:50.471 bw ( KiB/s): min=54784, max=333824, per=10.59%, avg=151727.80, stdev=68354.45, samples=20 00:22:50.471 iops : min= 214, max= 1304, avg=592.55, stdev=266.99, samples=20 00:22:50.471 lat (usec) : 1000=0.17% 00:22:50.471 lat (msec) : 2=0.23%, 4=0.47%, 10=1.95%, 20=3.22%, 50=24.71% 00:22:50.471 lat (msec) : 100=24.71%, 250=40.33%, 500=4.21% 00:22:50.471 cpu : usr=1.82%, sys=1.95%, ctx=2996, majf=0, minf=1 00:22:50.471 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:22:50.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.471 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.471 issued rwts: total=0,5990,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.471 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.471 job4: (groupid=0, jobs=1): err= 0: pid=2506387: Wed Nov 27 03:17:52 2024 00:22:50.471 write: IOPS=476, BW=119MiB/s (125MB/s)(1199MiB/10070msec); 0 zone resets 00:22:50.471 slat (usec): min=18, max=105216, avg=1622.32, stdev=4310.37 00:22:50.471 clat (msec): min=2, max=462, avg=132.75, stdev=69.57 00:22:50.471 lat (msec): min=2, max=462, avg=134.38, stdev=70.47 00:22:50.471 clat percentiles (msec): 00:22:50.471 | 1.00th=[ 8], 5.00th=[ 28], 10.00th=[ 52], 20.00th=[ 86], 00:22:50.471 | 30.00th=[ 94], 40.00th=[ 104], 50.00th=[ 124], 60.00th=[ 148], 00:22:50.471 | 70.00th=[ 165], 80.00th=[ 182], 90.00th=[ 209], 95.00th=[ 234], 00:22:50.471 | 99.00th=[ 418], 99.50th=[ 443], 99.90th=[ 464], 99.95th=[ 464], 00:22:50.471 | 99.99th=[ 464] 00:22:50.471 bw ( KiB/s): min=40960, max=181397, per=8.46%, avg=121095.45, stdev=38446.76, samples=20 00:22:50.471 iops : min= 160, max= 708, avg=473.00, stdev=150.13, samples=20 00:22:50.471 lat (msec) : 4=0.08%, 10=2.09%, 20=1.98%, 50=5.53%, 100=27.56% 00:22:50.471 lat (msec) : 250=58.39%, 500=4.38% 00:22:50.471 cpu : usr=1.62%, sys=1.40%, ctx=2239, majf=0, minf=1 00:22:50.471 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:22:50.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.471 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.471 issued rwts: total=0,4794,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.471 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.471 job5: (groupid=0, jobs=1): err= 0: pid=2506388: Wed Nov 27 03:17:52 2024 00:22:50.471 write: IOPS=522, BW=131MiB/s (137MB/s)(1331MiB/10191msec); 0 zone resets 00:22:50.471 slat (usec): min=17, max=61148, avg=1260.35, stdev=3500.07 00:22:50.471 clat (usec): min=758, max=456406, avg=121195.04, stdev=74407.87 00:22:50.471 lat (usec): min=784, max=456438, avg=122455.39, stdev=75219.25 00:22:50.471 clat percentiles (msec): 00:22:50.471 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 29], 20.00th=[ 72], 00:22:50.471 | 30.00th=[ 85], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 118], 00:22:50.471 | 70.00th=[ 138], 80.00th=[ 178], 90.00th=[ 209], 95.00th=[ 266], 00:22:50.471 | 99.00th=[ 380], 99.50th=[ 397], 99.90th=[ 443], 99.95th=[ 443], 00:22:50.471 | 99.99th=[ 456] 00:22:50.471 bw ( KiB/s): min=59392, max=194560, per=9.40%, avg=134649.85, stdev=49680.63, samples=20 00:22:50.471 iops : min= 232, max= 760, avg=525.95, stdev=194.11, samples=20 00:22:50.471 lat (usec) : 1000=0.06% 00:22:50.471 lat (msec) : 2=0.21%, 4=0.79%, 10=2.44%, 20=3.29%, 50=8.25% 00:22:50.471 lat (msec) : 100=24.82%, 250=54.31%, 500=5.84% 00:22:50.471 cpu : usr=1.66%, sys=1.78%, ctx=2957, majf=0, minf=1 00:22:50.471 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:50.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.471 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.471 issued rwts: total=0,5323,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.471 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.471 job6: (groupid=0, jobs=1): err= 0: pid=2506389: Wed Nov 27 03:17:52 2024 00:22:50.471 write: IOPS=518, BW=130MiB/s (136MB/s)(1324MiB/10208msec); 0 zone resets 00:22:50.471 slat (usec): min=25, max=126883, avg=1737.45, stdev=4144.41 00:22:50.471 clat (usec): min=829, max=546361, avg=121532.87, stdev=72743.51 00:22:50.471 lat (usec): min=893, max=546402, avg=123270.32, stdev=73703.09 00:22:50.471 clat percentiles (msec): 00:22:50.471 | 1.00th=[ 6], 5.00th=[ 35], 10.00th=[ 49], 20.00th=[ 71], 00:22:50.471 | 30.00th=[ 82], 40.00th=[ 89], 50.00th=[ 104], 60.00th=[ 116], 00:22:50.471 | 70.00th=[ 138], 80.00th=[ 180], 90.00th=[ 218], 95.00th=[ 279], 00:22:50.471 | 99.00th=[ 355], 99.50th=[ 380], 99.90th=[ 418], 99.95th=[ 418], 00:22:50.471 | 99.99th=[ 550] 00:22:50.471 bw ( KiB/s): min=57344, max=222208, per=9.35%, avg=133908.85, stdev=54191.10, samples=20 00:22:50.471 iops : min= 224, max= 868, avg=523.05, stdev=211.66, samples=20 00:22:50.471 lat (usec) : 1000=0.06% 00:22:50.471 lat (msec) : 2=0.11%, 4=0.49%, 10=1.13%, 20=1.04%, 50=9.22% 00:22:50.471 lat (msec) : 100=37.00%, 250=44.68%, 500=6.23%, 750=0.04% 00:22:50.471 cpu : usr=1.69%, sys=1.82%, ctx=1836, majf=0, minf=1 00:22:50.471 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:22:50.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.471 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.471 issued rwts: total=0,5295,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.471 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.471 job7: (groupid=0, jobs=1): err= 0: pid=2506390: Wed Nov 27 03:17:52 2024 00:22:50.471 write: IOPS=398, BW=99.6MiB/s (104MB/s)(1016MiB/10199msec); 0 zone resets 00:22:50.471 slat (usec): min=18, max=84107, avg=2101.62, stdev=4999.19 00:22:50.471 clat (usec): min=983, max=441444, avg=158503.59, stdev=81834.90 00:22:50.471 lat (usec): min=1055, max=441479, avg=160605.21, stdev=82711.41 00:22:50.471 clat percentiles (msec): 00:22:50.471 | 1.00th=[ 5], 5.00th=[ 12], 10.00th=[ 47], 20.00th=[ 97], 00:22:50.471 | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 163], 60.00th=[ 186], 00:22:50.471 | 70.00th=[ 201], 80.00th=[ 222], 90.00th=[ 266], 95.00th=[ 296], 00:22:50.471 | 99.00th=[ 355], 99.50th=[ 380], 99.90th=[ 426], 99.95th=[ 426], 00:22:50.471 | 99.99th=[ 443] 00:22:50.471 bw ( KiB/s): min=51200, max=168960, per=7.15%, avg=102344.30, stdev=35160.08, samples=20 00:22:50.471 iops : min= 200, max= 660, avg=399.70, stdev=137.32, samples=20 00:22:50.471 lat (usec) : 1000=0.02% 00:22:50.471 lat (msec) : 2=0.22%, 4=0.44%, 10=3.50%, 20=3.32%, 50=3.18% 00:22:50.471 lat (msec) : 100=13.24%, 250=61.74%, 500=14.33% 00:22:50.471 cpu : usr=1.41%, sys=1.18%, ctx=1671, majf=0, minf=1 00:22:50.471 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.4% 00:22:50.471 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.472 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.472 issued rwts: total=0,4062,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.472 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.472 job8: (groupid=0, jobs=1): err= 0: pid=2506392: Wed Nov 27 03:17:52 2024 00:22:50.472 write: IOPS=489, BW=122MiB/s (128MB/s)(1249MiB/10194msec); 0 zone resets 00:22:50.472 slat (usec): min=14, max=143369, avg=1436.36, stdev=4715.70 00:22:50.472 clat (usec): min=925, max=444644, avg=129024.90, stdev=80798.51 00:22:50.472 lat (usec): min=970, max=444693, avg=130461.26, stdev=81885.23 00:22:50.472 clat percentiles (msec): 00:22:50.472 | 1.00th=[ 5], 5.00th=[ 19], 10.00th=[ 36], 20.00th=[ 45], 00:22:50.472 | 30.00th=[ 79], 40.00th=[ 100], 50.00th=[ 118], 60.00th=[ 136], 00:22:50.472 | 70.00th=[ 167], 80.00th=[ 207], 90.00th=[ 243], 95.00th=[ 266], 00:22:50.472 | 99.00th=[ 326], 99.50th=[ 368], 99.90th=[ 430], 99.95th=[ 430], 00:22:50.472 | 99.99th=[ 447] 00:22:50.472 bw ( KiB/s): min=55296, max=289792, per=8.81%, avg=126242.30, stdev=67715.87, samples=20 00:22:50.472 iops : min= 216, max= 1132, avg=493.05, stdev=264.54, samples=20 00:22:50.472 lat (usec) : 1000=0.04% 00:22:50.472 lat (msec) : 2=0.28%, 4=0.64%, 10=1.96%, 20=2.60%, 50=18.02% 00:22:50.472 lat (msec) : 100=19.02%, 250=49.99%, 500=7.45% 00:22:50.472 cpu : usr=1.46%, sys=1.61%, ctx=2773, majf=0, minf=1 00:22:50.472 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:22:50.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.472 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.472 issued rwts: total=0,4995,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.472 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.472 job9: (groupid=0, jobs=1): err= 0: pid=2506393: Wed Nov 27 03:17:52 2024 00:22:50.472 write: IOPS=412, BW=103MiB/s (108MB/s)(1051MiB/10195msec); 0 zone resets 00:22:50.472 slat (usec): min=24, max=184109, avg=1977.96, stdev=5973.48 00:22:50.472 clat (msec): min=6, max=471, avg=152.00, stdev=74.05 00:22:50.472 lat (msec): min=6, max=471, avg=153.98, stdev=74.90 00:22:50.472 clat percentiles (msec): 00:22:50.472 | 1.00th=[ 18], 5.00th=[ 36], 10.00th=[ 63], 20.00th=[ 86], 00:22:50.472 | 30.00th=[ 101], 40.00th=[ 128], 50.00th=[ 148], 60.00th=[ 171], 00:22:50.472 | 70.00th=[ 192], 80.00th=[ 207], 90.00th=[ 239], 95.00th=[ 284], 00:22:50.472 | 99.00th=[ 351], 99.50th=[ 409], 99.90th=[ 456], 99.95th=[ 472], 00:22:50.472 | 99.99th=[ 472] 00:22:50.472 bw ( KiB/s): min=49152, max=160768, per=7.40%, avg=106004.90, stdev=31144.22, samples=20 00:22:50.472 iops : min= 192, max= 628, avg=414.05, stdev=121.68, samples=20 00:22:50.472 lat (msec) : 10=0.19%, 20=1.47%, 50=5.83%, 100=22.55%, 250=61.63% 00:22:50.472 lat (msec) : 500=8.33% 00:22:50.472 cpu : usr=1.24%, sys=1.42%, ctx=1844, majf=0, minf=1 00:22:50.472 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.8%, >=64=98.5% 00:22:50.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.472 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.472 issued rwts: total=0,4204,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.472 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.472 job10: (groupid=0, jobs=1): err= 0: pid=2506394: Wed Nov 27 03:17:52 2024 00:22:50.472 write: IOPS=684, BW=171MiB/s (179MB/s)(1729MiB/10107msec); 0 zone resets 00:22:50.472 slat (usec): min=16, max=107601, avg=757.28, stdev=2846.16 00:22:50.472 clat (usec): min=901, max=343955, avg=92720.42, stdev=69498.69 00:22:50.472 lat (usec): min=1000, max=343995, avg=93477.71, stdev=70086.45 00:22:50.472 clat percentiles (msec): 00:22:50.472 | 1.00th=[ 3], 5.00th=[ 11], 10.00th=[ 20], 20.00th=[ 31], 00:22:50.472 | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 74], 60.00th=[ 106], 00:22:50.472 | 70.00th=[ 129], 80.00th=[ 153], 90.00th=[ 203], 95.00th=[ 224], 00:22:50.472 | 99.00th=[ 266], 99.50th=[ 275], 99.90th=[ 313], 99.95th=[ 342], 00:22:50.472 | 99.99th=[ 347] 00:22:50.472 bw ( KiB/s): min=75776, max=340992, per=12.25%, avg=175447.00, stdev=79997.16, samples=20 00:22:50.472 iops : min= 296, max= 1332, avg=685.25, stdev=312.52, samples=20 00:22:50.472 lat (usec) : 1000=0.09% 00:22:50.472 lat (msec) : 2=0.51%, 4=1.36%, 10=2.75%, 20=5.94%, 50=30.22% 00:22:50.472 lat (msec) : 100=17.75%, 250=39.45%, 500=1.94% 00:22:50.472 cpu : usr=1.99%, sys=2.42%, ctx=4638, majf=0, minf=2 00:22:50.472 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:50.472 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:50.472 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:50.472 issued rwts: total=0,6917,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:50.472 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:50.472 00:22:50.472 Run status group 0 (all jobs): 00:22:50.472 WRITE: bw=1399MiB/s (1467MB/s), 99.6MiB/s-171MiB/s (104MB/s-179MB/s), io=13.9GiB (15.0GB), run=10064-10208msec 00:22:50.472 00:22:50.472 Disk stats (read/write): 00:22:50.472 nvme0n1: ios=49/10402, merge=0/0, ticks=33/1225048, in_queue=1225081, util=97.37% 00:22:50.472 nvme10n1: ios=49/10852, merge=0/0, ticks=40/1221041, in_queue=1221081, util=97.64% 00:22:50.472 nvme1n1: ios=49/9289, merge=0/0, ticks=1753/1236894, in_queue=1238647, util=100.00% 00:22:50.472 nvme2n1: ios=43/11807, merge=0/0, ticks=111/1218822, in_queue=1218933, util=98.29% 00:22:50.472 nvme3n1: ios=29/9371, merge=0/0, ticks=23/1218264, in_queue=1218287, util=97.85% 00:22:50.472 nvme4n1: ios=0/10636, merge=0/0, ticks=0/1248578, in_queue=1248578, util=98.16% 00:22:50.472 nvme5n1: ios=41/10563, merge=0/0, ticks=1315/1237013, in_queue=1238328, util=100.00% 00:22:50.472 nvme6n1: ios=0/8111, merge=0/0, ticks=0/1241350, in_queue=1241350, util=98.48% 00:22:50.472 nvme7n1: ios=39/9983, merge=0/0, ticks=259/1246901, in_queue=1247160, util=100.00% 00:22:50.472 nvme8n1: ios=32/8400, merge=0/0, ticks=1807/1217642, in_queue=1219449, util=100.00% 00:22:50.472 nvme9n1: ios=45/13660, merge=0/0, ticks=124/1227173, in_queue=1227297, util=99.96% 00:22:50.472 03:17:52 -- target/multiconnection.sh@36 -- # sync 00:22:50.472 03:17:52 -- target/multiconnection.sh@37 -- # seq 1 11 00:22:50.472 03:17:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.472 03:17:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:22:50.472 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:22:50.472 03:17:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:22:50.472 03:17:52 -- common/autotest_common.sh@1208 -- # local i=0 00:22:50.472 03:17:52 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:50.472 03:17:52 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:22:50.472 03:17:52 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:50.472 03:17:52 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:22:50.472 03:17:52 -- common/autotest_common.sh@1220 -- # return 0 00:22:50.472 03:17:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:50.472 03:17:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.472 03:17:52 -- common/autotest_common.sh@10 -- # set +x 00:22:50.472 03:17:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.472 03:17:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.472 03:17:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:22:50.472 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:22:50.472 03:17:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:22:50.472 03:17:52 -- common/autotest_common.sh@1208 -- # local i=0 00:22:50.472 03:17:52 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:50.472 03:17:52 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:22:50.472 03:17:52 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:50.472 03:17:52 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:22:50.472 03:17:52 -- common/autotest_common.sh@1220 -- # return 0 00:22:50.472 03:17:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:22:50.472 03:17:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.472 03:17:52 -- common/autotest_common.sh@10 -- # set +x 00:22:50.472 03:17:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.472 03:17:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.472 03:17:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:22:50.730 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:22:50.730 03:17:53 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:22:50.730 03:17:53 -- common/autotest_common.sh@1208 -- # local i=0 00:22:50.730 03:17:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:50.730 03:17:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:22:50.730 03:17:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:50.730 03:17:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:22:50.730 03:17:53 -- common/autotest_common.sh@1220 -- # return 0 00:22:50.730 03:17:53 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:22:50.730 03:17:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.730 03:17:53 -- common/autotest_common.sh@10 -- # set +x 00:22:50.731 03:17:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.731 03:17:53 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.731 03:17:53 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:22:50.989 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:22:50.989 03:17:53 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:22:50.989 03:17:53 -- common/autotest_common.sh@1208 -- # local i=0 00:22:50.989 03:17:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:50.989 03:17:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:22:50.989 03:17:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:50.989 03:17:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:22:50.989 03:17:53 -- common/autotest_common.sh@1220 -- # return 0 00:22:50.989 03:17:53 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:22:50.989 03:17:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:50.989 03:17:53 -- common/autotest_common.sh@10 -- # set +x 00:22:50.989 03:17:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:50.989 03:17:53 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:50.989 03:17:53 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:22:51.247 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:22:51.247 03:17:53 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:22:51.247 03:17:53 -- common/autotest_common.sh@1208 -- # local i=0 00:22:51.247 03:17:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:51.247 03:17:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:22:51.247 03:17:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:51.247 03:17:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:22:51.247 03:17:53 -- common/autotest_common.sh@1220 -- # return 0 00:22:51.247 03:17:53 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:22:51.247 03:17:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.247 03:17:53 -- common/autotest_common.sh@10 -- # set +x 00:22:51.247 03:17:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.247 03:17:53 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.247 03:17:53 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:22:51.506 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:22:51.506 03:17:53 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:22:51.506 03:17:53 -- common/autotest_common.sh@1208 -- # local i=0 00:22:51.506 03:17:53 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:51.506 03:17:53 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:22:51.506 03:17:53 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:51.506 03:17:53 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:22:51.506 03:17:53 -- common/autotest_common.sh@1220 -- # return 0 00:22:51.506 03:17:53 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:22:51.506 03:17:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.506 03:17:53 -- common/autotest_common.sh@10 -- # set +x 00:22:51.506 03:17:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.506 03:17:53 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.506 03:17:53 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:22:51.765 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:22:51.765 03:17:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:22:51.765 03:17:54 -- common/autotest_common.sh@1208 -- # local i=0 00:22:51.765 03:17:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:51.765 03:17:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:22:51.765 03:17:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:51.765 03:17:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:22:51.765 03:17:54 -- common/autotest_common.sh@1220 -- # return 0 00:22:51.765 03:17:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:22:51.765 03:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.765 03:17:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.765 03:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.765 03:17:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.765 03:17:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:22:51.765 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:22:51.765 03:17:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:22:51.765 03:17:54 -- common/autotest_common.sh@1208 -- # local i=0 00:22:51.765 03:17:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:51.765 03:17:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:22:51.765 03:17:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:51.765 03:17:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:22:51.765 03:17:54 -- common/autotest_common.sh@1220 -- # return 0 00:22:51.765 03:17:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:22:51.765 03:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:51.765 03:17:54 -- common/autotest_common.sh@10 -- # set +x 00:22:51.765 03:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:51.765 03:17:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:51.765 03:17:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:22:52.023 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:22:52.023 03:17:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:22:52.023 03:17:54 -- common/autotest_common.sh@1208 -- # local i=0 00:22:52.023 03:17:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:52.023 03:17:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:22:52.023 03:17:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:52.023 03:17:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:22:52.023 03:17:54 -- common/autotest_common.sh@1220 -- # return 0 00:22:52.023 03:17:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:22:52.023 03:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.023 03:17:54 -- common/autotest_common.sh@10 -- # set +x 00:22:52.023 03:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.023 03:17:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:52.023 03:17:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:22:52.281 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:22:52.281 03:17:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:22:52.281 03:17:54 -- common/autotest_common.sh@1208 -- # local i=0 00:22:52.281 03:17:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:52.281 03:17:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:22:52.281 03:17:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:52.281 03:17:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:22:52.281 03:17:54 -- common/autotest_common.sh@1220 -- # return 0 00:22:52.281 03:17:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:22:52.281 03:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.281 03:17:54 -- common/autotest_common.sh@10 -- # set +x 00:22:52.281 03:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.281 03:17:54 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:52.281 03:17:54 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:22:52.281 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:22:52.281 03:17:54 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:22:52.281 03:17:54 -- common/autotest_common.sh@1208 -- # local i=0 00:22:52.281 03:17:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:22:52.281 03:17:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:22:52.281 03:17:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:22:52.281 03:17:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:22:52.281 03:17:54 -- common/autotest_common.sh@1220 -- # return 0 00:22:52.281 03:17:54 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:22:52.281 03:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:52.281 03:17:54 -- common/autotest_common.sh@10 -- # set +x 00:22:52.281 03:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:52.281 03:17:54 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:22:52.281 03:17:54 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:22:52.281 03:17:54 -- target/multiconnection.sh@47 -- # nvmftestfini 00:22:52.281 03:17:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:52.281 03:17:54 -- nvmf/common.sh@116 -- # sync 00:22:52.281 03:17:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:52.281 03:17:54 -- nvmf/common.sh@119 -- # set +e 00:22:52.281 03:17:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:52.281 03:17:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:52.281 rmmod nvme_tcp 00:22:52.281 rmmod nvme_fabrics 00:22:52.281 rmmod nvme_keyring 00:22:52.281 03:17:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:52.281 03:17:54 -- nvmf/common.sh@123 -- # set -e 00:22:52.281 03:17:54 -- nvmf/common.sh@124 -- # return 0 00:22:52.281 03:17:54 -- nvmf/common.sh@477 -- # '[' -n 2500771 ']' 00:22:52.281 03:17:54 -- nvmf/common.sh@478 -- # killprocess 2500771 00:22:52.281 03:17:54 -- common/autotest_common.sh@936 -- # '[' -z 2500771 ']' 00:22:52.281 03:17:54 -- common/autotest_common.sh@940 -- # kill -0 2500771 00:22:52.281 03:17:54 -- common/autotest_common.sh@941 -- # uname 00:22:52.281 03:17:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:52.282 03:17:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2500771 00:22:52.282 03:17:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:52.282 03:17:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:52.282 03:17:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2500771' 00:22:52.282 killing process with pid 2500771 00:22:52.282 03:17:54 -- common/autotest_common.sh@955 -- # kill 2500771 00:22:52.282 03:17:54 -- common/autotest_common.sh@960 -- # wait 2500771 00:22:52.848 03:17:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:52.848 03:17:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:52.848 03:17:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:52.848 03:17:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:52.848 03:17:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:52.848 03:17:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:52.848 03:17:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:52.848 03:17:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.385 03:17:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:55.385 00:22:55.385 real 1m1.451s 00:22:55.385 user 3m27.020s 00:22:55.385 sys 0m25.890s 00:22:55.385 03:17:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:55.385 03:17:57 -- common/autotest_common.sh@10 -- # set +x 00:22:55.385 ************************************ 00:22:55.385 END TEST nvmf_multiconnection 00:22:55.385 ************************************ 00:22:55.385 03:17:57 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:55.385 03:17:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:55.385 03:17:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:55.385 03:17:57 -- common/autotest_common.sh@10 -- # set +x 00:22:55.385 ************************************ 00:22:55.385 START TEST nvmf_initiator_timeout 00:22:55.385 ************************************ 00:22:55.385 03:17:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:22:55.385 * Looking for test storage... 00:22:55.385 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:55.385 03:17:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:55.385 03:17:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:55.385 03:17:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:55.385 03:17:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:55.385 03:17:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:55.385 03:17:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:55.385 03:17:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:55.385 03:17:57 -- scripts/common.sh@335 -- # IFS=.-: 00:22:55.385 03:17:57 -- scripts/common.sh@335 -- # read -ra ver1 00:22:55.385 03:17:57 -- scripts/common.sh@336 -- # IFS=.-: 00:22:55.385 03:17:57 -- scripts/common.sh@336 -- # read -ra ver2 00:22:55.385 03:17:57 -- scripts/common.sh@337 -- # local 'op=<' 00:22:55.385 03:17:57 -- scripts/common.sh@339 -- # ver1_l=2 00:22:55.385 03:17:57 -- scripts/common.sh@340 -- # ver2_l=1 00:22:55.385 03:17:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:55.385 03:17:57 -- scripts/common.sh@343 -- # case "$op" in 00:22:55.385 03:17:57 -- scripts/common.sh@344 -- # : 1 00:22:55.385 03:17:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:55.385 03:17:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:55.385 03:17:57 -- scripts/common.sh@364 -- # decimal 1 00:22:55.385 03:17:57 -- scripts/common.sh@352 -- # local d=1 00:22:55.385 03:17:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:55.385 03:17:57 -- scripts/common.sh@354 -- # echo 1 00:22:55.385 03:17:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:55.385 03:17:57 -- scripts/common.sh@365 -- # decimal 2 00:22:55.385 03:17:57 -- scripts/common.sh@352 -- # local d=2 00:22:55.385 03:17:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:55.385 03:17:57 -- scripts/common.sh@354 -- # echo 2 00:22:55.385 03:17:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:55.385 03:17:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:55.385 03:17:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:55.385 03:17:57 -- scripts/common.sh@367 -- # return 0 00:22:55.385 03:17:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:55.385 03:17:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:55.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.385 --rc genhtml_branch_coverage=1 00:22:55.385 --rc genhtml_function_coverage=1 00:22:55.385 --rc genhtml_legend=1 00:22:55.385 --rc geninfo_all_blocks=1 00:22:55.385 --rc geninfo_unexecuted_blocks=1 00:22:55.385 00:22:55.385 ' 00:22:55.385 03:17:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:55.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.385 --rc genhtml_branch_coverage=1 00:22:55.385 --rc genhtml_function_coverage=1 00:22:55.385 --rc genhtml_legend=1 00:22:55.385 --rc geninfo_all_blocks=1 00:22:55.385 --rc geninfo_unexecuted_blocks=1 00:22:55.385 00:22:55.385 ' 00:22:55.385 03:17:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:55.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.385 --rc genhtml_branch_coverage=1 00:22:55.385 --rc genhtml_function_coverage=1 00:22:55.385 --rc genhtml_legend=1 00:22:55.385 --rc geninfo_all_blocks=1 00:22:55.385 --rc geninfo_unexecuted_blocks=1 00:22:55.385 00:22:55.385 ' 00:22:55.385 03:17:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:55.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:55.385 --rc genhtml_branch_coverage=1 00:22:55.385 --rc genhtml_function_coverage=1 00:22:55.385 --rc genhtml_legend=1 00:22:55.385 --rc geninfo_all_blocks=1 00:22:55.385 --rc geninfo_unexecuted_blocks=1 00:22:55.385 00:22:55.385 ' 00:22:55.385 03:17:57 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:55.385 03:17:57 -- nvmf/common.sh@7 -- # uname -s 00:22:55.385 03:17:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:55.385 03:17:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:55.385 03:17:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:55.385 03:17:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:55.385 03:17:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:55.385 03:17:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:55.385 03:17:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:55.385 03:17:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:55.385 03:17:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:55.385 03:17:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:55.385 03:17:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.385 03:17:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:55.385 03:17:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:55.385 03:17:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:55.385 03:17:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:55.385 03:17:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:55.385 03:17:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:55.385 03:17:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:55.385 03:17:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:55.385 03:17:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.385 03:17:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.385 03:17:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.385 03:17:57 -- paths/export.sh@5 -- # export PATH 00:22:55.385 03:17:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:55.385 03:17:57 -- nvmf/common.sh@46 -- # : 0 00:22:55.385 03:17:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:55.385 03:17:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:55.385 03:17:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:55.385 03:17:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:55.385 03:17:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:55.385 03:17:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:55.385 03:17:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:55.385 03:17:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:55.385 03:17:57 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:55.385 03:17:57 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:55.385 03:17:57 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:22:55.385 03:17:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:55.385 03:17:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:55.385 03:17:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:55.385 03:17:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:55.385 03:17:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:55.385 03:17:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:55.385 03:17:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:55.385 03:17:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:55.385 03:17:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:55.385 03:17:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:55.385 03:17:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:55.385 03:17:57 -- common/autotest_common.sh@10 -- # set +x 00:22:57.285 03:17:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:57.285 03:17:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:57.285 03:17:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:57.285 03:17:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:57.285 03:17:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:57.285 03:17:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:57.285 03:17:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:57.285 03:17:59 -- nvmf/common.sh@294 -- # net_devs=() 00:22:57.285 03:17:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:57.285 03:17:59 -- nvmf/common.sh@295 -- # e810=() 00:22:57.285 03:17:59 -- nvmf/common.sh@295 -- # local -ga e810 00:22:57.285 03:17:59 -- nvmf/common.sh@296 -- # x722=() 00:22:57.285 03:17:59 -- nvmf/common.sh@296 -- # local -ga x722 00:22:57.285 03:17:59 -- nvmf/common.sh@297 -- # mlx=() 00:22:57.285 03:17:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:57.285 03:17:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:57.285 03:17:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:57.285 03:17:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:57.285 03:17:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:57.285 03:17:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.285 03:17:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:57.285 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:57.285 03:17:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:57.285 03:17:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:57.285 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:57.285 03:17:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:57.285 03:17:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:57.285 03:17:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.285 03:17:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.285 03:17:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.285 03:17:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.285 03:17:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:57.285 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:57.285 03:17:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.285 03:17:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:57.285 03:17:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:57.286 03:17:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:57.286 03:17:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:57.286 03:17:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:57.286 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:57.286 03:17:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:57.286 03:17:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:57.286 03:17:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:57.286 03:17:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:57.286 03:17:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:57.286 03:17:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:57.286 03:17:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:57.286 03:17:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:57.286 03:17:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:57.286 03:17:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:57.286 03:17:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:57.286 03:17:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:57.286 03:17:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:57.286 03:17:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:57.286 03:17:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:57.286 03:17:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:57.286 03:17:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:57.286 03:17:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:57.286 03:17:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:57.286 03:17:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:57.286 03:17:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:57.286 03:17:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:57.286 03:17:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:57.286 03:17:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:57.286 03:17:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:57.286 03:17:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:57.286 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:57.286 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.200 ms 00:22:57.286 00:22:57.286 --- 10.0.0.2 ping statistics --- 00:22:57.286 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.286 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:22:57.286 03:17:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:57.544 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:57.544 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:22:57.544 00:22:57.544 --- 10.0.0.1 ping statistics --- 00:22:57.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:57.544 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:22:57.544 03:17:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:57.544 03:17:59 -- nvmf/common.sh@410 -- # return 0 00:22:57.544 03:17:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:57.544 03:17:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:57.544 03:17:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:57.544 03:17:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:57.544 03:17:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:57.544 03:17:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:57.544 03:17:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:57.544 03:17:59 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:22:57.544 03:17:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:57.544 03:17:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:57.544 03:17:59 -- common/autotest_common.sh@10 -- # set +x 00:22:57.544 03:17:59 -- nvmf/common.sh@469 -- # nvmfpid=2509789 00:22:57.544 03:17:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:57.544 03:17:59 -- nvmf/common.sh@470 -- # waitforlisten 2509789 00:22:57.544 03:17:59 -- common/autotest_common.sh@829 -- # '[' -z 2509789 ']' 00:22:57.544 03:17:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:57.544 03:17:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:57.544 03:17:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:57.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:57.544 03:17:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:57.544 03:17:59 -- common/autotest_common.sh@10 -- # set +x 00:22:57.544 [2024-11-27 03:17:59.975068] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:57.544 [2024-11-27 03:17:59.975140] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:57.544 EAL: No free 2048 kB hugepages reported on node 1 00:22:57.544 [2024-11-27 03:18:00.043400] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:57.544 [2024-11-27 03:18:00.139872] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:57.544 [2024-11-27 03:18:00.140020] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:57.544 [2024-11-27 03:18:00.140037] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:57.544 [2024-11-27 03:18:00.140050] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:57.544 [2024-11-27 03:18:00.140111] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:57.544 [2024-11-27 03:18:00.140240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:57.544 [2024-11-27 03:18:00.140274] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:57.544 [2024-11-27 03:18:00.140276] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:58.477 03:18:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:58.477 03:18:00 -- common/autotest_common.sh@862 -- # return 0 00:22:58.477 03:18:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:58.477 03:18:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:58.477 03:18:00 -- common/autotest_common.sh@10 -- # set +x 00:22:58.477 03:18:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:58.477 03:18:01 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:22:58.477 03:18:01 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:22:58.477 03:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.477 03:18:01 -- common/autotest_common.sh@10 -- # set +x 00:22:58.477 Malloc0 00:22:58.477 03:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.477 03:18:01 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:22:58.477 03:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.477 03:18:01 -- common/autotest_common.sh@10 -- # set +x 00:22:58.477 Delay0 00:22:58.477 03:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.477 03:18:01 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:58.477 03:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.477 03:18:01 -- common/autotest_common.sh@10 -- # set +x 00:22:58.477 [2024-11-27 03:18:01.038241] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:58.477 03:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.477 03:18:01 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:22:58.477 03:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.477 03:18:01 -- common/autotest_common.sh@10 -- # set +x 00:22:58.477 03:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.477 03:18:01 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:22:58.477 03:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.477 03:18:01 -- common/autotest_common.sh@10 -- # set +x 00:22:58.477 03:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.477 03:18:01 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:58.477 03:18:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:58.477 03:18:01 -- common/autotest_common.sh@10 -- # set +x 00:22:58.477 [2024-11-27 03:18:01.066542] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:58.477 03:18:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:58.477 03:18:01 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:59.409 03:18:01 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:22:59.409 03:18:01 -- common/autotest_common.sh@1187 -- # local i=0 00:22:59.409 03:18:01 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:59.409 03:18:01 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:59.409 03:18:01 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:01.308 03:18:03 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:01.308 03:18:03 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:01.308 03:18:03 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:01.308 03:18:03 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:01.308 03:18:03 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:01.308 03:18:03 -- common/autotest_common.sh@1197 -- # return 0 00:23:01.308 03:18:03 -- target/initiator_timeout.sh@35 -- # fio_pid=2510469 00:23:01.308 03:18:03 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:01.308 03:18:03 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:01.308 [global] 00:23:01.308 thread=1 00:23:01.308 invalidate=1 00:23:01.308 rw=write 00:23:01.308 time_based=1 00:23:01.308 runtime=60 00:23:01.308 ioengine=libaio 00:23:01.308 direct=1 00:23:01.308 bs=4096 00:23:01.308 iodepth=1 00:23:01.308 norandommap=0 00:23:01.308 numjobs=1 00:23:01.308 00:23:01.308 verify_dump=1 00:23:01.308 verify_backlog=512 00:23:01.308 verify_state_save=0 00:23:01.308 do_verify=1 00:23:01.308 verify=crc32c-intel 00:23:01.308 [job0] 00:23:01.308 filename=/dev/nvme0n1 00:23:01.308 Could not set queue depth (nvme0n1) 00:23:01.566 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:01.566 fio-3.35 00:23:01.566 Starting 1 thread 00:23:04.888 03:18:06 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:04.888 03:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.888 03:18:06 -- common/autotest_common.sh@10 -- # set +x 00:23:04.888 true 00:23:04.888 03:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.888 03:18:06 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:04.888 03:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.888 03:18:06 -- common/autotest_common.sh@10 -- # set +x 00:23:04.888 true 00:23:04.889 03:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.889 03:18:06 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:04.889 03:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.889 03:18:06 -- common/autotest_common.sh@10 -- # set +x 00:23:04.889 true 00:23:04.889 03:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.889 03:18:06 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:04.889 03:18:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:04.889 03:18:06 -- common/autotest_common.sh@10 -- # set +x 00:23:04.889 true 00:23:04.889 03:18:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:04.889 03:18:06 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:07.420 03:18:09 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:07.420 03:18:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.420 03:18:09 -- common/autotest_common.sh@10 -- # set +x 00:23:07.420 true 00:23:07.420 03:18:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.420 03:18:09 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:07.420 03:18:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.420 03:18:09 -- common/autotest_common.sh@10 -- # set +x 00:23:07.420 true 00:23:07.420 03:18:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.420 03:18:09 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:07.420 03:18:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.420 03:18:09 -- common/autotest_common.sh@10 -- # set +x 00:23:07.420 true 00:23:07.420 03:18:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.420 03:18:09 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:07.420 03:18:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.420 03:18:09 -- common/autotest_common.sh@10 -- # set +x 00:23:07.420 true 00:23:07.420 03:18:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.420 03:18:09 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:07.420 03:18:09 -- target/initiator_timeout.sh@54 -- # wait 2510469 00:24:03.644 00:24:03.644 job0: (groupid=0, jobs=1): err= 0: pid=2510539: Wed Nov 27 03:19:04 2024 00:24:03.644 read: IOPS=57, BW=232KiB/s (238kB/s)(13.6MiB/60038msec) 00:24:03.644 slat (usec): min=7, max=9014, avg=17.91, stdev=199.65 00:24:03.644 clat (usec): min=248, max=40793k, avg=16966.92, stdev=691343.96 00:24:03.644 lat (usec): min=256, max=40793k, avg=16984.83, stdev=691343.94 00:24:03.644 clat percentiles (usec): 00:24:03.644 | 1.00th=[ 258], 5.00th=[ 265], 10.00th=[ 269], 00:24:03.644 | 20.00th=[ 277], 30.00th=[ 285], 40.00th=[ 293], 00:24:03.644 | 50.00th=[ 302], 60.00th=[ 318], 70.00th=[ 330], 00:24:03.644 | 80.00th=[ 363], 90.00th=[ 41157], 95.00th=[ 41157], 00:24:03.644 | 99.00th=[ 41681], 99.50th=[ 42206], 99.90th=[ 42206], 00:24:03.644 | 99.95th=[ 44827], 99.99th=[17112761] 00:24:03.644 write: IOPS=59, BW=239KiB/s (245kB/s)(14.0MiB/60038msec); 0 zone resets 00:24:03.644 slat (usec): min=7, max=27938, avg=20.00, stdev=466.50 00:24:03.644 clat (usec): min=176, max=943, avg=222.49, stdev=25.49 00:24:03.644 lat (usec): min=184, max=28174, avg=242.49, stdev=467.52 00:24:03.644 clat percentiles (usec): 00:24:03.644 | 1.00th=[ 182], 5.00th=[ 190], 10.00th=[ 198], 20.00th=[ 206], 00:24:03.644 | 30.00th=[ 210], 40.00th=[ 215], 50.00th=[ 221], 60.00th=[ 225], 00:24:03.644 | 70.00th=[ 233], 80.00th=[ 239], 90.00th=[ 249], 95.00th=[ 265], 00:24:03.644 | 99.00th=[ 289], 99.50th=[ 302], 99.90th=[ 334], 99.95th=[ 343], 00:24:03.644 | 99.99th=[ 947] 00:24:03.644 bw ( KiB/s): min= 2888, max= 6752, per=100.00%, avg=4778.67, stdev=1595.58, samples=6 00:24:03.644 iops : min= 722, max= 1688, avg=1194.67, stdev=398.89, samples=6 00:24:03.645 lat (usec) : 250=46.15%, 500=47.31%, 750=0.45%, 1000=0.08% 00:24:03.645 lat (msec) : 2=0.01%, 50=5.97%, >=2000=0.01% 00:24:03.645 cpu : usr=0.12%, sys=0.19%, ctx=7070, majf=0, minf=1 00:24:03.645 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:03.645 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.645 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:03.645 issued rwts: total=3482,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:03.645 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:03.645 00:24:03.645 Run status group 0 (all jobs): 00:24:03.645 READ: bw=232KiB/s (238kB/s), 232KiB/s-232KiB/s (238kB/s-238kB/s), io=13.6MiB (14.3MB), run=60038-60038msec 00:24:03.645 WRITE: bw=239KiB/s (245kB/s), 239KiB/s-239KiB/s (245kB/s-245kB/s), io=14.0MiB (14.7MB), run=60038-60038msec 00:24:03.645 00:24:03.645 Disk stats (read/write): 00:24:03.645 nvme0n1: ios=3530/3584, merge=0/0, ticks=19419/794, in_queue=20213, util=99.84% 00:24:03.645 03:19:04 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:03.645 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:03.645 03:19:04 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:03.645 03:19:04 -- common/autotest_common.sh@1208 -- # local i=0 00:24:03.645 03:19:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:03.645 03:19:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:03.645 03:19:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:03.645 03:19:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:03.645 03:19:04 -- common/autotest_common.sh@1220 -- # return 0 00:24:03.645 03:19:04 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:03.645 03:19:04 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:03.645 nvmf hotplug test: fio successful as expected 00:24:03.645 03:19:04 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:03.645 03:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:03.645 03:19:04 -- common/autotest_common.sh@10 -- # set +x 00:24:03.645 03:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:03.645 03:19:04 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:03.645 03:19:04 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:03.645 03:19:04 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:03.645 03:19:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:03.645 03:19:04 -- nvmf/common.sh@116 -- # sync 00:24:03.645 03:19:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:03.645 03:19:04 -- nvmf/common.sh@119 -- # set +e 00:24:03.645 03:19:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:03.645 03:19:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:03.645 rmmod nvme_tcp 00:24:03.645 rmmod nvme_fabrics 00:24:03.645 rmmod nvme_keyring 00:24:03.645 03:19:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:03.645 03:19:04 -- nvmf/common.sh@123 -- # set -e 00:24:03.645 03:19:04 -- nvmf/common.sh@124 -- # return 0 00:24:03.645 03:19:04 -- nvmf/common.sh@477 -- # '[' -n 2509789 ']' 00:24:03.645 03:19:04 -- nvmf/common.sh@478 -- # killprocess 2509789 00:24:03.645 03:19:04 -- common/autotest_common.sh@936 -- # '[' -z 2509789 ']' 00:24:03.645 03:19:04 -- common/autotest_common.sh@940 -- # kill -0 2509789 00:24:03.645 03:19:04 -- common/autotest_common.sh@941 -- # uname 00:24:03.645 03:19:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:03.645 03:19:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2509789 00:24:03.645 03:19:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:03.645 03:19:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:03.645 03:19:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2509789' 00:24:03.645 killing process with pid 2509789 00:24:03.645 03:19:04 -- common/autotest_common.sh@955 -- # kill 2509789 00:24:03.645 03:19:04 -- common/autotest_common.sh@960 -- # wait 2509789 00:24:03.645 03:19:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:03.645 03:19:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:03.645 03:19:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:03.645 03:19:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:03.645 03:19:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:03.645 03:19:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:03.645 03:19:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:03.645 03:19:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:04.212 03:19:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:04.212 00:24:04.212 real 1m9.235s 00:24:04.212 user 4m14.409s 00:24:04.212 sys 0m6.647s 00:24:04.212 03:19:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:04.212 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:24:04.212 ************************************ 00:24:04.212 END TEST nvmf_initiator_timeout 00:24:04.212 ************************************ 00:24:04.212 03:19:06 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:04.212 03:19:06 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:04.212 03:19:06 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:04.212 03:19:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:04.212 03:19:06 -- common/autotest_common.sh@10 -- # set +x 00:24:06.741 03:19:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:06.741 03:19:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:06.741 03:19:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:06.741 03:19:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:06.741 03:19:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:06.741 03:19:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:06.741 03:19:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:06.741 03:19:08 -- nvmf/common.sh@294 -- # net_devs=() 00:24:06.741 03:19:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:06.741 03:19:08 -- nvmf/common.sh@295 -- # e810=() 00:24:06.741 03:19:08 -- nvmf/common.sh@295 -- # local -ga e810 00:24:06.741 03:19:08 -- nvmf/common.sh@296 -- # x722=() 00:24:06.741 03:19:08 -- nvmf/common.sh@296 -- # local -ga x722 00:24:06.741 03:19:08 -- nvmf/common.sh@297 -- # mlx=() 00:24:06.741 03:19:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:06.741 03:19:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:06.741 03:19:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:06.741 03:19:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:06.741 03:19:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:06.741 03:19:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:06.741 03:19:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:06.741 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:06.741 03:19:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:06.741 03:19:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:06.741 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:06.741 03:19:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:06.741 03:19:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:06.741 03:19:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:06.741 03:19:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:06.741 03:19:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:06.741 03:19:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:06.741 03:19:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:06.741 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:06.741 03:19:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:06.741 03:19:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:06.741 03:19:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:06.741 03:19:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:06.741 03:19:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:06.741 03:19:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:06.741 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:06.741 03:19:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:06.741 03:19:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:06.741 03:19:08 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:06.741 03:19:08 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:06.741 03:19:08 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:06.741 03:19:08 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:06.741 03:19:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:06.741 03:19:08 -- common/autotest_common.sh@10 -- # set +x 00:24:06.741 ************************************ 00:24:06.741 START TEST nvmf_perf_adq 00:24:06.741 ************************************ 00:24:06.741 03:19:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:06.741 * Looking for test storage... 00:24:06.741 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:06.741 03:19:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:06.741 03:19:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:06.741 03:19:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:06.741 03:19:08 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:06.741 03:19:08 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:06.741 03:19:08 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:06.741 03:19:08 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:06.741 03:19:08 -- scripts/common.sh@335 -- # IFS=.-: 00:24:06.741 03:19:08 -- scripts/common.sh@335 -- # read -ra ver1 00:24:06.741 03:19:08 -- scripts/common.sh@336 -- # IFS=.-: 00:24:06.741 03:19:08 -- scripts/common.sh@336 -- # read -ra ver2 00:24:06.741 03:19:08 -- scripts/common.sh@337 -- # local 'op=<' 00:24:06.741 03:19:08 -- scripts/common.sh@339 -- # ver1_l=2 00:24:06.741 03:19:08 -- scripts/common.sh@340 -- # ver2_l=1 00:24:06.741 03:19:08 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:06.741 03:19:08 -- scripts/common.sh@343 -- # case "$op" in 00:24:06.741 03:19:08 -- scripts/common.sh@344 -- # : 1 00:24:06.741 03:19:08 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:06.741 03:19:08 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:06.741 03:19:08 -- scripts/common.sh@364 -- # decimal 1 00:24:06.741 03:19:08 -- scripts/common.sh@352 -- # local d=1 00:24:06.741 03:19:08 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:06.741 03:19:08 -- scripts/common.sh@354 -- # echo 1 00:24:06.741 03:19:08 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:06.741 03:19:08 -- scripts/common.sh@365 -- # decimal 2 00:24:06.741 03:19:08 -- scripts/common.sh@352 -- # local d=2 00:24:06.741 03:19:08 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:06.741 03:19:08 -- scripts/common.sh@354 -- # echo 2 00:24:06.741 03:19:08 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:06.741 03:19:08 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:06.741 03:19:08 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:06.741 03:19:08 -- scripts/common.sh@367 -- # return 0 00:24:06.741 03:19:08 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:06.741 03:19:08 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:06.741 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:06.741 --rc genhtml_branch_coverage=1 00:24:06.741 --rc genhtml_function_coverage=1 00:24:06.741 --rc genhtml_legend=1 00:24:06.742 --rc geninfo_all_blocks=1 00:24:06.742 --rc geninfo_unexecuted_blocks=1 00:24:06.742 00:24:06.742 ' 00:24:06.742 03:19:08 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:06.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:06.742 --rc genhtml_branch_coverage=1 00:24:06.742 --rc genhtml_function_coverage=1 00:24:06.742 --rc genhtml_legend=1 00:24:06.742 --rc geninfo_all_blocks=1 00:24:06.742 --rc geninfo_unexecuted_blocks=1 00:24:06.742 00:24:06.742 ' 00:24:06.742 03:19:08 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:06.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:06.742 --rc genhtml_branch_coverage=1 00:24:06.742 --rc genhtml_function_coverage=1 00:24:06.742 --rc genhtml_legend=1 00:24:06.742 --rc geninfo_all_blocks=1 00:24:06.742 --rc geninfo_unexecuted_blocks=1 00:24:06.742 00:24:06.742 ' 00:24:06.742 03:19:08 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:06.742 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:06.742 --rc genhtml_branch_coverage=1 00:24:06.742 --rc genhtml_function_coverage=1 00:24:06.742 --rc genhtml_legend=1 00:24:06.742 --rc geninfo_all_blocks=1 00:24:06.742 --rc geninfo_unexecuted_blocks=1 00:24:06.742 00:24:06.742 ' 00:24:06.742 03:19:08 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:06.742 03:19:08 -- nvmf/common.sh@7 -- # uname -s 00:24:06.742 03:19:08 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:06.742 03:19:08 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:06.742 03:19:08 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:06.742 03:19:08 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:06.742 03:19:08 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:06.742 03:19:08 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:06.742 03:19:08 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:06.742 03:19:08 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:06.742 03:19:08 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:06.742 03:19:08 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:06.742 03:19:08 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:06.742 03:19:08 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:06.742 03:19:08 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:06.742 03:19:08 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:06.742 03:19:08 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:06.742 03:19:08 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:06.742 03:19:08 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:06.742 03:19:08 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:06.742 03:19:08 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:06.742 03:19:08 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.742 03:19:08 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.742 03:19:08 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.742 03:19:08 -- paths/export.sh@5 -- # export PATH 00:24:06.742 03:19:08 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:06.742 03:19:08 -- nvmf/common.sh@46 -- # : 0 00:24:06.742 03:19:08 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:06.742 03:19:08 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:06.742 03:19:08 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:06.742 03:19:08 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:06.742 03:19:08 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:06.742 03:19:08 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:06.742 03:19:08 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:06.742 03:19:08 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:06.742 03:19:08 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:06.742 03:19:08 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:06.742 03:19:08 -- common/autotest_common.sh@10 -- # set +x 00:24:08.642 03:19:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:08.642 03:19:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:08.642 03:19:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:08.642 03:19:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:08.642 03:19:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:08.642 03:19:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:08.642 03:19:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:08.642 03:19:10 -- nvmf/common.sh@294 -- # net_devs=() 00:24:08.642 03:19:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:08.642 03:19:10 -- nvmf/common.sh@295 -- # e810=() 00:24:08.642 03:19:10 -- nvmf/common.sh@295 -- # local -ga e810 00:24:08.642 03:19:10 -- nvmf/common.sh@296 -- # x722=() 00:24:08.642 03:19:10 -- nvmf/common.sh@296 -- # local -ga x722 00:24:08.642 03:19:10 -- nvmf/common.sh@297 -- # mlx=() 00:24:08.642 03:19:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:08.642 03:19:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:08.642 03:19:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:08.642 03:19:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:08.642 03:19:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:08.642 03:19:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:08.642 03:19:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:08.642 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:08.642 03:19:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:08.642 03:19:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:08.642 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:08.642 03:19:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:08.642 03:19:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:08.642 03:19:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:08.642 03:19:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:08.642 03:19:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:08.642 03:19:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:08.642 03:19:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:08.642 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:08.642 03:19:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:08.642 03:19:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:08.642 03:19:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:08.642 03:19:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:08.642 03:19:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:08.642 03:19:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:08.642 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:08.642 03:19:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:08.642 03:19:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:08.642 03:19:10 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:08.642 03:19:10 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:08.642 03:19:10 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:08.642 03:19:10 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:08.642 03:19:10 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:09.210 03:19:11 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:11.858 03:19:13 -- target/perf_adq.sh@54 -- # sleep 5 00:24:17.136 03:19:18 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:17.136 03:19:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:17.136 03:19:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:17.136 03:19:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:17.136 03:19:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:17.136 03:19:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:17.136 03:19:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:17.136 03:19:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:17.136 03:19:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:17.136 03:19:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:17.136 03:19:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:17.136 03:19:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:17.136 03:19:18 -- common/autotest_common.sh@10 -- # set +x 00:24:17.136 03:19:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:17.136 03:19:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:17.136 03:19:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:17.136 03:19:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:17.136 03:19:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:17.136 03:19:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:17.136 03:19:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:17.136 03:19:18 -- nvmf/common.sh@294 -- # net_devs=() 00:24:17.136 03:19:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:17.136 03:19:18 -- nvmf/common.sh@295 -- # e810=() 00:24:17.136 03:19:18 -- nvmf/common.sh@295 -- # local -ga e810 00:24:17.136 03:19:18 -- nvmf/common.sh@296 -- # x722=() 00:24:17.136 03:19:18 -- nvmf/common.sh@296 -- # local -ga x722 00:24:17.136 03:19:18 -- nvmf/common.sh@297 -- # mlx=() 00:24:17.136 03:19:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:17.136 03:19:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:17.136 03:19:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:17.136 03:19:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:17.136 03:19:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:17.136 03:19:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:17.136 03:19:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:17.137 03:19:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:17.137 03:19:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:17.137 03:19:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:17.137 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:17.137 03:19:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:17.137 03:19:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:17.137 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:17.137 03:19:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:17.137 03:19:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:17.137 03:19:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:17.137 03:19:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:17.137 03:19:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:17.137 03:19:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:17.137 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:17.137 03:19:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:17.137 03:19:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:17.137 03:19:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:17.137 03:19:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:17.137 03:19:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:17.137 03:19:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:17.137 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:17.137 03:19:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:17.137 03:19:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:17.137 03:19:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:17.137 03:19:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:17.137 03:19:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:17.137 03:19:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:17.137 03:19:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:17.137 03:19:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:17.137 03:19:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:17.137 03:19:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:17.137 03:19:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:17.137 03:19:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:17.137 03:19:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:17.137 03:19:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:17.137 03:19:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:17.137 03:19:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:17.137 03:19:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:17.137 03:19:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:17.137 03:19:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:17.137 03:19:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:17.137 03:19:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:17.137 03:19:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:17.137 03:19:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:17.137 03:19:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:17.137 03:19:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:17.137 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:17.137 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.329 ms 00:24:17.137 00:24:17.137 --- 10.0.0.2 ping statistics --- 00:24:17.137 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:17.137 rtt min/avg/max/mdev = 0.329/0.329/0.329/0.000 ms 00:24:17.137 03:19:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:17.137 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:17.137 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.052 ms 00:24:17.137 00:24:17.137 --- 10.0.0.1 ping statistics --- 00:24:17.137 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:17.137 rtt min/avg/max/mdev = 0.052/0.052/0.052/0.000 ms 00:24:17.137 03:19:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:17.137 03:19:19 -- nvmf/common.sh@410 -- # return 0 00:24:17.137 03:19:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:17.137 03:19:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:17.137 03:19:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:17.137 03:19:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:17.137 03:19:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:17.137 03:19:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:17.137 03:19:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:17.137 03:19:19 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:17.137 03:19:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:17.137 03:19:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:17.137 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.137 03:19:19 -- nvmf/common.sh@469 -- # nvmfpid=2522997 00:24:17.137 03:19:19 -- nvmf/common.sh@470 -- # waitforlisten 2522997 00:24:17.137 03:19:19 -- common/autotest_common.sh@829 -- # '[' -z 2522997 ']' 00:24:17.137 03:19:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:17.137 03:19:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:17.137 03:19:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:17.137 03:19:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:17.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:17.137 03:19:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:17.137 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.137 [2024-11-27 03:19:19.211411] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:17.137 [2024-11-27 03:19:19.211482] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:17.137 EAL: No free 2048 kB hugepages reported on node 1 00:24:17.137 [2024-11-27 03:19:19.276925] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:17.137 [2024-11-27 03:19:19.361436] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:17.137 [2024-11-27 03:19:19.361612] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:17.137 [2024-11-27 03:19:19.361631] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:17.137 [2024-11-27 03:19:19.361643] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:17.137 [2024-11-27 03:19:19.361695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:17.137 [2024-11-27 03:19:19.361763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:17.137 [2024-11-27 03:19:19.361824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:17.137 [2024-11-27 03:19:19.361827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:17.137 03:19:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:17.137 03:19:19 -- common/autotest_common.sh@862 -- # return 0 00:24:17.137 03:19:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:17.137 03:19:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:17.137 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.137 03:19:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:17.137 03:19:19 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:17.137 03:19:19 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:17.137 03:19:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:17.137 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.137 03:19:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:17.137 03:19:19 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:17.137 03:19:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:17.137 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.137 03:19:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:17.137 03:19:19 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:17.137 03:19:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:17.137 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.137 [2024-11-27 03:19:19.563041] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:17.137 03:19:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:17.137 03:19:19 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:17.137 03:19:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:17.137 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.137 Malloc1 00:24:17.137 03:19:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:17.137 03:19:19 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:17.137 03:19:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:17.137 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.137 03:19:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:17.137 03:19:19 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:17.137 03:19:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:17.138 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.138 03:19:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:17.138 03:19:19 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:17.138 03:19:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:17.138 03:19:19 -- common/autotest_common.sh@10 -- # set +x 00:24:17.138 [2024-11-27 03:19:19.613764] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:17.138 03:19:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:17.138 03:19:19 -- target/perf_adq.sh@73 -- # perfpid=2523023 00:24:17.138 03:19:19 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:17.138 03:19:19 -- target/perf_adq.sh@74 -- # sleep 2 00:24:17.138 EAL: No free 2048 kB hugepages reported on node 1 00:24:19.036 03:19:21 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:19.036 03:19:21 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:19.036 03:19:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:19.036 03:19:21 -- common/autotest_common.sh@10 -- # set +x 00:24:19.036 03:19:21 -- target/perf_adq.sh@76 -- # wc -l 00:24:19.036 03:19:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:19.294 03:19:21 -- target/perf_adq.sh@76 -- # count=4 00:24:19.294 03:19:21 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:19.294 03:19:21 -- target/perf_adq.sh@81 -- # wait 2523023 00:24:27.401 Initializing NVMe Controllers 00:24:27.401 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:27.401 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:27.401 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:27.401 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:27.401 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:27.401 Initialization complete. Launching workers. 00:24:27.401 ======================================================== 00:24:27.401 Latency(us) 00:24:27.401 Device Information : IOPS MiB/s Average min max 00:24:27.401 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11336.00 44.28 5646.63 1739.62 9783.07 00:24:27.401 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10993.00 42.94 5823.68 1348.60 9905.10 00:24:27.401 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 10869.10 42.46 5889.85 2076.55 8827.96 00:24:27.401 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11366.10 44.40 5630.93 1591.24 9663.04 00:24:27.401 ======================================================== 00:24:27.401 Total : 44564.19 174.08 5745.62 1348.60 9905.10 00:24:27.401 00:24:27.401 03:19:29 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:27.401 03:19:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:27.401 03:19:29 -- nvmf/common.sh@116 -- # sync 00:24:27.401 03:19:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:27.401 03:19:29 -- nvmf/common.sh@119 -- # set +e 00:24:27.401 03:19:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:27.401 03:19:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:27.401 rmmod nvme_tcp 00:24:27.401 rmmod nvme_fabrics 00:24:27.401 rmmod nvme_keyring 00:24:27.401 03:19:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:27.401 03:19:29 -- nvmf/common.sh@123 -- # set -e 00:24:27.401 03:19:29 -- nvmf/common.sh@124 -- # return 0 00:24:27.401 03:19:29 -- nvmf/common.sh@477 -- # '[' -n 2522997 ']' 00:24:27.401 03:19:29 -- nvmf/common.sh@478 -- # killprocess 2522997 00:24:27.401 03:19:29 -- common/autotest_common.sh@936 -- # '[' -z 2522997 ']' 00:24:27.401 03:19:29 -- common/autotest_common.sh@940 -- # kill -0 2522997 00:24:27.401 03:19:29 -- common/autotest_common.sh@941 -- # uname 00:24:27.401 03:19:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:27.401 03:19:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2522997 00:24:27.401 03:19:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:27.401 03:19:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:27.401 03:19:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2522997' 00:24:27.401 killing process with pid 2522997 00:24:27.401 03:19:29 -- common/autotest_common.sh@955 -- # kill 2522997 00:24:27.401 03:19:29 -- common/autotest_common.sh@960 -- # wait 2522997 00:24:27.660 03:19:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:27.660 03:19:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:27.660 03:19:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:27.660 03:19:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:27.660 03:19:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:27.660 03:19:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:27.660 03:19:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:27.660 03:19:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:29.560 03:19:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:29.561 03:19:32 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:29.561 03:19:32 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:30.495 03:19:32 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:33.027 03:19:35 -- target/perf_adq.sh@54 -- # sleep 5 00:24:38.302 03:19:40 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:38.302 03:19:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:38.302 03:19:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:38.302 03:19:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:38.302 03:19:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:38.302 03:19:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:38.302 03:19:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:38.302 03:19:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:38.302 03:19:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:38.302 03:19:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:38.302 03:19:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:38.302 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.302 03:19:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:38.302 03:19:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:38.302 03:19:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:38.302 03:19:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:38.302 03:19:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:38.302 03:19:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:38.302 03:19:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:38.302 03:19:40 -- nvmf/common.sh@294 -- # net_devs=() 00:24:38.302 03:19:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:38.302 03:19:40 -- nvmf/common.sh@295 -- # e810=() 00:24:38.302 03:19:40 -- nvmf/common.sh@295 -- # local -ga e810 00:24:38.302 03:19:40 -- nvmf/common.sh@296 -- # x722=() 00:24:38.302 03:19:40 -- nvmf/common.sh@296 -- # local -ga x722 00:24:38.302 03:19:40 -- nvmf/common.sh@297 -- # mlx=() 00:24:38.302 03:19:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:38.302 03:19:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:38.302 03:19:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:38.302 03:19:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:38.302 03:19:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:38.302 03:19:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:38.302 03:19:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:38.302 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:38.302 03:19:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:38.302 03:19:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:38.302 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:38.302 03:19:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:38.302 03:19:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:38.302 03:19:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:38.302 03:19:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:38.302 03:19:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:38.302 03:19:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:38.302 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:38.302 03:19:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:38.302 03:19:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:38.302 03:19:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:38.302 03:19:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:38.302 03:19:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:38.302 03:19:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:38.302 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:38.302 03:19:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:38.302 03:19:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:38.302 03:19:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:38.302 03:19:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:38.302 03:19:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:38.302 03:19:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:38.302 03:19:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:38.302 03:19:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:38.302 03:19:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:38.302 03:19:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:38.302 03:19:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:38.302 03:19:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:38.302 03:19:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:38.302 03:19:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:38.302 03:19:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:38.302 03:19:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:38.302 03:19:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:38.302 03:19:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:38.302 03:19:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:38.302 03:19:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:38.302 03:19:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:38.302 03:19:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:38.302 03:19:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:38.302 03:19:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:38.302 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:38.302 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:24:38.302 00:24:38.302 --- 10.0.0.2 ping statistics --- 00:24:38.302 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:38.302 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:24:38.302 03:19:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:38.302 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:38.302 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.072 ms 00:24:38.302 00:24:38.302 --- 10.0.0.1 ping statistics --- 00:24:38.302 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:38.302 rtt min/avg/max/mdev = 0.072/0.072/0.072/0.000 ms 00:24:38.302 03:19:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:38.302 03:19:40 -- nvmf/common.sh@410 -- # return 0 00:24:38.302 03:19:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:38.302 03:19:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:38.302 03:19:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:38.302 03:19:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:38.302 03:19:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:38.302 03:19:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:38.302 03:19:40 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:38.302 03:19:40 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:38.302 03:19:40 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:38.302 03:19:40 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:38.302 net.core.busy_poll = 1 00:24:38.302 03:19:40 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:38.303 net.core.busy_read = 1 00:24:38.303 03:19:40 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:38.303 03:19:40 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:38.303 03:19:40 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:38.303 03:19:40 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:38.303 03:19:40 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:38.303 03:19:40 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:38.303 03:19:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:38.303 03:19:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:38.303 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.303 03:19:40 -- nvmf/common.sh@469 -- # nvmfpid=2525835 00:24:38.303 03:19:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:38.303 03:19:40 -- nvmf/common.sh@470 -- # waitforlisten 2525835 00:24:38.303 03:19:40 -- common/autotest_common.sh@829 -- # '[' -z 2525835 ']' 00:24:38.303 03:19:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:38.303 03:19:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:38.303 03:19:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:38.303 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:38.303 03:19:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:38.303 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.303 [2024-11-27 03:19:40.556231] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:38.303 [2024-11-27 03:19:40.556304] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:38.303 EAL: No free 2048 kB hugepages reported on node 1 00:24:38.303 [2024-11-27 03:19:40.621632] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:38.303 [2024-11-27 03:19:40.707465] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:38.303 [2024-11-27 03:19:40.707628] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:38.303 [2024-11-27 03:19:40.707645] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:38.303 [2024-11-27 03:19:40.707657] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:38.303 [2024-11-27 03:19:40.707712] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:38.303 [2024-11-27 03:19:40.707772] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:38.303 [2024-11-27 03:19:40.707834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:38.303 [2024-11-27 03:19:40.707836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:38.303 03:19:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:38.303 03:19:40 -- common/autotest_common.sh@862 -- # return 0 00:24:38.303 03:19:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:38.303 03:19:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:38.303 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.303 03:19:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:38.303 03:19:40 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:38.303 03:19:40 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:38.303 03:19:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.303 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.303 03:19:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.303 03:19:40 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:38.303 03:19:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.303 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.303 03:19:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.303 03:19:40 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:38.303 03:19:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.303 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.303 [2024-11-27 03:19:40.908101] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:38.303 03:19:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.303 03:19:40 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:38.303 03:19:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.303 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.563 Malloc1 00:24:38.563 03:19:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.563 03:19:40 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:38.563 03:19:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.563 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.563 03:19:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.563 03:19:40 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:38.563 03:19:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.563 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.563 03:19:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.563 03:19:40 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:38.563 03:19:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.563 03:19:40 -- common/autotest_common.sh@10 -- # set +x 00:24:38.563 [2024-11-27 03:19:40.959205] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:38.563 03:19:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.563 03:19:40 -- target/perf_adq.sh@94 -- # perfpid=2525862 00:24:38.563 03:19:40 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:38.563 03:19:40 -- target/perf_adq.sh@95 -- # sleep 2 00:24:38.563 EAL: No free 2048 kB hugepages reported on node 1 00:24:40.469 03:19:42 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:40.469 03:19:42 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:40.469 03:19:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:40.470 03:19:42 -- target/perf_adq.sh@97 -- # wc -l 00:24:40.470 03:19:42 -- common/autotest_common.sh@10 -- # set +x 00:24:40.470 03:19:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:40.470 03:19:43 -- target/perf_adq.sh@97 -- # count=2 00:24:40.470 03:19:43 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:24:40.470 03:19:43 -- target/perf_adq.sh@103 -- # wait 2525862 00:24:48.586 Initializing NVMe Controllers 00:24:48.586 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:48.586 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:48.586 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:48.586 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:48.586 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:48.586 Initialization complete. Launching workers. 00:24:48.586 ======================================================== 00:24:48.586 Latency(us) 00:24:48.586 Device Information : IOPS MiB/s Average min max 00:24:48.586 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7866.10 30.73 8137.83 1219.97 54286.85 00:24:48.586 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 6996.70 27.33 9147.87 1251.89 53350.31 00:24:48.586 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 6752.00 26.37 9479.38 1321.00 53154.33 00:24:48.586 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 6688.30 26.13 9599.81 1226.40 53180.08 00:24:48.586 ======================================================== 00:24:48.586 Total : 28303.09 110.56 9053.04 1219.97 54286.85 00:24:48.586 00:24:48.586 03:19:51 -- target/perf_adq.sh@104 -- # nvmftestfini 00:24:48.586 03:19:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:48.586 03:19:51 -- nvmf/common.sh@116 -- # sync 00:24:48.586 03:19:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:48.586 03:19:51 -- nvmf/common.sh@119 -- # set +e 00:24:48.586 03:19:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:48.586 03:19:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:48.586 rmmod nvme_tcp 00:24:48.586 rmmod nvme_fabrics 00:24:48.586 rmmod nvme_keyring 00:24:48.586 03:19:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:48.586 03:19:51 -- nvmf/common.sh@123 -- # set -e 00:24:48.586 03:19:51 -- nvmf/common.sh@124 -- # return 0 00:24:48.586 03:19:51 -- nvmf/common.sh@477 -- # '[' -n 2525835 ']' 00:24:48.586 03:19:51 -- nvmf/common.sh@478 -- # killprocess 2525835 00:24:48.586 03:19:51 -- common/autotest_common.sh@936 -- # '[' -z 2525835 ']' 00:24:48.586 03:19:51 -- common/autotest_common.sh@940 -- # kill -0 2525835 00:24:48.586 03:19:51 -- common/autotest_common.sh@941 -- # uname 00:24:48.586 03:19:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:48.586 03:19:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2525835 00:24:48.586 03:19:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:48.586 03:19:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:48.586 03:19:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2525835' 00:24:48.586 killing process with pid 2525835 00:24:48.586 03:19:51 -- common/autotest_common.sh@955 -- # kill 2525835 00:24:48.586 03:19:51 -- common/autotest_common.sh@960 -- # wait 2525835 00:24:48.845 03:19:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:48.845 03:19:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:48.845 03:19:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:48.845 03:19:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:48.845 03:19:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:48.845 03:19:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:48.845 03:19:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:48.845 03:19:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:51.384 03:19:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:51.384 03:19:53 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:24:51.384 00:24:51.384 real 0m44.669s 00:24:51.384 user 2m38.539s 00:24:51.384 sys 0m9.830s 00:24:51.384 03:19:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:51.384 03:19:53 -- common/autotest_common.sh@10 -- # set +x 00:24:51.384 ************************************ 00:24:51.384 END TEST nvmf_perf_adq 00:24:51.384 ************************************ 00:24:51.384 03:19:53 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:51.384 03:19:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:51.384 03:19:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:51.384 03:19:53 -- common/autotest_common.sh@10 -- # set +x 00:24:51.384 ************************************ 00:24:51.384 START TEST nvmf_shutdown 00:24:51.384 ************************************ 00:24:51.384 03:19:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:24:51.384 * Looking for test storage... 00:24:51.384 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:51.384 03:19:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:51.384 03:19:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:51.384 03:19:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:51.384 03:19:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:51.384 03:19:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:51.384 03:19:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:51.385 03:19:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:51.385 03:19:53 -- scripts/common.sh@335 -- # IFS=.-: 00:24:51.385 03:19:53 -- scripts/common.sh@335 -- # read -ra ver1 00:24:51.385 03:19:53 -- scripts/common.sh@336 -- # IFS=.-: 00:24:51.385 03:19:53 -- scripts/common.sh@336 -- # read -ra ver2 00:24:51.385 03:19:53 -- scripts/common.sh@337 -- # local 'op=<' 00:24:51.385 03:19:53 -- scripts/common.sh@339 -- # ver1_l=2 00:24:51.385 03:19:53 -- scripts/common.sh@340 -- # ver2_l=1 00:24:51.385 03:19:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:51.385 03:19:53 -- scripts/common.sh@343 -- # case "$op" in 00:24:51.385 03:19:53 -- scripts/common.sh@344 -- # : 1 00:24:51.385 03:19:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:51.385 03:19:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:51.385 03:19:53 -- scripts/common.sh@364 -- # decimal 1 00:24:51.385 03:19:53 -- scripts/common.sh@352 -- # local d=1 00:24:51.385 03:19:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:51.385 03:19:53 -- scripts/common.sh@354 -- # echo 1 00:24:51.385 03:19:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:51.385 03:19:53 -- scripts/common.sh@365 -- # decimal 2 00:24:51.385 03:19:53 -- scripts/common.sh@352 -- # local d=2 00:24:51.385 03:19:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:51.385 03:19:53 -- scripts/common.sh@354 -- # echo 2 00:24:51.385 03:19:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:51.385 03:19:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:51.385 03:19:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:51.385 03:19:53 -- scripts/common.sh@367 -- # return 0 00:24:51.385 03:19:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:51.385 03:19:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:51.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:51.385 --rc genhtml_branch_coverage=1 00:24:51.385 --rc genhtml_function_coverage=1 00:24:51.385 --rc genhtml_legend=1 00:24:51.385 --rc geninfo_all_blocks=1 00:24:51.385 --rc geninfo_unexecuted_blocks=1 00:24:51.385 00:24:51.385 ' 00:24:51.385 03:19:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:51.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:51.385 --rc genhtml_branch_coverage=1 00:24:51.385 --rc genhtml_function_coverage=1 00:24:51.385 --rc genhtml_legend=1 00:24:51.385 --rc geninfo_all_blocks=1 00:24:51.385 --rc geninfo_unexecuted_blocks=1 00:24:51.385 00:24:51.385 ' 00:24:51.385 03:19:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:51.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:51.385 --rc genhtml_branch_coverage=1 00:24:51.385 --rc genhtml_function_coverage=1 00:24:51.385 --rc genhtml_legend=1 00:24:51.385 --rc geninfo_all_blocks=1 00:24:51.385 --rc geninfo_unexecuted_blocks=1 00:24:51.385 00:24:51.385 ' 00:24:51.385 03:19:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:51.385 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:51.385 --rc genhtml_branch_coverage=1 00:24:51.385 --rc genhtml_function_coverage=1 00:24:51.385 --rc genhtml_legend=1 00:24:51.385 --rc geninfo_all_blocks=1 00:24:51.385 --rc geninfo_unexecuted_blocks=1 00:24:51.385 00:24:51.385 ' 00:24:51.385 03:19:53 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:51.385 03:19:53 -- nvmf/common.sh@7 -- # uname -s 00:24:51.385 03:19:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:51.385 03:19:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:51.385 03:19:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:51.385 03:19:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:51.385 03:19:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:51.385 03:19:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:51.385 03:19:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:51.385 03:19:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:51.385 03:19:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:51.385 03:19:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:51.385 03:19:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:51.385 03:19:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:51.385 03:19:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:51.385 03:19:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:51.385 03:19:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:51.385 03:19:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:51.385 03:19:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:51.385 03:19:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:51.385 03:19:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:51.385 03:19:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:51.385 03:19:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:51.385 03:19:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:51.385 03:19:53 -- paths/export.sh@5 -- # export PATH 00:24:51.385 03:19:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:51.385 03:19:53 -- nvmf/common.sh@46 -- # : 0 00:24:51.385 03:19:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:51.385 03:19:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:51.385 03:19:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:51.385 03:19:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:51.385 03:19:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:51.385 03:19:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:51.385 03:19:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:51.385 03:19:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:51.385 03:19:53 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:51.385 03:19:53 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:51.385 03:19:53 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:24:51.385 03:19:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:51.385 03:19:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:51.385 03:19:53 -- common/autotest_common.sh@10 -- # set +x 00:24:51.385 ************************************ 00:24:51.385 START TEST nvmf_shutdown_tc1 00:24:51.385 ************************************ 00:24:51.385 03:19:53 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:24:51.385 03:19:53 -- target/shutdown.sh@74 -- # starttarget 00:24:51.385 03:19:53 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:51.385 03:19:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:51.385 03:19:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:51.385 03:19:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:51.385 03:19:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:51.385 03:19:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:51.385 03:19:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:51.385 03:19:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:51.385 03:19:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:51.386 03:19:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:51.386 03:19:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:51.386 03:19:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:51.386 03:19:53 -- common/autotest_common.sh@10 -- # set +x 00:24:53.289 03:19:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:53.289 03:19:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:53.289 03:19:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:53.289 03:19:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:53.289 03:19:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:53.289 03:19:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:53.289 03:19:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:53.289 03:19:55 -- nvmf/common.sh@294 -- # net_devs=() 00:24:53.289 03:19:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:53.289 03:19:55 -- nvmf/common.sh@295 -- # e810=() 00:24:53.289 03:19:55 -- nvmf/common.sh@295 -- # local -ga e810 00:24:53.289 03:19:55 -- nvmf/common.sh@296 -- # x722=() 00:24:53.289 03:19:55 -- nvmf/common.sh@296 -- # local -ga x722 00:24:53.289 03:19:55 -- nvmf/common.sh@297 -- # mlx=() 00:24:53.289 03:19:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:53.289 03:19:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:53.289 03:19:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:53.289 03:19:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:53.289 03:19:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:53.289 03:19:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:53.289 03:19:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:53.289 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:53.289 03:19:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:53.289 03:19:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:53.289 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:53.289 03:19:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:53.289 03:19:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:53.289 03:19:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:53.289 03:19:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:53.289 03:19:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:53.289 03:19:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:53.289 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:53.289 03:19:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:53.289 03:19:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:53.289 03:19:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:53.289 03:19:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:53.289 03:19:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:53.289 03:19:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:53.289 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:53.289 03:19:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:53.289 03:19:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:53.289 03:19:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:53.289 03:19:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:53.289 03:19:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:53.289 03:19:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:53.289 03:19:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:53.289 03:19:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:53.289 03:19:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:53.289 03:19:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:53.289 03:19:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:53.289 03:19:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:53.289 03:19:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:53.289 03:19:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:53.289 03:19:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:53.289 03:19:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:53.289 03:19:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:53.289 03:19:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:53.289 03:19:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:53.289 03:19:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:53.289 03:19:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:53.289 03:19:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:53.289 03:19:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:53.289 03:19:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:53.289 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:53.289 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:24:53.289 00:24:53.289 --- 10.0.0.2 ping statistics --- 00:24:53.289 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:53.289 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:24:53.289 03:19:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:53.289 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:53.289 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:24:53.289 00:24:53.289 --- 10.0.0.1 ping statistics --- 00:24:53.289 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:53.289 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:24:53.289 03:19:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:53.289 03:19:55 -- nvmf/common.sh@410 -- # return 0 00:24:53.289 03:19:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:53.289 03:19:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:53.289 03:19:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:53.289 03:19:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:53.289 03:19:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:53.289 03:19:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:53.289 03:19:55 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:53.550 03:19:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:53.551 03:19:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:53.551 03:19:55 -- common/autotest_common.sh@10 -- # set +x 00:24:53.551 03:19:55 -- nvmf/common.sh@469 -- # nvmfpid=2529073 00:24:53.551 03:19:55 -- nvmf/common.sh@470 -- # waitforlisten 2529073 00:24:53.551 03:19:55 -- common/autotest_common.sh@829 -- # '[' -z 2529073 ']' 00:24:53.551 03:19:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:53.551 03:19:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:53.551 03:19:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:53.551 03:19:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:53.551 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:53.551 03:19:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:53.551 03:19:55 -- common/autotest_common.sh@10 -- # set +x 00:24:53.551 [2024-11-27 03:19:55.955308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:53.551 [2024-11-27 03:19:55.955405] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:53.551 EAL: No free 2048 kB hugepages reported on node 1 00:24:53.551 [2024-11-27 03:19:56.024863] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:53.551 [2024-11-27 03:19:56.117459] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:53.551 [2024-11-27 03:19:56.117645] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:53.551 [2024-11-27 03:19:56.117668] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:53.551 [2024-11-27 03:19:56.117684] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:53.551 [2024-11-27 03:19:56.117770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:53.551 [2024-11-27 03:19:56.117844] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:53.551 [2024-11-27 03:19:56.117898] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:53.551 [2024-11-27 03:19:56.117901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:54.487 03:19:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:54.487 03:19:56 -- common/autotest_common.sh@862 -- # return 0 00:24:54.487 03:19:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:54.487 03:19:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:54.487 03:19:56 -- common/autotest_common.sh@10 -- # set +x 00:24:54.487 03:19:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:54.487 03:19:56 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:54.487 03:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:54.487 03:19:56 -- common/autotest_common.sh@10 -- # set +x 00:24:54.487 [2024-11-27 03:19:56.937171] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:54.487 03:19:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:54.487 03:19:56 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:54.487 03:19:56 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:54.487 03:19:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:54.487 03:19:56 -- common/autotest_common.sh@10 -- # set +x 00:24:54.487 03:19:56 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:54.487 03:19:56 -- target/shutdown.sh@28 -- # cat 00:24:54.487 03:19:56 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:54.487 03:19:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:54.487 03:19:56 -- common/autotest_common.sh@10 -- # set +x 00:24:54.487 Malloc1 00:24:54.487 [2024-11-27 03:19:57.026474] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:54.487 Malloc2 00:24:54.487 Malloc3 00:24:54.747 Malloc4 00:24:54.747 Malloc5 00:24:54.747 Malloc6 00:24:54.747 Malloc7 00:24:54.747 Malloc8 00:24:55.005 Malloc9 00:24:55.005 Malloc10 00:24:55.005 03:19:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.005 03:19:57 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:55.005 03:19:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:55.005 03:19:57 -- common/autotest_common.sh@10 -- # set +x 00:24:55.005 03:19:57 -- target/shutdown.sh@78 -- # perfpid=2529362 00:24:55.005 03:19:57 -- target/shutdown.sh@79 -- # waitforlisten 2529362 /var/tmp/bdevperf.sock 00:24:55.005 03:19:57 -- common/autotest_common.sh@829 -- # '[' -z 2529362 ']' 00:24:55.005 03:19:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:55.005 03:19:57 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:55.005 03:19:57 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:55.005 03:19:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:55.005 03:19:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:55.005 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:55.005 03:19:57 -- nvmf/common.sh@520 -- # config=() 00:24:55.005 03:19:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:55.005 03:19:57 -- nvmf/common.sh@520 -- # local subsystem config 00:24:55.005 03:19:57 -- common/autotest_common.sh@10 -- # set +x 00:24:55.005 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.005 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.005 { 00:24:55.005 "params": { 00:24:55.005 "name": "Nvme$subsystem", 00:24:55.005 "trtype": "$TEST_TRANSPORT", 00:24:55.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.005 "adrfam": "ipv4", 00:24:55.005 "trsvcid": "$NVMF_PORT", 00:24:55.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.005 "hdgst": ${hdgst:-false}, 00:24:55.005 "ddgst": ${ddgst:-false} 00:24:55.005 }, 00:24:55.005 "method": "bdev_nvme_attach_controller" 00:24:55.005 } 00:24:55.005 EOF 00:24:55.005 )") 00:24:55.005 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.005 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.005 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.005 { 00:24:55.005 "params": { 00:24:55.005 "name": "Nvme$subsystem", 00:24:55.005 "trtype": "$TEST_TRANSPORT", 00:24:55.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.005 "adrfam": "ipv4", 00:24:55.005 "trsvcid": "$NVMF_PORT", 00:24:55.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.005 "hdgst": ${hdgst:-false}, 00:24:55.005 "ddgst": ${ddgst:-false} 00:24:55.005 }, 00:24:55.005 "method": "bdev_nvme_attach_controller" 00:24:55.005 } 00:24:55.005 EOF 00:24:55.005 )") 00:24:55.005 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.005 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.005 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.005 { 00:24:55.005 "params": { 00:24:55.005 "name": "Nvme$subsystem", 00:24:55.005 "trtype": "$TEST_TRANSPORT", 00:24:55.005 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.005 "adrfam": "ipv4", 00:24:55.005 "trsvcid": "$NVMF_PORT", 00:24:55.005 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.005 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.005 "hdgst": ${hdgst:-false}, 00:24:55.006 "ddgst": ${ddgst:-false} 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 } 00:24:55.006 EOF 00:24:55.006 )") 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.006 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.006 { 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme$subsystem", 00:24:55.006 "trtype": "$TEST_TRANSPORT", 00:24:55.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "$NVMF_PORT", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.006 "hdgst": ${hdgst:-false}, 00:24:55.006 "ddgst": ${ddgst:-false} 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 } 00:24:55.006 EOF 00:24:55.006 )") 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.006 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.006 { 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme$subsystem", 00:24:55.006 "trtype": "$TEST_TRANSPORT", 00:24:55.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "$NVMF_PORT", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.006 "hdgst": ${hdgst:-false}, 00:24:55.006 "ddgst": ${ddgst:-false} 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 } 00:24:55.006 EOF 00:24:55.006 )") 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.006 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.006 { 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme$subsystem", 00:24:55.006 "trtype": "$TEST_TRANSPORT", 00:24:55.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "$NVMF_PORT", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.006 "hdgst": ${hdgst:-false}, 00:24:55.006 "ddgst": ${ddgst:-false} 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 } 00:24:55.006 EOF 00:24:55.006 )") 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.006 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.006 { 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme$subsystem", 00:24:55.006 "trtype": "$TEST_TRANSPORT", 00:24:55.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "$NVMF_PORT", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.006 "hdgst": ${hdgst:-false}, 00:24:55.006 "ddgst": ${ddgst:-false} 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 } 00:24:55.006 EOF 00:24:55.006 )") 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.006 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.006 { 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme$subsystem", 00:24:55.006 "trtype": "$TEST_TRANSPORT", 00:24:55.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "$NVMF_PORT", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.006 "hdgst": ${hdgst:-false}, 00:24:55.006 "ddgst": ${ddgst:-false} 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 } 00:24:55.006 EOF 00:24:55.006 )") 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.006 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.006 { 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme$subsystem", 00:24:55.006 "trtype": "$TEST_TRANSPORT", 00:24:55.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "$NVMF_PORT", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.006 "hdgst": ${hdgst:-false}, 00:24:55.006 "ddgst": ${ddgst:-false} 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 } 00:24:55.006 EOF 00:24:55.006 )") 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.006 03:19:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:55.006 { 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme$subsystem", 00:24:55.006 "trtype": "$TEST_TRANSPORT", 00:24:55.006 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "$NVMF_PORT", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:55.006 "hdgst": ${hdgst:-false}, 00:24:55.006 "ddgst": ${ddgst:-false} 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 } 00:24:55.006 EOF 00:24:55.006 )") 00:24:55.006 03:19:57 -- nvmf/common.sh@542 -- # cat 00:24:55.006 03:19:57 -- nvmf/common.sh@544 -- # jq . 00:24:55.006 03:19:57 -- nvmf/common.sh@545 -- # IFS=, 00:24:55.006 03:19:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme1", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 },{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme2", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 },{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme3", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 },{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme4", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 },{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme5", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 },{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme6", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 },{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme7", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 },{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme8", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 },{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme9", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 },{ 00:24:55.006 "params": { 00:24:55.006 "name": "Nvme10", 00:24:55.006 "trtype": "tcp", 00:24:55.006 "traddr": "10.0.0.2", 00:24:55.006 "adrfam": "ipv4", 00:24:55.006 "trsvcid": "4420", 00:24:55.006 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:55.006 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:55.006 "hdgst": false, 00:24:55.006 "ddgst": false 00:24:55.006 }, 00:24:55.006 "method": "bdev_nvme_attach_controller" 00:24:55.006 }' 00:24:55.006 [2024-11-27 03:19:57.539870] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:55.006 [2024-11-27 03:19:57.539966] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:55.006 EAL: No free 2048 kB hugepages reported on node 1 00:24:55.006 [2024-11-27 03:19:57.603937] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:55.263 [2024-11-27 03:19:57.689371] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:56.640 03:19:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:56.640 03:19:59 -- common/autotest_common.sh@862 -- # return 0 00:24:56.640 03:19:59 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:56.640 03:19:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:56.640 03:19:59 -- common/autotest_common.sh@10 -- # set +x 00:24:56.640 03:19:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:56.640 03:19:59 -- target/shutdown.sh@83 -- # kill -9 2529362 00:24:56.640 03:19:59 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:56.640 03:19:59 -- target/shutdown.sh@87 -- # sleep 1 00:24:58.016 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2529362 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:24:58.016 03:20:00 -- target/shutdown.sh@88 -- # kill -0 2529073 00:24:58.016 03:20:00 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:24:58.016 03:20:00 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:58.016 03:20:00 -- nvmf/common.sh@520 -- # config=() 00:24:58.016 03:20:00 -- nvmf/common.sh@520 -- # local subsystem config 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:58.016 { 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme$subsystem", 00:24:58.016 "trtype": "$TEST_TRANSPORT", 00:24:58.016 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:58.016 "adrfam": "ipv4", 00:24:58.016 "trsvcid": "$NVMF_PORT", 00:24:58.016 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:58.016 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:58.016 "hdgst": ${hdgst:-false}, 00:24:58.016 "ddgst": ${ddgst:-false} 00:24:58.016 }, 00:24:58.016 "method": "bdev_nvme_attach_controller" 00:24:58.016 } 00:24:58.016 EOF 00:24:58.016 )") 00:24:58.016 03:20:00 -- nvmf/common.sh@542 -- # cat 00:24:58.016 03:20:00 -- nvmf/common.sh@544 -- # jq . 00:24:58.016 03:20:00 -- nvmf/common.sh@545 -- # IFS=, 00:24:58.016 03:20:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:58.016 "params": { 00:24:58.016 "name": "Nvme1", 00:24:58.016 "trtype": "tcp", 00:24:58.016 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 },{ 00:24:58.017 "params": { 00:24:58.017 "name": "Nvme2", 00:24:58.017 "trtype": "tcp", 00:24:58.017 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 },{ 00:24:58.017 "params": { 00:24:58.017 "name": "Nvme3", 00:24:58.017 "trtype": "tcp", 00:24:58.017 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 },{ 00:24:58.017 "params": { 00:24:58.017 "name": "Nvme4", 00:24:58.017 "trtype": "tcp", 00:24:58.017 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 },{ 00:24:58.017 "params": { 00:24:58.017 "name": "Nvme5", 00:24:58.017 "trtype": "tcp", 00:24:58.017 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 },{ 00:24:58.017 "params": { 00:24:58.017 "name": "Nvme6", 00:24:58.017 "trtype": "tcp", 00:24:58.017 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 },{ 00:24:58.017 "params": { 00:24:58.017 "name": "Nvme7", 00:24:58.017 "trtype": "tcp", 00:24:58.017 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 },{ 00:24:58.017 "params": { 00:24:58.017 "name": "Nvme8", 00:24:58.017 "trtype": "tcp", 00:24:58.017 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 },{ 00:24:58.017 "params": { 00:24:58.017 "name": "Nvme9", 00:24:58.017 "trtype": "tcp", 00:24:58.017 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 },{ 00:24:58.017 "params": { 00:24:58.017 "name": "Nvme10", 00:24:58.017 "trtype": "tcp", 00:24:58.017 "traddr": "10.0.0.2", 00:24:58.017 "adrfam": "ipv4", 00:24:58.017 "trsvcid": "4420", 00:24:58.017 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:58.017 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:58.017 "hdgst": false, 00:24:58.017 "ddgst": false 00:24:58.017 }, 00:24:58.017 "method": "bdev_nvme_attach_controller" 00:24:58.017 }' 00:24:58.017 [2024-11-27 03:20:00.299669] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:58.017 [2024-11-27 03:20:00.299755] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2529698 ] 00:24:58.017 EAL: No free 2048 kB hugepages reported on node 1 00:24:58.017 [2024-11-27 03:20:00.365656] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:58.017 [2024-11-27 03:20:00.455268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:59.393 Running I/O for 1 seconds... 00:25:00.786 00:25:00.786 Latency(us) 00:25:00.786 [2024-11-27T02:20:03.405Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme1n1 : 1.07 373.65 23.35 0.00 0.00 165668.37 52817.16 123498.95 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme2n1 : 1.07 372.29 23.27 0.00 0.00 165099.98 52428.80 121168.78 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme3n1 : 1.07 370.56 23.16 0.00 0.00 164583.30 53982.25 120392.06 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme4n1 : 1.10 393.47 24.59 0.00 0.00 157118.28 12913.02 138256.69 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme5n1 : 1.10 392.77 24.55 0.00 0.00 156280.93 12621.75 123498.95 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme6n1 : 1.08 367.54 22.97 0.00 0.00 163531.41 39807.05 125052.40 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme7n1 : 1.11 391.89 24.49 0.00 0.00 154913.56 8349.77 126605.84 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme8n1 : 1.09 366.03 22.88 0.00 0.00 162566.36 31457.28 128936.01 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme9n1 : 1.11 391.20 24.45 0.00 0.00 153062.24 7670.14 129712.73 00:25:00.786 [2024-11-27T02:20:03.405Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:00.786 Verification LBA range: start 0x0 length 0x400 00:25:00.786 Nvme10n1 : 1.10 363.46 22.72 0.00 0.00 162306.31 22233.69 132819.63 00:25:00.786 [2024-11-27T02:20:03.405Z] =================================================================================================================== 00:25:00.786 [2024-11-27T02:20:03.405Z] Total : 3782.86 236.43 0.00 0.00 160332.58 7670.14 138256.69 00:25:00.786 03:20:03 -- target/shutdown.sh@93 -- # stoptarget 00:25:00.786 03:20:03 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:00.786 03:20:03 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:00.786 03:20:03 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:00.786 03:20:03 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:00.786 03:20:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:00.786 03:20:03 -- nvmf/common.sh@116 -- # sync 00:25:00.786 03:20:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:00.786 03:20:03 -- nvmf/common.sh@119 -- # set +e 00:25:00.786 03:20:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:00.786 03:20:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:00.786 rmmod nvme_tcp 00:25:00.786 rmmod nvme_fabrics 00:25:00.786 rmmod nvme_keyring 00:25:00.786 03:20:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:00.786 03:20:03 -- nvmf/common.sh@123 -- # set -e 00:25:00.786 03:20:03 -- nvmf/common.sh@124 -- # return 0 00:25:00.786 03:20:03 -- nvmf/common.sh@477 -- # '[' -n 2529073 ']' 00:25:00.786 03:20:03 -- nvmf/common.sh@478 -- # killprocess 2529073 00:25:00.786 03:20:03 -- common/autotest_common.sh@936 -- # '[' -z 2529073 ']' 00:25:00.786 03:20:03 -- common/autotest_common.sh@940 -- # kill -0 2529073 00:25:00.786 03:20:03 -- common/autotest_common.sh@941 -- # uname 00:25:00.786 03:20:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:00.786 03:20:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2529073 00:25:00.786 03:20:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:00.786 03:20:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:00.786 03:20:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2529073' 00:25:00.786 killing process with pid 2529073 00:25:00.786 03:20:03 -- common/autotest_common.sh@955 -- # kill 2529073 00:25:00.786 03:20:03 -- common/autotest_common.sh@960 -- # wait 2529073 00:25:01.355 03:20:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:01.355 03:20:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:01.355 03:20:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:01.355 03:20:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:01.355 03:20:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:01.355 03:20:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:01.355 03:20:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:01.355 03:20:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:03.262 03:20:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:03.262 00:25:03.262 real 0m12.180s 00:25:03.262 user 0m35.421s 00:25:03.262 sys 0m3.172s 00:25:03.262 03:20:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:03.262 03:20:05 -- common/autotest_common.sh@10 -- # set +x 00:25:03.262 ************************************ 00:25:03.262 END TEST nvmf_shutdown_tc1 00:25:03.262 ************************************ 00:25:03.262 03:20:05 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:03.262 03:20:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:03.262 03:20:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:03.262 03:20:05 -- common/autotest_common.sh@10 -- # set +x 00:25:03.263 ************************************ 00:25:03.263 START TEST nvmf_shutdown_tc2 00:25:03.263 ************************************ 00:25:03.263 03:20:05 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:03.263 03:20:05 -- target/shutdown.sh@98 -- # starttarget 00:25:03.263 03:20:05 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:03.263 03:20:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:03.263 03:20:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:03.263 03:20:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:03.263 03:20:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:03.263 03:20:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:03.263 03:20:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:03.263 03:20:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:03.263 03:20:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:03.263 03:20:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:03.263 03:20:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:03.263 03:20:05 -- common/autotest_common.sh@10 -- # set +x 00:25:03.263 03:20:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:03.263 03:20:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:03.263 03:20:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:03.263 03:20:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:03.263 03:20:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:03.263 03:20:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:03.263 03:20:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:03.263 03:20:05 -- nvmf/common.sh@294 -- # net_devs=() 00:25:03.263 03:20:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:03.263 03:20:05 -- nvmf/common.sh@295 -- # e810=() 00:25:03.263 03:20:05 -- nvmf/common.sh@295 -- # local -ga e810 00:25:03.263 03:20:05 -- nvmf/common.sh@296 -- # x722=() 00:25:03.263 03:20:05 -- nvmf/common.sh@296 -- # local -ga x722 00:25:03.263 03:20:05 -- nvmf/common.sh@297 -- # mlx=() 00:25:03.263 03:20:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:03.263 03:20:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:03.263 03:20:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:03.263 03:20:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:03.263 03:20:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:03.263 03:20:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:03.263 03:20:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:03.263 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:03.263 03:20:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:03.263 03:20:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:03.263 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:03.263 03:20:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:03.263 03:20:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:03.263 03:20:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:03.263 03:20:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:03.263 03:20:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:03.263 03:20:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:03.263 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:03.263 03:20:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:03.263 03:20:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:03.263 03:20:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:03.263 03:20:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:03.263 03:20:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:03.263 03:20:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:03.263 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:03.263 03:20:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:03.263 03:20:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:03.263 03:20:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:03.263 03:20:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:03.263 03:20:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:03.263 03:20:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:03.263 03:20:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:03.263 03:20:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:03.263 03:20:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:03.263 03:20:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:03.263 03:20:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:03.263 03:20:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:03.263 03:20:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:03.263 03:20:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:03.263 03:20:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:03.263 03:20:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:03.521 03:20:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:03.521 03:20:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:03.521 03:20:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:03.521 03:20:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:03.521 03:20:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:03.521 03:20:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:03.521 03:20:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:03.521 03:20:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:03.521 03:20:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:03.521 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:03.521 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.184 ms 00:25:03.521 00:25:03.521 --- 10.0.0.2 ping statistics --- 00:25:03.521 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:03.521 rtt min/avg/max/mdev = 0.184/0.184/0.184/0.000 ms 00:25:03.521 03:20:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:03.521 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:03.521 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.117 ms 00:25:03.521 00:25:03.521 --- 10.0.0.1 ping statistics --- 00:25:03.521 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:03.521 rtt min/avg/max/mdev = 0.117/0.117/0.117/0.000 ms 00:25:03.521 03:20:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:03.521 03:20:05 -- nvmf/common.sh@410 -- # return 0 00:25:03.521 03:20:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:03.521 03:20:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:03.521 03:20:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:03.521 03:20:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:03.521 03:20:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:03.521 03:20:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:03.521 03:20:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:03.521 03:20:06 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:03.521 03:20:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:03.521 03:20:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:03.521 03:20:06 -- common/autotest_common.sh@10 -- # set +x 00:25:03.521 03:20:06 -- nvmf/common.sh@469 -- # nvmfpid=2530478 00:25:03.521 03:20:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:03.521 03:20:06 -- nvmf/common.sh@470 -- # waitforlisten 2530478 00:25:03.521 03:20:06 -- common/autotest_common.sh@829 -- # '[' -z 2530478 ']' 00:25:03.521 03:20:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:03.521 03:20:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:03.521 03:20:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:03.521 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:03.521 03:20:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:03.521 03:20:06 -- common/autotest_common.sh@10 -- # set +x 00:25:03.521 [2024-11-27 03:20:06.073121] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:03.521 [2024-11-27 03:20:06.073203] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:03.521 EAL: No free 2048 kB hugepages reported on node 1 00:25:03.780 [2024-11-27 03:20:06.143857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:03.780 [2024-11-27 03:20:06.233496] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:03.780 [2024-11-27 03:20:06.233670] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:03.780 [2024-11-27 03:20:06.233691] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:03.780 [2024-11-27 03:20:06.233706] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:03.780 [2024-11-27 03:20:06.233812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:03.780 [2024-11-27 03:20:06.233859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:03.780 [2024-11-27 03:20:06.233916] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:03.780 [2024-11-27 03:20:06.233918] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:04.716 03:20:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:04.717 03:20:07 -- common/autotest_common.sh@862 -- # return 0 00:25:04.717 03:20:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:04.717 03:20:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:04.717 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:25:04.717 03:20:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:04.717 03:20:07 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:04.717 03:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:04.717 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:25:04.717 [2024-11-27 03:20:07.049135] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:04.717 03:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:04.717 03:20:07 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:04.717 03:20:07 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:04.717 03:20:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:04.717 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:25:04.717 03:20:07 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:04.717 03:20:07 -- target/shutdown.sh@28 -- # cat 00:25:04.717 03:20:07 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:04.717 03:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:04.717 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:25:04.717 Malloc1 00:25:04.717 [2024-11-27 03:20:07.124253] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:04.717 Malloc2 00:25:04.717 Malloc3 00:25:04.717 Malloc4 00:25:04.717 Malloc5 00:25:04.975 Malloc6 00:25:04.975 Malloc7 00:25:04.975 Malloc8 00:25:04.975 Malloc9 00:25:04.975 Malloc10 00:25:04.975 03:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:04.975 03:20:07 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:04.975 03:20:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:04.975 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:25:05.234 03:20:07 -- target/shutdown.sh@102 -- # perfpid=2530667 00:25:05.234 03:20:07 -- target/shutdown.sh@103 -- # waitforlisten 2530667 /var/tmp/bdevperf.sock 00:25:05.234 03:20:07 -- common/autotest_common.sh@829 -- # '[' -z 2530667 ']' 00:25:05.234 03:20:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:05.234 03:20:07 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:05.234 03:20:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:05.234 03:20:07 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:05.234 03:20:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:05.234 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:05.234 03:20:07 -- nvmf/common.sh@520 -- # config=() 00:25:05.234 03:20:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:05.234 03:20:07 -- nvmf/common.sh@520 -- # local subsystem config 00:25:05.234 03:20:07 -- common/autotest_common.sh@10 -- # set +x 00:25:05.234 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.234 { 00:25:05.234 "params": { 00:25:05.234 "name": "Nvme$subsystem", 00:25:05.234 "trtype": "$TEST_TRANSPORT", 00:25:05.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.234 "adrfam": "ipv4", 00:25:05.234 "trsvcid": "$NVMF_PORT", 00:25:05.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.234 "hdgst": ${hdgst:-false}, 00:25:05.234 "ddgst": ${ddgst:-false} 00:25:05.234 }, 00:25:05.234 "method": "bdev_nvme_attach_controller" 00:25:05.234 } 00:25:05.234 EOF 00:25:05.234 )") 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.234 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.234 { 00:25:05.234 "params": { 00:25:05.234 "name": "Nvme$subsystem", 00:25:05.234 "trtype": "$TEST_TRANSPORT", 00:25:05.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.234 "adrfam": "ipv4", 00:25:05.234 "trsvcid": "$NVMF_PORT", 00:25:05.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.234 "hdgst": ${hdgst:-false}, 00:25:05.234 "ddgst": ${ddgst:-false} 00:25:05.234 }, 00:25:05.234 "method": "bdev_nvme_attach_controller" 00:25:05.234 } 00:25:05.234 EOF 00:25:05.234 )") 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.234 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.234 { 00:25:05.234 "params": { 00:25:05.234 "name": "Nvme$subsystem", 00:25:05.234 "trtype": "$TEST_TRANSPORT", 00:25:05.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.234 "adrfam": "ipv4", 00:25:05.234 "trsvcid": "$NVMF_PORT", 00:25:05.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.234 "hdgst": ${hdgst:-false}, 00:25:05.234 "ddgst": ${ddgst:-false} 00:25:05.234 }, 00:25:05.234 "method": "bdev_nvme_attach_controller" 00:25:05.234 } 00:25:05.234 EOF 00:25:05.234 )") 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.234 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.234 { 00:25:05.234 "params": { 00:25:05.234 "name": "Nvme$subsystem", 00:25:05.234 "trtype": "$TEST_TRANSPORT", 00:25:05.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.234 "adrfam": "ipv4", 00:25:05.234 "trsvcid": "$NVMF_PORT", 00:25:05.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.234 "hdgst": ${hdgst:-false}, 00:25:05.234 "ddgst": ${ddgst:-false} 00:25:05.234 }, 00:25:05.234 "method": "bdev_nvme_attach_controller" 00:25:05.234 } 00:25:05.234 EOF 00:25:05.234 )") 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.234 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.234 { 00:25:05.234 "params": { 00:25:05.234 "name": "Nvme$subsystem", 00:25:05.234 "trtype": "$TEST_TRANSPORT", 00:25:05.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.234 "adrfam": "ipv4", 00:25:05.234 "trsvcid": "$NVMF_PORT", 00:25:05.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.234 "hdgst": ${hdgst:-false}, 00:25:05.234 "ddgst": ${ddgst:-false} 00:25:05.234 }, 00:25:05.234 "method": "bdev_nvme_attach_controller" 00:25:05.234 } 00:25:05.234 EOF 00:25:05.234 )") 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.234 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.234 { 00:25:05.234 "params": { 00:25:05.234 "name": "Nvme$subsystem", 00:25:05.234 "trtype": "$TEST_TRANSPORT", 00:25:05.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.234 "adrfam": "ipv4", 00:25:05.234 "trsvcid": "$NVMF_PORT", 00:25:05.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.234 "hdgst": ${hdgst:-false}, 00:25:05.234 "ddgst": ${ddgst:-false} 00:25:05.234 }, 00:25:05.234 "method": "bdev_nvme_attach_controller" 00:25:05.234 } 00:25:05.234 EOF 00:25:05.234 )") 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.234 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.234 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.234 { 00:25:05.234 "params": { 00:25:05.234 "name": "Nvme$subsystem", 00:25:05.234 "trtype": "$TEST_TRANSPORT", 00:25:05.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.234 "adrfam": "ipv4", 00:25:05.234 "trsvcid": "$NVMF_PORT", 00:25:05.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.234 "hdgst": ${hdgst:-false}, 00:25:05.234 "ddgst": ${ddgst:-false} 00:25:05.234 }, 00:25:05.234 "method": "bdev_nvme_attach_controller" 00:25:05.234 } 00:25:05.234 EOF 00:25:05.234 )") 00:25:05.235 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.235 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.235 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.235 { 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme$subsystem", 00:25:05.235 "trtype": "$TEST_TRANSPORT", 00:25:05.235 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "$NVMF_PORT", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.235 "hdgst": ${hdgst:-false}, 00:25:05.235 "ddgst": ${ddgst:-false} 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 } 00:25:05.235 EOF 00:25:05.235 )") 00:25:05.235 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.235 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.235 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.235 { 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme$subsystem", 00:25:05.235 "trtype": "$TEST_TRANSPORT", 00:25:05.235 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "$NVMF_PORT", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.235 "hdgst": ${hdgst:-false}, 00:25:05.235 "ddgst": ${ddgst:-false} 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 } 00:25:05.235 EOF 00:25:05.235 )") 00:25:05.235 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.235 03:20:07 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:05.235 03:20:07 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:05.235 { 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme$subsystem", 00:25:05.235 "trtype": "$TEST_TRANSPORT", 00:25:05.235 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "$NVMF_PORT", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:05.235 "hdgst": ${hdgst:-false}, 00:25:05.235 "ddgst": ${ddgst:-false} 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 } 00:25:05.235 EOF 00:25:05.235 )") 00:25:05.235 03:20:07 -- nvmf/common.sh@542 -- # cat 00:25:05.235 03:20:07 -- nvmf/common.sh@544 -- # jq . 00:25:05.235 03:20:07 -- nvmf/common.sh@545 -- # IFS=, 00:25:05.235 03:20:07 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme1", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 },{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme2", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 },{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme3", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 },{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme4", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 },{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme5", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 },{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme6", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 },{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme7", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 },{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme8", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 },{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme9", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 },{ 00:25:05.235 "params": { 00:25:05.235 "name": "Nvme10", 00:25:05.235 "trtype": "tcp", 00:25:05.235 "traddr": "10.0.0.2", 00:25:05.235 "adrfam": "ipv4", 00:25:05.235 "trsvcid": "4420", 00:25:05.235 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:05.235 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:05.235 "hdgst": false, 00:25:05.235 "ddgst": false 00:25:05.235 }, 00:25:05.235 "method": "bdev_nvme_attach_controller" 00:25:05.235 }' 00:25:05.235 [2024-11-27 03:20:07.642415] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:05.235 [2024-11-27 03:20:07.642491] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2530667 ] 00:25:05.235 EAL: No free 2048 kB hugepages reported on node 1 00:25:05.235 [2024-11-27 03:20:07.711310] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:05.235 [2024-11-27 03:20:07.796843] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:07.137 Running I/O for 10 seconds... 00:25:07.704 03:20:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:07.704 03:20:10 -- common/autotest_common.sh@862 -- # return 0 00:25:07.704 03:20:10 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:07.704 03:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.704 03:20:10 -- common/autotest_common.sh@10 -- # set +x 00:25:07.704 03:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.704 03:20:10 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:07.704 03:20:10 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:07.704 03:20:10 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:07.704 03:20:10 -- target/shutdown.sh@57 -- # local ret=1 00:25:07.704 03:20:10 -- target/shutdown.sh@58 -- # local i 00:25:07.704 03:20:10 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:07.704 03:20:10 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:07.704 03:20:10 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:07.704 03:20:10 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:07.704 03:20:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.704 03:20:10 -- common/autotest_common.sh@10 -- # set +x 00:25:07.704 03:20:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.704 03:20:10 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:07.704 03:20:10 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:07.704 03:20:10 -- target/shutdown.sh@64 -- # ret=0 00:25:07.704 03:20:10 -- target/shutdown.sh@65 -- # break 00:25:07.704 03:20:10 -- target/shutdown.sh@69 -- # return 0 00:25:07.704 03:20:10 -- target/shutdown.sh@109 -- # killprocess 2530667 00:25:07.704 03:20:10 -- common/autotest_common.sh@936 -- # '[' -z 2530667 ']' 00:25:07.704 03:20:10 -- common/autotest_common.sh@940 -- # kill -0 2530667 00:25:07.704 03:20:10 -- common/autotest_common.sh@941 -- # uname 00:25:07.704 03:20:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:07.704 03:20:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2530667 00:25:07.704 03:20:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:07.704 03:20:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:07.704 03:20:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2530667' 00:25:07.704 killing process with pid 2530667 00:25:07.704 03:20:10 -- common/autotest_common.sh@955 -- # kill 2530667 00:25:07.704 03:20:10 -- common/autotest_common.sh@960 -- # wait 2530667 00:25:07.704 Received shutdown signal, test time was about 0.755369 seconds 00:25:07.704 00:25:07.704 Latency(us) 00:25:07.704 [2024-11-27T02:20:10.323Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:07.704 [2024-11-27T02:20:10.323Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.704 Verification LBA range: start 0x0 length 0x400 00:25:07.704 Nvme1n1 : 0.75 419.64 26.23 0.00 0.00 149700.71 14175.19 123498.95 00:25:07.704 [2024-11-27T02:20:10.323Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.704 Verification LBA range: start 0x0 length 0x400 00:25:07.704 Nvme2n1 : 0.73 374.97 23.44 0.00 0.00 163963.33 23981.32 154567.87 00:25:07.704 [2024-11-27T02:20:10.323Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.704 Verification LBA range: start 0x0 length 0x400 00:25:07.704 Nvme3n1 : 0.75 418.88 26.18 0.00 0.00 146935.03 13398.47 121945.51 00:25:07.704 [2024-11-27T02:20:10.323Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.704 Verification LBA range: start 0x0 length 0x400 00:25:07.704 Nvme4n1 : 0.75 417.47 26.09 0.00 0.00 145824.50 14757.74 120392.06 00:25:07.704 [2024-11-27T02:20:10.323Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.704 Verification LBA range: start 0x0 length 0x400 00:25:07.704 Nvme5n1 : 0.72 378.69 23.67 0.00 0.00 156998.88 23884.23 118838.61 00:25:07.704 [2024-11-27T02:20:10.323Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.704 Verification LBA range: start 0x0 length 0x400 00:25:07.704 Nvme6n1 : 0.73 373.20 23.33 0.00 0.00 157647.45 24175.50 132819.63 00:25:07.704 [2024-11-27T02:20:10.323Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.704 Verification LBA range: start 0x0 length 0x400 00:25:07.704 Nvme7n1 : 0.72 376.74 23.55 0.00 0.00 154209.85 24855.13 117285.17 00:25:07.704 [2024-11-27T02:20:10.323Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.704 Verification LBA range: start 0x0 length 0x400 00:25:07.704 Nvme8n1 : 0.73 371.56 23.22 0.00 0.00 154938.21 24175.50 127382.57 00:25:07.705 [2024-11-27T02:20:10.324Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.705 Verification LBA range: start 0x0 length 0x400 00:25:07.705 Nvme9n1 : 0.74 367.10 22.94 0.00 0.00 154668.17 27767.85 128159.29 00:25:07.705 [2024-11-27T02:20:10.324Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:07.705 Verification LBA range: start 0x0 length 0x400 00:25:07.705 Nvme10n1 : 0.75 363.76 22.73 0.00 0.00 156826.47 13786.83 129712.73 00:25:07.705 [2024-11-27T02:20:10.324Z] =================================================================================================================== 00:25:07.705 [2024-11-27T02:20:10.324Z] Total : 3862.01 241.38 0.00 0.00 153868.59 13398.47 154567.87 00:25:07.963 03:20:10 -- target/shutdown.sh@112 -- # sleep 1 00:25:09.348 03:20:11 -- target/shutdown.sh@113 -- # kill -0 2530478 00:25:09.348 03:20:11 -- target/shutdown.sh@115 -- # stoptarget 00:25:09.348 03:20:11 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:09.348 03:20:11 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:09.348 03:20:11 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:09.348 03:20:11 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:09.348 03:20:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:09.348 03:20:11 -- nvmf/common.sh@116 -- # sync 00:25:09.348 03:20:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:09.348 03:20:11 -- nvmf/common.sh@119 -- # set +e 00:25:09.348 03:20:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:09.348 03:20:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:09.348 rmmod nvme_tcp 00:25:09.348 rmmod nvme_fabrics 00:25:09.348 rmmod nvme_keyring 00:25:09.348 03:20:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:09.348 03:20:11 -- nvmf/common.sh@123 -- # set -e 00:25:09.348 03:20:11 -- nvmf/common.sh@124 -- # return 0 00:25:09.348 03:20:11 -- nvmf/common.sh@477 -- # '[' -n 2530478 ']' 00:25:09.348 03:20:11 -- nvmf/common.sh@478 -- # killprocess 2530478 00:25:09.348 03:20:11 -- common/autotest_common.sh@936 -- # '[' -z 2530478 ']' 00:25:09.348 03:20:11 -- common/autotest_common.sh@940 -- # kill -0 2530478 00:25:09.348 03:20:11 -- common/autotest_common.sh@941 -- # uname 00:25:09.348 03:20:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:09.348 03:20:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2530478 00:25:09.348 03:20:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:09.348 03:20:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:09.348 03:20:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2530478' 00:25:09.348 killing process with pid 2530478 00:25:09.348 03:20:11 -- common/autotest_common.sh@955 -- # kill 2530478 00:25:09.348 03:20:11 -- common/autotest_common.sh@960 -- # wait 2530478 00:25:09.607 03:20:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:09.608 03:20:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:09.608 03:20:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:09.608 03:20:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:09.608 03:20:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:09.608 03:20:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:09.608 03:20:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:09.608 03:20:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:12.150 03:20:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:12.150 00:25:12.150 real 0m8.313s 00:25:12.150 user 0m26.481s 00:25:12.150 sys 0m1.510s 00:25:12.150 03:20:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:12.150 03:20:14 -- common/autotest_common.sh@10 -- # set +x 00:25:12.150 ************************************ 00:25:12.150 END TEST nvmf_shutdown_tc2 00:25:12.150 ************************************ 00:25:12.150 03:20:14 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:12.150 03:20:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:12.150 03:20:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:12.150 03:20:14 -- common/autotest_common.sh@10 -- # set +x 00:25:12.150 ************************************ 00:25:12.150 START TEST nvmf_shutdown_tc3 00:25:12.150 ************************************ 00:25:12.150 03:20:14 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:12.150 03:20:14 -- target/shutdown.sh@120 -- # starttarget 00:25:12.150 03:20:14 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:12.150 03:20:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:12.150 03:20:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:12.150 03:20:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:12.150 03:20:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:12.150 03:20:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:12.150 03:20:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:12.150 03:20:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:12.150 03:20:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:12.150 03:20:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:12.150 03:20:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:12.150 03:20:14 -- common/autotest_common.sh@10 -- # set +x 00:25:12.150 03:20:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:12.150 03:20:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:12.150 03:20:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:12.150 03:20:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:12.150 03:20:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:12.150 03:20:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:12.150 03:20:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:12.150 03:20:14 -- nvmf/common.sh@294 -- # net_devs=() 00:25:12.150 03:20:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:12.150 03:20:14 -- nvmf/common.sh@295 -- # e810=() 00:25:12.150 03:20:14 -- nvmf/common.sh@295 -- # local -ga e810 00:25:12.150 03:20:14 -- nvmf/common.sh@296 -- # x722=() 00:25:12.150 03:20:14 -- nvmf/common.sh@296 -- # local -ga x722 00:25:12.150 03:20:14 -- nvmf/common.sh@297 -- # mlx=() 00:25:12.150 03:20:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:12.150 03:20:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:12.150 03:20:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:12.150 03:20:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:12.150 03:20:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:12.150 03:20:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:12.150 03:20:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:12.150 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:12.150 03:20:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:12.150 03:20:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:12.150 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:12.150 03:20:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:12.150 03:20:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:12.150 03:20:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:12.150 03:20:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:12.150 03:20:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:12.150 03:20:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:12.150 03:20:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:12.150 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:12.150 03:20:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:12.150 03:20:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:12.151 03:20:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:12.151 03:20:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:12.151 03:20:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:12.151 03:20:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:12.151 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:12.151 03:20:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:12.151 03:20:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:12.151 03:20:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:12.151 03:20:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:12.151 03:20:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:12.151 03:20:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:12.151 03:20:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:12.151 03:20:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:12.151 03:20:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:12.151 03:20:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:12.151 03:20:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:12.151 03:20:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:12.151 03:20:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:12.151 03:20:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:12.151 03:20:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:12.151 03:20:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:12.151 03:20:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:12.151 03:20:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:12.151 03:20:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:12.151 03:20:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:12.151 03:20:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:12.151 03:20:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:12.151 03:20:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:12.151 03:20:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:12.151 03:20:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:12.151 03:20:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:12.151 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:12.151 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.176 ms 00:25:12.151 00:25:12.151 --- 10.0.0.2 ping statistics --- 00:25:12.151 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:12.151 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:25:12.151 03:20:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:12.151 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:12.151 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:25:12.151 00:25:12.151 --- 10.0.0.1 ping statistics --- 00:25:12.151 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:12.151 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:25:12.151 03:20:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:12.151 03:20:14 -- nvmf/common.sh@410 -- # return 0 00:25:12.151 03:20:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:12.151 03:20:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:12.151 03:20:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:12.151 03:20:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:12.151 03:20:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:12.151 03:20:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:12.151 03:20:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:12.151 03:20:14 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:12.151 03:20:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:12.151 03:20:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:12.151 03:20:14 -- common/autotest_common.sh@10 -- # set +x 00:25:12.151 03:20:14 -- nvmf/common.sh@469 -- # nvmfpid=2531606 00:25:12.151 03:20:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:12.151 03:20:14 -- nvmf/common.sh@470 -- # waitforlisten 2531606 00:25:12.151 03:20:14 -- common/autotest_common.sh@829 -- # '[' -z 2531606 ']' 00:25:12.151 03:20:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:12.151 03:20:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:12.151 03:20:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:12.151 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:12.151 03:20:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:12.151 03:20:14 -- common/autotest_common.sh@10 -- # set +x 00:25:12.151 [2024-11-27 03:20:14.446161] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:12.151 [2024-11-27 03:20:14.446241] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:12.151 EAL: No free 2048 kB hugepages reported on node 1 00:25:12.151 [2024-11-27 03:20:14.518497] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:12.151 [2024-11-27 03:20:14.606784] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:12.151 [2024-11-27 03:20:14.606956] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:12.151 [2024-11-27 03:20:14.606973] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:12.151 [2024-11-27 03:20:14.606985] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:12.151 [2024-11-27 03:20:14.607083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:12.151 [2024-11-27 03:20:14.607146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:12.151 [2024-11-27 03:20:14.607200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:12.151 [2024-11-27 03:20:14.607202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:13.090 03:20:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:13.090 03:20:15 -- common/autotest_common.sh@862 -- # return 0 00:25:13.090 03:20:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:13.090 03:20:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:13.090 03:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:13.090 03:20:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:13.090 03:20:15 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:13.090 03:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.090 03:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:13.090 [2024-11-27 03:20:15.452152] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:13.090 03:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.090 03:20:15 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:13.090 03:20:15 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:13.090 03:20:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:13.090 03:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:13.090 03:20:15 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:13.090 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.090 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.090 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.090 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.091 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.091 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.091 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.091 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.091 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.091 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.091 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.091 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.091 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.091 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.091 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.091 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.091 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.091 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.091 03:20:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.091 03:20:15 -- target/shutdown.sh@28 -- # cat 00:25:13.091 03:20:15 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:13.091 03:20:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.091 03:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:13.091 Malloc1 00:25:13.091 [2024-11-27 03:20:15.527289] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:13.091 Malloc2 00:25:13.091 Malloc3 00:25:13.091 Malloc4 00:25:13.091 Malloc5 00:25:13.350 Malloc6 00:25:13.350 Malloc7 00:25:13.350 Malloc8 00:25:13.350 Malloc9 00:25:13.350 Malloc10 00:25:13.350 03:20:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.350 03:20:15 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:13.350 03:20:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:13.350 03:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:13.609 03:20:15 -- target/shutdown.sh@124 -- # perfpid=2531912 00:25:13.610 03:20:15 -- target/shutdown.sh@125 -- # waitforlisten 2531912 /var/tmp/bdevperf.sock 00:25:13.610 03:20:15 -- common/autotest_common.sh@829 -- # '[' -z 2531912 ']' 00:25:13.610 03:20:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:13.610 03:20:15 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:13.610 03:20:15 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:13.610 03:20:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:13.610 03:20:15 -- nvmf/common.sh@520 -- # config=() 00:25:13.610 03:20:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:13.610 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:13.610 03:20:15 -- nvmf/common.sh@520 -- # local subsystem config 00:25:13.610 03:20:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:13.610 03:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.610 03:20:15 -- common/autotest_common.sh@10 -- # set +x 00:25:13.610 03:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.610 { 00:25:13.610 "params": { 00:25:13.610 "name": "Nvme$subsystem", 00:25:13.610 "trtype": "$TEST_TRANSPORT", 00:25:13.610 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.610 "adrfam": "ipv4", 00:25:13.610 "trsvcid": "$NVMF_PORT", 00:25:13.610 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.610 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.610 "hdgst": ${hdgst:-false}, 00:25:13.610 "ddgst": ${ddgst:-false} 00:25:13.610 }, 00:25:13.610 "method": "bdev_nvme_attach_controller" 00:25:13.610 } 00:25:13.610 EOF 00:25:13.610 )") 00:25:13.610 03:20:15 -- nvmf/common.sh@542 -- # cat 00:25:13.610 03:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.610 03:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.610 { 00:25:13.610 "params": { 00:25:13.610 "name": "Nvme$subsystem", 00:25:13.610 "trtype": "$TEST_TRANSPORT", 00:25:13.610 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.610 "adrfam": "ipv4", 00:25:13.610 "trsvcid": "$NVMF_PORT", 00:25:13.610 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.610 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.610 "hdgst": ${hdgst:-false}, 00:25:13.610 "ddgst": ${ddgst:-false} 00:25:13.610 }, 00:25:13.610 "method": "bdev_nvme_attach_controller" 00:25:13.610 } 00:25:13.610 EOF 00:25:13.610 )") 00:25:13.610 03:20:15 -- nvmf/common.sh@542 -- # cat 00:25:13.610 03:20:15 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.610 03:20:15 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.610 { 00:25:13.610 "params": { 00:25:13.610 "name": "Nvme$subsystem", 00:25:13.610 "trtype": "$TEST_TRANSPORT", 00:25:13.610 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.610 "adrfam": "ipv4", 00:25:13.610 "trsvcid": "$NVMF_PORT", 00:25:13.610 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.610 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.610 "hdgst": ${hdgst:-false}, 00:25:13.610 "ddgst": ${ddgst:-false} 00:25:13.610 }, 00:25:13.610 "method": "bdev_nvme_attach_controller" 00:25:13.610 } 00:25:13.610 EOF 00:25:13.610 )") 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # cat 00:25:13.610 03:20:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.610 { 00:25:13.610 "params": { 00:25:13.610 "name": "Nvme$subsystem", 00:25:13.610 "trtype": "$TEST_TRANSPORT", 00:25:13.610 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.610 "adrfam": "ipv4", 00:25:13.610 "trsvcid": "$NVMF_PORT", 00:25:13.610 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.610 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.610 "hdgst": ${hdgst:-false}, 00:25:13.610 "ddgst": ${ddgst:-false} 00:25:13.610 }, 00:25:13.610 "method": "bdev_nvme_attach_controller" 00:25:13.610 } 00:25:13.610 EOF 00:25:13.610 )") 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # cat 00:25:13.610 03:20:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.610 { 00:25:13.610 "params": { 00:25:13.610 "name": "Nvme$subsystem", 00:25:13.610 "trtype": "$TEST_TRANSPORT", 00:25:13.610 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.610 "adrfam": "ipv4", 00:25:13.610 "trsvcid": "$NVMF_PORT", 00:25:13.610 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.610 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.610 "hdgst": ${hdgst:-false}, 00:25:13.610 "ddgst": ${ddgst:-false} 00:25:13.610 }, 00:25:13.610 "method": "bdev_nvme_attach_controller" 00:25:13.610 } 00:25:13.610 EOF 00:25:13.610 )") 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # cat 00:25:13.610 03:20:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.610 { 00:25:13.610 "params": { 00:25:13.610 "name": "Nvme$subsystem", 00:25:13.610 "trtype": "$TEST_TRANSPORT", 00:25:13.610 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.610 "adrfam": "ipv4", 00:25:13.610 "trsvcid": "$NVMF_PORT", 00:25:13.610 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.610 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.610 "hdgst": ${hdgst:-false}, 00:25:13.610 "ddgst": ${ddgst:-false} 00:25:13.610 }, 00:25:13.610 "method": "bdev_nvme_attach_controller" 00:25:13.610 } 00:25:13.610 EOF 00:25:13.610 )") 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # cat 00:25:13.610 03:20:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.610 { 00:25:13.610 "params": { 00:25:13.610 "name": "Nvme$subsystem", 00:25:13.610 "trtype": "$TEST_TRANSPORT", 00:25:13.610 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.610 "adrfam": "ipv4", 00:25:13.610 "trsvcid": "$NVMF_PORT", 00:25:13.610 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.610 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.610 "hdgst": ${hdgst:-false}, 00:25:13.610 "ddgst": ${ddgst:-false} 00:25:13.610 }, 00:25:13.610 "method": "bdev_nvme_attach_controller" 00:25:13.610 } 00:25:13.610 EOF 00:25:13.610 )") 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # cat 00:25:13.610 03:20:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.610 { 00:25:13.610 "params": { 00:25:13.610 "name": "Nvme$subsystem", 00:25:13.610 "trtype": "$TEST_TRANSPORT", 00:25:13.610 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.610 "adrfam": "ipv4", 00:25:13.610 "trsvcid": "$NVMF_PORT", 00:25:13.610 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.610 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.610 "hdgst": ${hdgst:-false}, 00:25:13.610 "ddgst": ${ddgst:-false} 00:25:13.610 }, 00:25:13.610 "method": "bdev_nvme_attach_controller" 00:25:13.610 } 00:25:13.610 EOF 00:25:13.610 )") 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # cat 00:25:13.610 03:20:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.610 03:20:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.610 { 00:25:13.610 "params": { 00:25:13.610 "name": "Nvme$subsystem", 00:25:13.610 "trtype": "$TEST_TRANSPORT", 00:25:13.610 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.610 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "$NVMF_PORT", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.611 "hdgst": ${hdgst:-false}, 00:25:13.611 "ddgst": ${ddgst:-false} 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 } 00:25:13.611 EOF 00:25:13.611 )") 00:25:13.611 03:20:16 -- nvmf/common.sh@542 -- # cat 00:25:13.611 03:20:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.611 03:20:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.611 { 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme$subsystem", 00:25:13.611 "trtype": "$TEST_TRANSPORT", 00:25:13.611 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "$NVMF_PORT", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.611 "hdgst": ${hdgst:-false}, 00:25:13.611 "ddgst": ${ddgst:-false} 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 } 00:25:13.611 EOF 00:25:13.611 )") 00:25:13.611 03:20:16 -- nvmf/common.sh@542 -- # cat 00:25:13.611 03:20:16 -- nvmf/common.sh@544 -- # jq . 00:25:13.611 03:20:16 -- nvmf/common.sh@545 -- # IFS=, 00:25:13.611 03:20:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme1", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 },{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme2", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 },{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme3", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 },{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme4", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 },{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme5", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 },{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme6", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 },{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme7", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 },{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme8", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 },{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme9", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 },{ 00:25:13.611 "params": { 00:25:13.611 "name": "Nvme10", 00:25:13.611 "trtype": "tcp", 00:25:13.611 "traddr": "10.0.0.2", 00:25:13.611 "adrfam": "ipv4", 00:25:13.611 "trsvcid": "4420", 00:25:13.611 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:13.611 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:13.611 "hdgst": false, 00:25:13.611 "ddgst": false 00:25:13.611 }, 00:25:13.611 "method": "bdev_nvme_attach_controller" 00:25:13.611 }' 00:25:13.611 [2024-11-27 03:20:16.033256] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:13.611 [2024-11-27 03:20:16.033327] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2531912 ] 00:25:13.611 EAL: No free 2048 kB hugepages reported on node 1 00:25:13.611 [2024-11-27 03:20:16.097185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:13.611 [2024-11-27 03:20:16.182675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:15.514 Running I/O for 10 seconds... 00:25:15.514 03:20:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:15.514 03:20:17 -- common/autotest_common.sh@862 -- # return 0 00:25:15.514 03:20:17 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:15.514 03:20:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.514 03:20:17 -- common/autotest_common.sh@10 -- # set +x 00:25:15.514 03:20:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.514 03:20:17 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:15.514 03:20:17 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:15.514 03:20:17 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:15.514 03:20:17 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:15.514 03:20:17 -- target/shutdown.sh@57 -- # local ret=1 00:25:15.514 03:20:17 -- target/shutdown.sh@58 -- # local i 00:25:15.514 03:20:17 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:15.514 03:20:17 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:15.514 03:20:17 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:15.514 03:20:17 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:15.514 03:20:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.514 03:20:17 -- common/autotest_common.sh@10 -- # set +x 00:25:15.514 03:20:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.514 03:20:17 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:15.514 03:20:17 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:15.514 03:20:17 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:15.787 03:20:18 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:15.787 03:20:18 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:15.787 03:20:18 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:15.787 03:20:18 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:15.787 03:20:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.787 03:20:18 -- common/autotest_common.sh@10 -- # set +x 00:25:15.787 03:20:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.787 03:20:18 -- target/shutdown.sh@60 -- # read_io_count=167 00:25:15.787 03:20:18 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:25:15.787 03:20:18 -- target/shutdown.sh@64 -- # ret=0 00:25:15.787 03:20:18 -- target/shutdown.sh@65 -- # break 00:25:15.787 03:20:18 -- target/shutdown.sh@69 -- # return 0 00:25:15.787 03:20:18 -- target/shutdown.sh@134 -- # killprocess 2531606 00:25:15.787 03:20:18 -- common/autotest_common.sh@936 -- # '[' -z 2531606 ']' 00:25:15.787 03:20:18 -- common/autotest_common.sh@940 -- # kill -0 2531606 00:25:15.787 03:20:18 -- common/autotest_common.sh@941 -- # uname 00:25:15.787 03:20:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:15.787 03:20:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2531606 00:25:15.787 03:20:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:15.787 03:20:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:15.787 03:20:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2531606' 00:25:15.787 killing process with pid 2531606 00:25:15.787 03:20:18 -- common/autotest_common.sh@955 -- # kill 2531606 00:25:15.787 03:20:18 -- common/autotest_common.sh@960 -- # wait 2531606 00:25:15.787 [2024-11-27 03:20:18.267007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267268] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267624] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267636] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267683] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267695] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267719] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267765] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.267942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7ae90 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.268981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269040] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269125] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269137] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269236] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.788 [2024-11-27 03:20:18.269248] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269300] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269612] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269690] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269727] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269764] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.269801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d750 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.274415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b340 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.274441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b340 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275331] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275738] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.789 [2024-11-27 03:20:18.275817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275864] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.275990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.276002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.276014] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.276027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.276039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.276051] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.276062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.276075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.276087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7b7f0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280428] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.280593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7bc80 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.281991] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.282003] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.282018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.282031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.282043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.282054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.282066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.790 [2024-11-27 03:20:18.282078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282126] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282138] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282150] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282185] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282197] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282209] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.282326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c5e0 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283623] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283724] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283909] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283933] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.283997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284176] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7c940 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.791 [2024-11-27 03:20:18.284785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.791 [2024-11-27 03:20:18.284803] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.791 [2024-11-27 03:20:18.284817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.791 [2024-11-27 03:20:18.284838] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.791 [2024-11-27 03:20:18.284851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.791 [2024-11-27 03:20:18.284865] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.791 [2024-11-27 03:20:18.284878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.791 [2024-11-27 03:20:18.284906] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1389a30 is same with the state(5) to be set 00:25:15.791 [2024-11-27 03:20:18.284961] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.791 [2024-11-27 03:20:18.284982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.791 [2024-11-27 03:20:18.284997] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.791 [2024-11-27 03:20:18.285011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.791 [2024-11-27 03:20:18.285025] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.791 [2024-11-27 03:20:18.285038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.791 [2024-11-27 03:20:18.285052] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.791 [2024-11-27 03:20:18.285065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1374d30 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 [2024-11-27 03:20:18.285145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285161] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 [2024-11-27 03:20:18.285167] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285190] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 [2024-11-27 03:20:18.285194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285217] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-11-27 03:20:18.285219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 he state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with t[2024-11-27 03:20:18.285233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:15.792 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x152e100 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285272] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285299] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 [2024-11-27 03:20:18.285307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with t[2024-11-27 03:20:18.285319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:15.792 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285337] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 [2024-11-27 03:20:18.285345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285365] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 [2024-11-27 03:20:18.285369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285392] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-11-27 03:20:18.285393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 he state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with t[2024-11-27 03:20:18.285407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:15.792 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285422] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13676b0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285468] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-27 03:20:18.285474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 he state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285505] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 [2024-11-27 03:20:18.285512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285543] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 [2024-11-27 03:20:18.285547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285571] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 ns[2024-11-27 03:20:18.285572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 he state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with t[2024-11-27 03:20:18.285588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:15.792 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.792 [2024-11-27 03:20:18.285601] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x152cc50 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.792 [2024-11-27 03:20:18.285668] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-27 03:20:18.285672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:15.792 he state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with t[2024-11-27 03:20:18.285690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:15.793 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.285705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285708] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.285718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.285731] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285736] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.285743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.285755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285763] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.285767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.285779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1508c80 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285834] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-27 03:20:18.285839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with tid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 he state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.285868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285873] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.285881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.285896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285902] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.285917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with t[2024-11-27 03:20:18.285918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 che state(5) to be set 00:25:15.793 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.285931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285934] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.285944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.285956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1518660 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.285968] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7cdf0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286006] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.286025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286040] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.286053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286066] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.286079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286093] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.286106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x151d700 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286163] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.286183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286198] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.286211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286224] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.286241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286255] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.793 [2024-11-27 03:20:18.286268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bc070 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286707] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t[2024-11-27 03:20:18.286850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:1he state(5) to be set 00:25:15.793 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.793 [2024-11-27 03:20:18.286870] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.793 [2024-11-27 03:20:18.286917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.793 [2024-11-27 03:20:18.286954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t[2024-11-27 03:20:18.286959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:15.793 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.793 [2024-11-27 03:20:18.286974] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.793 [2024-11-27 03:20:18.286978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.286987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.286992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287000] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 03:20:18.287024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 he state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t[2024-11-27 03:20:18.287100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128he state(5) to be set 00:25:15.794 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t[2024-11-27 03:20:18.287116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:15.794 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287183] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25600 len:12[2024-11-27 03:20:18.287195] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 he state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287208] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t[2024-11-27 03:20:18.287209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:15.794 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t[2024-11-27 03:20:18.287247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:15.794 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:1[2024-11-27 03:20:18.287297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 he state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t[2024-11-27 03:20:18.287311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 che state(5) to be set 00:25:15.794 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-27 03:20:18.287349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with tdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 he state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t[2024-11-27 03:20:18.287485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:30720 len:1he state(5) to be set 00:25:15.794 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:30848 len:12[2024-11-27 03:20:18.287523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with t8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 he state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd7d2a0 is same with the state(5) to be set 00:25:15.794 [2024-11-27 03:20:18.287546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.794 [2024-11-27 03:20:18.287578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.794 [2024-11-27 03:20:18.287612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.287977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.287993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.795 [2024-11-27 03:20:18.288825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.795 [2024-11-27 03:20:18.288842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.288856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.288871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.288884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.288902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14e6d30 is same with the state(5) to be set 00:25:15.796 [2024-11-27 03:20:18.288983] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x14e6d30 was disconnected and freed. reset controller. 00:25:15.796 [2024-11-27 03:20:18.289051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.796 [2024-11-27 03:20:18.289983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.796 [2024-11-27 03:20:18.289998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.797 [2024-11-27 03:20:18.290914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.290928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14e80e0 is same with the state(5) to be set 00:25:15.797 [2024-11-27 03:20:18.290995] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x14e80e0 was disconnected and freed. reset controller. 00:25:15.797 [2024-11-27 03:20:18.294848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:15.797 [2024-11-27 03:20:18.294902] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:15.797 [2024-11-27 03:20:18.294929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1508c80 (9): Bad file descriptor 00:25:15.797 [2024-11-27 03:20:18.294953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1389a30 (9): Bad file descriptor 00:25:15.797 [2024-11-27 03:20:18.294975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1374d30 (9): Bad file descriptor 00:25:15.797 [2024-11-27 03:20:18.295012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x152e100 (9): Bad file descriptor 00:25:15.797 [2024-11-27 03:20:18.295042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13676b0 (9): Bad file descriptor 00:25:15.797 [2024-11-27 03:20:18.295069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x152cc50 (9): Bad file descriptor 00:25:15.797 [2024-11-27 03:20:18.295125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.797 [2024-11-27 03:20:18.295171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.295192] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.797 [2024-11-27 03:20:18.295206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.295219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.797 [2024-11-27 03:20:18.295233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.797 [2024-11-27 03:20:18.295246] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:15.798 [2024-11-27 03:20:18.295259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13be650 is same with the state(5) to be set 00:25:15.798 [2024-11-27 03:20:18.295303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1518660 (9): Bad file descriptor 00:25:15.798 [2024-11-27 03:20:18.295333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x151d700 (9): Bad file descriptor 00:25:15.798 [2024-11-27 03:20:18.295361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bc070 (9): Bad file descriptor 00:25:15.798 [2024-11-27 03:20:18.295431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.295974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.295987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.798 [2024-11-27 03:20:18.296557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.798 [2024-11-27 03:20:18.296572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.296973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.296989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.297363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.297475] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x13d9010 was disconnected and freed. reset controller. 00:25:15.799 [2024-11-27 03:20:18.298398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.799 [2024-11-27 03:20:18.298777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.799 [2024-11-27 03:20:18.298792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.298805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.298821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.298839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.298855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.298868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.298884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.298900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.298919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.298933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.298948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.298962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.298977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.298990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.800 [2024-11-27 03:20:18.299970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.800 [2024-11-27 03:20:18.299985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.299998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.300321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.300427] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x14e5ef0 was disconnected and freed. reset controller. 00:25:15.801 [2024-11-27 03:20:18.303330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.303984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.303998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x14e4950 is same with the state(5) to be set 00:25:15.801 [2024-11-27 03:20:18.304081] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x14e4950 was disconnected and freed. reset controller. 00:25:15.801 [2024-11-27 03:20:18.305829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.305853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.305875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.801 [2024-11-27 03:20:18.305890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.801 [2024-11-27 03:20:18.305906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.305921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.305937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.305951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.305967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.305982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.305998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306510] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13d98a0 is same with the state(5) to be set 00:25:15.802 [2024-11-27 03:20:18.306604] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x13d98a0 was disconnected and freed. reset controller. 00:25:15.802 [2024-11-27 03:20:18.306644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.306974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.306990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.307004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.307019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.307033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.307049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.307062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.307077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.307091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.307107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.307120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.307136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.307150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.307165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.307179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.307195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.802 [2024-11-27 03:20:18.307209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.802 [2024-11-27 03:20:18.307224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.307238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.307254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.307271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.307365] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x13dadd0 was disconnected and freed. reset controller. 00:25:15.803 [2024-11-27 03:20:18.307591] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:15.803 [2024-11-27 03:20:18.307630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:15.803 [2024-11-27 03:20:18.307665] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:15.803 [2024-11-27 03:20:18.307823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.803 [2024-11-27 03:20:18.307921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.803 [2024-11-27 03:20:18.307947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1389a30 with addr=10.0.0.2, port=4420 00:25:15.803 [2024-11-27 03:20:18.307963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1389a30 is same with the state(5) to be set 00:25:15.803 [2024-11-27 03:20:18.308054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.803 [2024-11-27 03:20:18.308132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.803 [2024-11-27 03:20:18.308156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1508c80 with addr=10.0.0.2, port=4420 00:25:15.803 [2024-11-27 03:20:18.308171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1508c80 is same with the state(5) to be set 00:25:15.803 [2024-11-27 03:20:18.308194] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.803 [2024-11-27 03:20:18.308232] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13be650 (9): Bad file descriptor 00:25:15.803 [2024-11-27 03:20:18.308266] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.803 [2024-11-27 03:20:18.308287] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.803 [2024-11-27 03:20:18.311198] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:15.803 [2024-11-27 03:20:18.311282] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:15.803 [2024-11-27 03:20:18.311352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:15.803 [2024-11-27 03:20:18.311378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:15.803 [2024-11-27 03:20:18.311484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.803 [2024-11-27 03:20:18.311583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.803 [2024-11-27 03:20:18.311610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13676b0 with addr=10.0.0.2, port=4420 00:25:15.803 [2024-11-27 03:20:18.311626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13676b0 is same with the state(5) to be set 00:25:15.803 [2024-11-27 03:20:18.311709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.803 [2024-11-27 03:20:18.311798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.803 [2024-11-27 03:20:18.311823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x152e100 with addr=10.0.0.2, port=4420 00:25:15.803 [2024-11-27 03:20:18.311839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x152e100 is same with the state(5) to be set 00:25:15.803 [2024-11-27 03:20:18.311864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1389a30 (9): Bad file descriptor 00:25:15.803 [2024-11-27 03:20:18.311894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1508c80 (9): Bad file descriptor 00:25:15.803 [2024-11-27 03:20:18.312539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.312982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.312997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.803 [2024-11-27 03:20:18.313283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.803 [2024-11-27 03:20:18.313297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.313983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.313998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.314429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.804 [2024-11-27 03:20:18.314444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13dc3b0 is same with the state(5) to be set 00:25:15.804 [2024-11-27 03:20:18.315694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.804 [2024-11-27 03:20:18.315717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.315740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.315756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.315771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.315785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.315801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.315815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.315831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.315845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.315860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.315874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.315889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.315902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.315917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.315931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.315946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.315959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.315975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.315988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.805 [2024-11-27 03:20:18.316677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.805 [2024-11-27 03:20:18.316693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.316973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.316988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.806 [2024-11-27 03:20:18.317599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.806 [2024-11-27 03:20:18.317614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13def70 is same with the state(5) to be set 00:25:15.806 [2024-11-27 03:20:18.319477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:15.806 [2024-11-27 03:20:18.319509] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:15.806 [2024-11-27 03:20:18.319537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:15.806 [2024-11-27 03:20:18.319694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.806 [2024-11-27 03:20:18.319808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.806 [2024-11-27 03:20:18.319833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1374d30 with addr=10.0.0.2, port=4420 00:25:15.806 [2024-11-27 03:20:18.319850] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1374d30 is same with the state(5) to be set 00:25:15.806 [2024-11-27 03:20:18.319934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.806 [2024-11-27 03:20:18.320029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.806 [2024-11-27 03:20:18.320061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1518660 with addr=10.0.0.2, port=4420 00:25:15.806 [2024-11-27 03:20:18.320076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1518660 is same with the state(5) to be set 00:25:15.806 [2024-11-27 03:20:18.320100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13676b0 (9): Bad file descriptor 00:25:15.806 [2024-11-27 03:20:18.320120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x152e100 (9): Bad file descriptor 00:25:15.806 [2024-11-27 03:20:18.320135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:15.806 [2024-11-27 03:20:18.320149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:15.806 [2024-11-27 03:20:18.320163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:15.806 [2024-11-27 03:20:18.320187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:15.806 [2024-11-27 03:20:18.320201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:15.806 [2024-11-27 03:20:18.320213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:15.807 [2024-11-27 03:20:18.320260] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.807 [2024-11-27 03:20:18.320284] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.807 [2024-11-27 03:20:18.320320] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.807 [2024-11-27 03:20:18.320347] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.807 [2024-11-27 03:20:18.321218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.807 [2024-11-27 03:20:18.321243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.807 [2024-11-27 03:20:18.321345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.807 [2024-11-27 03:20:18.321470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.807 [2024-11-27 03:20:18.321497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x151d700 with addr=10.0.0.2, port=4420 00:25:15.807 [2024-11-27 03:20:18.321512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x151d700 is same with the state(5) to be set 00:25:15.807 [2024-11-27 03:20:18.321602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.807 [2024-11-27 03:20:18.321683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.807 [2024-11-27 03:20:18.321709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13bc070 with addr=10.0.0.2, port=4420 00:25:15.807 [2024-11-27 03:20:18.321724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13bc070 is same with the state(5) to be set 00:25:15.807 [2024-11-27 03:20:18.321799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.807 [2024-11-27 03:20:18.321885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.807 [2024-11-27 03:20:18.321909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x152cc50 with addr=10.0.0.2, port=4420 00:25:15.807 [2024-11-27 03:20:18.321925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x152cc50 is same with the state(5) to be set 00:25:15.807 [2024-11-27 03:20:18.321943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1374d30 (9): Bad file descriptor 00:25:15.807 [2024-11-27 03:20:18.321961] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1518660 (9): Bad file descriptor 00:25:15.807 [2024-11-27 03:20:18.321977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:15.807 [2024-11-27 03:20:18.321989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:15.807 [2024-11-27 03:20:18.322002] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:15.807 [2024-11-27 03:20:18.322021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:15.807 [2024-11-27 03:20:18.322035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:15.807 [2024-11-27 03:20:18.322047] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:15.807 [2024-11-27 03:20:18.322409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:25216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:25344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.322978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.322993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.323006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.323021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.323034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.323049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:25728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.323062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.323078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:20736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.323091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.323106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.323119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.323135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.323148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.323163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:20992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.323176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.323192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:21376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.323205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.323221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:21504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.807 [2024-11-27 03:20:18.323234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.807 [2024-11-27 03:20:18.323253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:26112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:21760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:26240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:22272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:26368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:23040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:23424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:23552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:23808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:26752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:23936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:24064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:27136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:27264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.323980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.323999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:28032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:28160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:15.808 [2024-11-27 03:20:18.324301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:15.808 [2024-11-27 03:20:18.324316] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13dd990 is same with the state(5) to be set 00:25:15.808 [2024-11-27 03:20:18.326243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.808 [2024-11-27 03:20:18.326271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.808 task offset: 29184 on job bdev=Nvme4n1 fails 00:25:15.808 00:25:15.808 Latency(us) 00:25:15.808 [2024-11-27T02:20:18.427Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:15.808 [2024-11-27T02:20:18.427Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.808 [2024-11-27T02:20:18.427Z] Job: Nvme1n1 ended in about 0.58 seconds with error 00:25:15.808 Verification LBA range: start 0x0 length 0x400 00:25:15.808 Nvme1n1 : 0.58 356.58 22.29 109.72 0.00 136104.99 40777.96 118838.61 00:25:15.808 [2024-11-27T02:20:18.427Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.808 [2024-11-27T02:20:18.428Z] Job: Nvme2n1 ended in about 0.59 seconds with error 00:25:15.809 Verification LBA range: start 0x0 length 0x400 00:25:15.809 Nvme2n1 : 0.59 352.93 22.06 33.94 0.00 160002.16 10388.67 138256.69 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme3n1 ended in about 0.59 seconds with error 00:25:15.809 Verification LBA range: start 0x0 length 0x400 00:25:15.809 Nvme3n1 : 0.59 355.38 22.21 109.35 0.00 133018.09 35146.71 118061.89 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme4n1 ended in about 0.57 seconds with error 00:25:15.809 Verification LBA range: start 0x0 length 0x400 00:25:15.809 Nvme4n1 : 0.57 362.91 22.68 111.67 0.00 128378.10 15437.37 116508.44 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme5n1 ended in about 0.57 seconds with error 00:25:15.809 Verification LBA range: start 0x0 length 0x400 00:25:15.809 Nvme5n1 : 0.57 362.23 22.64 111.46 0.00 126864.72 9029.40 116508.44 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme6n1 ended in about 0.59 seconds with error 00:25:15.809 Verification LBA range: start 0x0 length 0x400 00:25:15.809 Nvme6n1 : 0.59 348.97 21.81 37.27 0.00 152208.11 8349.77 116508.44 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme7n1 ended in about 0.59 seconds with error 00:25:15.809 Verification LBA range: start 0x0 length 0x400 00:25:15.809 Nvme7n1 : 0.59 350.12 21.88 35.52 0.00 150122.26 8495.41 118838.61 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme8n1 ended in about 0.60 seconds with error 00:25:15.809 Verification LBA range: start 0x0 length 0x400 00:25:15.809 Nvme8n1 : 0.60 275.35 17.21 107.45 0.00 151099.87 98255.45 121945.51 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme9n1 ended in about 0.61 seconds with error 00:25:15.809 Verification LBA range: start 0x0 length 0x400 00:25:15.809 Nvme9n1 : 0.61 270.86 16.93 105.70 0.00 151758.21 99032.18 122722.23 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:15.809 [2024-11-27T02:20:18.428Z] Job: Nvme10n1 ended in about 0.60 seconds with error 00:25:15.809 Verification LBA range: start 0x0 length 0x400 00:25:15.809 Nvme10n1 : 0.60 273.89 17.12 106.89 0.00 147866.93 84662.80 124275.67 00:25:15.809 [2024-11-27T02:20:18.428Z] =================================================================================================================== 00:25:15.809 [2024-11-27T02:20:18.428Z] Total : 3309.23 206.83 868.95 0.00 142835.77 8349.77 138256.69 00:25:15.809 [2024-11-27 03:20:18.353858] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:15.809 [2024-11-27 03:20:18.353952] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:15.809 [2024-11-27 03:20:18.354025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x151d700 (9): Bad file descriptor 00:25:15.809 [2024-11-27 03:20:18.354054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13bc070 (9): Bad file descriptor 00:25:15.809 [2024-11-27 03:20:18.354073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x152cc50 (9): Bad file descriptor 00:25:15.809 [2024-11-27 03:20:18.354090] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:15.809 [2024-11-27 03:20:18.354115] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:15.809 [2024-11-27 03:20:18.354132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:15.809 [2024-11-27 03:20:18.354158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:15.809 [2024-11-27 03:20:18.354171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:15.809 [2024-11-27 03:20:18.354185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:15.809 [2024-11-27 03:20:18.354216] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.809 [2024-11-27 03:20:18.354240] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.809 [2024-11-27 03:20:18.354420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.809 [2024-11-27 03:20:18.354444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.809 [2024-11-27 03:20:18.354676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.354787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.354814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13be650 with addr=10.0.0.2, port=4420 00:25:15.809 [2024-11-27 03:20:18.354832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13be650 is same with the state(5) to be set 00:25:15.809 [2024-11-27 03:20:18.354847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:15.809 [2024-11-27 03:20:18.354860] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:15.809 [2024-11-27 03:20:18.354873] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:15.809 [2024-11-27 03:20:18.354891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:15.809 [2024-11-27 03:20:18.354905] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:15.809 [2024-11-27 03:20:18.354918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:15.809 [2024-11-27 03:20:18.354934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:15.809 [2024-11-27 03:20:18.354947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:15.809 [2024-11-27 03:20:18.354960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:15.809 [2024-11-27 03:20:18.355007] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.809 [2024-11-27 03:20:18.355029] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.809 [2024-11-27 03:20:18.355048] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:15.809 [2024-11-27 03:20:18.355413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.809 [2024-11-27 03:20:18.355437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.809 [2024-11-27 03:20:18.355450] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.809 [2024-11-27 03:20:18.355480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13be650 (9): Bad file descriptor 00:25:15.809 [2024-11-27 03:20:18.355551] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:15.809 [2024-11-27 03:20:18.355577] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:15.809 [2024-11-27 03:20:18.355599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:15.809 [2024-11-27 03:20:18.355615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:15.809 [2024-11-27 03:20:18.355655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:15.809 [2024-11-27 03:20:18.355671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:15.809 [2024-11-27 03:20:18.355683] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:15.809 [2024-11-27 03:20:18.355721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:15.809 [2024-11-27 03:20:18.355742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:15.809 [2024-11-27 03:20:18.355767] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.809 [2024-11-27 03:20:18.355885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.355981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.356006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1508c80 with addr=10.0.0.2, port=4420 00:25:15.809 [2024-11-27 03:20:18.356022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1508c80 is same with the state(5) to be set 00:25:15.809 [2024-11-27 03:20:18.356106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.356203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.356229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1389a30 with addr=10.0.0.2, port=4420 00:25:15.809 [2024-11-27 03:20:18.356244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1389a30 is same with the state(5) to be set 00:25:15.809 [2024-11-27 03:20:18.356314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.356398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.356423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x152e100 with addr=10.0.0.2, port=4420 00:25:15.809 [2024-11-27 03:20:18.356439] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x152e100 is same with the state(5) to be set 00:25:15.809 [2024-11-27 03:20:18.356554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.356656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.356681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13676b0 with addr=10.0.0.2, port=4420 00:25:15.809 [2024-11-27 03:20:18.356696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13676b0 is same with the state(5) to be set 00:25:15.809 [2024-11-27 03:20:18.356824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.356926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.356953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1518660 with addr=10.0.0.2, port=4420 00:25:15.809 [2024-11-27 03:20:18.356969] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1518660 is same with the state(5) to be set 00:25:15.809 [2024-11-27 03:20:18.357045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.809 [2024-11-27 03:20:18.357133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:15.810 [2024-11-27 03:20:18.357158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1374d30 with addr=10.0.0.2, port=4420 00:25:15.810 [2024-11-27 03:20:18.357173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1374d30 is same with the state(5) to be set 00:25:15.810 [2024-11-27 03:20:18.357197] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1508c80 (9): Bad file descriptor 00:25:15.810 [2024-11-27 03:20:18.357216] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1389a30 (9): Bad file descriptor 00:25:15.810 [2024-11-27 03:20:18.357233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x152e100 (9): Bad file descriptor 00:25:15.810 [2024-11-27 03:20:18.357250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13676b0 (9): Bad file descriptor 00:25:15.810 [2024-11-27 03:20:18.357294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1518660 (9): Bad file descriptor 00:25:15.810 [2024-11-27 03:20:18.357317] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1374d30 (9): Bad file descriptor 00:25:15.810 [2024-11-27 03:20:18.357333] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:15.810 [2024-11-27 03:20:18.357345] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:15.810 [2024-11-27 03:20:18.357358] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:15.810 [2024-11-27 03:20:18.357374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:15.810 [2024-11-27 03:20:18.357388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:15.810 [2024-11-27 03:20:18.357400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:15.810 [2024-11-27 03:20:18.357415] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:15.810 [2024-11-27 03:20:18.357428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:15.810 [2024-11-27 03:20:18.357440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:15.810 [2024-11-27 03:20:18.357455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:15.810 [2024-11-27 03:20:18.357467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:15.810 [2024-11-27 03:20:18.357479] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:15.810 [2024-11-27 03:20:18.357516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.810 [2024-11-27 03:20:18.357543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.810 [2024-11-27 03:20:18.357555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.810 [2024-11-27 03:20:18.357566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.810 [2024-11-27 03:20:18.357578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:15.810 [2024-11-27 03:20:18.357590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:15.810 [2024-11-27 03:20:18.357603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:15.810 [2024-11-27 03:20:18.357618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:15.810 [2024-11-27 03:20:18.357631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:15.810 [2024-11-27 03:20:18.357643] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:15.810 [2024-11-27 03:20:18.357681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:15.810 [2024-11-27 03:20:18.357699] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:16.378 03:20:18 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:16.378 03:20:18 -- target/shutdown.sh@138 -- # sleep 1 00:25:17.424 03:20:19 -- target/shutdown.sh@141 -- # kill -9 2531912 00:25:17.424 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2531912) - No such process 00:25:17.424 03:20:19 -- target/shutdown.sh@141 -- # true 00:25:17.424 03:20:19 -- target/shutdown.sh@143 -- # stoptarget 00:25:17.424 03:20:19 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:17.424 03:20:19 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:17.424 03:20:19 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:17.424 03:20:19 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:17.424 03:20:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:17.424 03:20:19 -- nvmf/common.sh@116 -- # sync 00:25:17.424 03:20:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:17.424 03:20:19 -- nvmf/common.sh@119 -- # set +e 00:25:17.424 03:20:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:17.424 03:20:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:17.424 rmmod nvme_tcp 00:25:17.424 rmmod nvme_fabrics 00:25:17.424 rmmod nvme_keyring 00:25:17.424 03:20:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:17.424 03:20:19 -- nvmf/common.sh@123 -- # set -e 00:25:17.424 03:20:19 -- nvmf/common.sh@124 -- # return 0 00:25:17.424 03:20:19 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:17.424 03:20:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:17.424 03:20:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:17.424 03:20:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:17.424 03:20:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:17.424 03:20:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:17.424 03:20:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:17.424 03:20:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:17.424 03:20:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:19.331 03:20:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:19.331 00:25:19.331 real 0m7.724s 00:25:19.331 user 0m19.411s 00:25:19.331 sys 0m1.376s 00:25:19.331 03:20:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:19.331 03:20:21 -- common/autotest_common.sh@10 -- # set +x 00:25:19.331 ************************************ 00:25:19.331 END TEST nvmf_shutdown_tc3 00:25:19.331 ************************************ 00:25:19.331 03:20:21 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:19.331 00:25:19.331 real 0m28.452s 00:25:19.331 user 1m21.455s 00:25:19.331 sys 0m6.173s 00:25:19.331 03:20:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:19.331 03:20:21 -- common/autotest_common.sh@10 -- # set +x 00:25:19.331 ************************************ 00:25:19.331 END TEST nvmf_shutdown 00:25:19.331 ************************************ 00:25:19.591 03:20:21 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:19.591 03:20:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:19.591 03:20:21 -- common/autotest_common.sh@10 -- # set +x 00:25:19.591 03:20:21 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:19.591 03:20:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:19.591 03:20:21 -- common/autotest_common.sh@10 -- # set +x 00:25:19.591 03:20:22 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:19.591 03:20:22 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:19.591 03:20:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:19.591 03:20:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:19.591 03:20:22 -- common/autotest_common.sh@10 -- # set +x 00:25:19.591 ************************************ 00:25:19.591 START TEST nvmf_multicontroller 00:25:19.591 ************************************ 00:25:19.591 03:20:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:19.591 * Looking for test storage... 00:25:19.591 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:19.591 03:20:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:19.591 03:20:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:19.591 03:20:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:19.591 03:20:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:19.591 03:20:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:19.591 03:20:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:19.591 03:20:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:19.591 03:20:22 -- scripts/common.sh@335 -- # IFS=.-: 00:25:19.591 03:20:22 -- scripts/common.sh@335 -- # read -ra ver1 00:25:19.591 03:20:22 -- scripts/common.sh@336 -- # IFS=.-: 00:25:19.591 03:20:22 -- scripts/common.sh@336 -- # read -ra ver2 00:25:19.591 03:20:22 -- scripts/common.sh@337 -- # local 'op=<' 00:25:19.591 03:20:22 -- scripts/common.sh@339 -- # ver1_l=2 00:25:19.591 03:20:22 -- scripts/common.sh@340 -- # ver2_l=1 00:25:19.591 03:20:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:19.591 03:20:22 -- scripts/common.sh@343 -- # case "$op" in 00:25:19.591 03:20:22 -- scripts/common.sh@344 -- # : 1 00:25:19.591 03:20:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:19.591 03:20:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:19.591 03:20:22 -- scripts/common.sh@364 -- # decimal 1 00:25:19.591 03:20:22 -- scripts/common.sh@352 -- # local d=1 00:25:19.591 03:20:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:19.591 03:20:22 -- scripts/common.sh@354 -- # echo 1 00:25:19.591 03:20:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:19.591 03:20:22 -- scripts/common.sh@365 -- # decimal 2 00:25:19.591 03:20:22 -- scripts/common.sh@352 -- # local d=2 00:25:19.591 03:20:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:19.591 03:20:22 -- scripts/common.sh@354 -- # echo 2 00:25:19.591 03:20:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:19.591 03:20:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:19.591 03:20:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:19.591 03:20:22 -- scripts/common.sh@367 -- # return 0 00:25:19.591 03:20:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:19.591 03:20:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:19.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:19.591 --rc genhtml_branch_coverage=1 00:25:19.591 --rc genhtml_function_coverage=1 00:25:19.591 --rc genhtml_legend=1 00:25:19.591 --rc geninfo_all_blocks=1 00:25:19.591 --rc geninfo_unexecuted_blocks=1 00:25:19.591 00:25:19.591 ' 00:25:19.591 03:20:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:19.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:19.591 --rc genhtml_branch_coverage=1 00:25:19.591 --rc genhtml_function_coverage=1 00:25:19.591 --rc genhtml_legend=1 00:25:19.591 --rc geninfo_all_blocks=1 00:25:19.591 --rc geninfo_unexecuted_blocks=1 00:25:19.591 00:25:19.591 ' 00:25:19.591 03:20:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:19.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:19.591 --rc genhtml_branch_coverage=1 00:25:19.591 --rc genhtml_function_coverage=1 00:25:19.591 --rc genhtml_legend=1 00:25:19.591 --rc geninfo_all_blocks=1 00:25:19.591 --rc geninfo_unexecuted_blocks=1 00:25:19.591 00:25:19.591 ' 00:25:19.591 03:20:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:19.591 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:19.591 --rc genhtml_branch_coverage=1 00:25:19.591 --rc genhtml_function_coverage=1 00:25:19.591 --rc genhtml_legend=1 00:25:19.591 --rc geninfo_all_blocks=1 00:25:19.591 --rc geninfo_unexecuted_blocks=1 00:25:19.591 00:25:19.591 ' 00:25:19.591 03:20:22 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:19.591 03:20:22 -- nvmf/common.sh@7 -- # uname -s 00:25:19.591 03:20:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:19.591 03:20:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:19.591 03:20:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:19.591 03:20:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:19.591 03:20:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:19.591 03:20:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:19.591 03:20:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:19.592 03:20:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:19.592 03:20:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:19.592 03:20:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:19.592 03:20:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:19.592 03:20:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:19.592 03:20:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:19.592 03:20:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:19.592 03:20:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:19.592 03:20:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:19.592 03:20:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:19.592 03:20:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:19.592 03:20:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:19.592 03:20:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:19.592 03:20:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:19.592 03:20:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:19.592 03:20:22 -- paths/export.sh@5 -- # export PATH 00:25:19.592 03:20:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:19.592 03:20:22 -- nvmf/common.sh@46 -- # : 0 00:25:19.592 03:20:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:19.592 03:20:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:19.592 03:20:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:19.592 03:20:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:19.592 03:20:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:19.592 03:20:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:19.592 03:20:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:19.592 03:20:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:19.592 03:20:22 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:19.592 03:20:22 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:19.592 03:20:22 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:19.592 03:20:22 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:19.592 03:20:22 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:19.592 03:20:22 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:19.592 03:20:22 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:19.592 03:20:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:19.592 03:20:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:19.592 03:20:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:19.592 03:20:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:19.592 03:20:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:19.592 03:20:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:19.592 03:20:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:19.592 03:20:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:19.592 03:20:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:19.592 03:20:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:19.592 03:20:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:19.592 03:20:22 -- common/autotest_common.sh@10 -- # set +x 00:25:21.496 03:20:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:21.496 03:20:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:21.496 03:20:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:21.496 03:20:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:21.496 03:20:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:21.496 03:20:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:21.496 03:20:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:21.496 03:20:24 -- nvmf/common.sh@294 -- # net_devs=() 00:25:21.496 03:20:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:21.496 03:20:24 -- nvmf/common.sh@295 -- # e810=() 00:25:21.496 03:20:24 -- nvmf/common.sh@295 -- # local -ga e810 00:25:21.496 03:20:24 -- nvmf/common.sh@296 -- # x722=() 00:25:21.496 03:20:24 -- nvmf/common.sh@296 -- # local -ga x722 00:25:21.496 03:20:24 -- nvmf/common.sh@297 -- # mlx=() 00:25:21.496 03:20:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:21.496 03:20:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:21.496 03:20:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:21.496 03:20:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:21.496 03:20:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:21.496 03:20:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:21.496 03:20:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:21.496 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:21.496 03:20:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:21.496 03:20:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:21.496 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:21.496 03:20:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:21.496 03:20:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:21.496 03:20:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:21.496 03:20:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:21.496 03:20:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:21.496 03:20:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:21.496 03:20:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:21.496 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:21.497 03:20:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:21.497 03:20:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:21.497 03:20:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:21.497 03:20:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:21.497 03:20:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:21.497 03:20:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:21.497 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:21.497 03:20:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:21.497 03:20:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:21.497 03:20:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:21.497 03:20:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:21.497 03:20:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:21.497 03:20:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:21.497 03:20:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:21.497 03:20:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:21.497 03:20:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:21.497 03:20:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:21.497 03:20:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:21.497 03:20:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:21.497 03:20:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:21.497 03:20:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:21.497 03:20:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:21.497 03:20:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:21.497 03:20:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:21.497 03:20:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:21.497 03:20:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:21.754 03:20:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:21.754 03:20:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:21.754 03:20:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:21.754 03:20:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:21.754 03:20:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:21.754 03:20:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:21.754 03:20:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:21.754 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:21.754 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:25:21.754 00:25:21.754 --- 10.0.0.2 ping statistics --- 00:25:21.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:21.754 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:25:21.754 03:20:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:21.754 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:21.754 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.091 ms 00:25:21.754 00:25:21.754 --- 10.0.0.1 ping statistics --- 00:25:21.754 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:21.754 rtt min/avg/max/mdev = 0.091/0.091/0.091/0.000 ms 00:25:21.754 03:20:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:21.754 03:20:24 -- nvmf/common.sh@410 -- # return 0 00:25:21.754 03:20:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:21.754 03:20:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:21.754 03:20:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:21.754 03:20:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:21.754 03:20:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:21.754 03:20:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:21.754 03:20:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:21.754 03:20:24 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:21.754 03:20:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:21.754 03:20:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:21.754 03:20:24 -- common/autotest_common.sh@10 -- # set +x 00:25:21.754 03:20:24 -- nvmf/common.sh@469 -- # nvmfpid=2534343 00:25:21.754 03:20:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:21.754 03:20:24 -- nvmf/common.sh@470 -- # waitforlisten 2534343 00:25:21.754 03:20:24 -- common/autotest_common.sh@829 -- # '[' -z 2534343 ']' 00:25:21.754 03:20:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:21.754 03:20:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:21.754 03:20:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:21.754 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:21.754 03:20:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:21.754 03:20:24 -- common/autotest_common.sh@10 -- # set +x 00:25:21.754 [2024-11-27 03:20:24.266285] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:21.754 [2024-11-27 03:20:24.266361] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:21.754 EAL: No free 2048 kB hugepages reported on node 1 00:25:21.754 [2024-11-27 03:20:24.334644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:22.012 [2024-11-27 03:20:24.423772] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:22.012 [2024-11-27 03:20:24.423946] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:22.012 [2024-11-27 03:20:24.423965] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:22.012 [2024-11-27 03:20:24.423979] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:22.012 [2024-11-27 03:20:24.424063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:22.012 [2024-11-27 03:20:24.424180] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:22.012 [2024-11-27 03:20:24.424183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:22.950 03:20:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:22.950 03:20:25 -- common/autotest_common.sh@862 -- # return 0 00:25:22.950 03:20:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:22.950 03:20:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 03:20:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:22.950 03:20:25 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 [2024-11-27 03:20:25.245680] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 Malloc0 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 [2024-11-27 03:20:25.307656] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 [2024-11-27 03:20:25.315501] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 Malloc1 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:22.950 03:20:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:22.950 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:22.950 03:20:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:22.950 03:20:25 -- host/multicontroller.sh@44 -- # bdevperf_pid=2534498 00:25:22.950 03:20:25 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:22.950 03:20:25 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:22.950 03:20:25 -- host/multicontroller.sh@47 -- # waitforlisten 2534498 /var/tmp/bdevperf.sock 00:25:22.950 03:20:25 -- common/autotest_common.sh@829 -- # '[' -z 2534498 ']' 00:25:22.950 03:20:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:22.950 03:20:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:22.950 03:20:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:22.951 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:22.951 03:20:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:22.951 03:20:25 -- common/autotest_common.sh@10 -- # set +x 00:25:23.885 03:20:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:23.885 03:20:26 -- common/autotest_common.sh@862 -- # return 0 00:25:23.885 03:20:26 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:23.885 03:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:23.885 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.145 NVMe0n1 00:25:24.145 03:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:24.145 03:20:26 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:24.145 03:20:26 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:24.145 03:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.145 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.145 03:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:24.145 1 00:25:24.145 03:20:26 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:24.145 03:20:26 -- common/autotest_common.sh@650 -- # local es=0 00:25:24.145 03:20:26 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:24.145 03:20:26 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:24.145 03:20:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:24.145 03:20:26 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:24.145 03:20:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:24.145 03:20:26 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:24.145 03:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.145 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.145 request: 00:25:24.145 { 00:25:24.145 "name": "NVMe0", 00:25:24.145 "trtype": "tcp", 00:25:24.145 "traddr": "10.0.0.2", 00:25:24.145 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:24.145 "hostaddr": "10.0.0.2", 00:25:24.145 "hostsvcid": "60000", 00:25:24.145 "adrfam": "ipv4", 00:25:24.145 "trsvcid": "4420", 00:25:24.145 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:24.145 "method": "bdev_nvme_attach_controller", 00:25:24.145 "req_id": 1 00:25:24.145 } 00:25:24.145 Got JSON-RPC error response 00:25:24.145 response: 00:25:24.145 { 00:25:24.145 "code": -114, 00:25:24.145 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:24.145 } 00:25:24.145 03:20:26 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:24.145 03:20:26 -- common/autotest_common.sh@653 -- # es=1 00:25:24.146 03:20:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:24.146 03:20:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:24.146 03:20:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:24.146 03:20:26 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:24.146 03:20:26 -- common/autotest_common.sh@650 -- # local es=0 00:25:24.146 03:20:26 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:24.146 03:20:26 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:24.146 03:20:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:24.146 03:20:26 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:24.146 03:20:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:24.146 03:20:26 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:24.146 03:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.146 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.146 request: 00:25:24.146 { 00:25:24.146 "name": "NVMe0", 00:25:24.146 "trtype": "tcp", 00:25:24.146 "traddr": "10.0.0.2", 00:25:24.146 "hostaddr": "10.0.0.2", 00:25:24.146 "hostsvcid": "60000", 00:25:24.146 "adrfam": "ipv4", 00:25:24.146 "trsvcid": "4420", 00:25:24.146 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:24.146 "method": "bdev_nvme_attach_controller", 00:25:24.146 "req_id": 1 00:25:24.146 } 00:25:24.146 Got JSON-RPC error response 00:25:24.146 response: 00:25:24.146 { 00:25:24.146 "code": -114, 00:25:24.146 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:24.146 } 00:25:24.146 03:20:26 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:24.146 03:20:26 -- common/autotest_common.sh@653 -- # es=1 00:25:24.146 03:20:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:24.146 03:20:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:24.146 03:20:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:24.146 03:20:26 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:24.146 03:20:26 -- common/autotest_common.sh@650 -- # local es=0 00:25:24.146 03:20:26 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:24.146 03:20:26 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:24.146 03:20:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:24.146 03:20:26 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:24.146 03:20:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:24.146 03:20:26 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:24.146 03:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.146 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.146 request: 00:25:24.146 { 00:25:24.146 "name": "NVMe0", 00:25:24.146 "trtype": "tcp", 00:25:24.146 "traddr": "10.0.0.2", 00:25:24.146 "hostaddr": "10.0.0.2", 00:25:24.146 "hostsvcid": "60000", 00:25:24.146 "adrfam": "ipv4", 00:25:24.146 "trsvcid": "4420", 00:25:24.146 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:24.146 "multipath": "disable", 00:25:24.146 "method": "bdev_nvme_attach_controller", 00:25:24.146 "req_id": 1 00:25:24.146 } 00:25:24.146 Got JSON-RPC error response 00:25:24.146 response: 00:25:24.146 { 00:25:24.146 "code": -114, 00:25:24.146 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:24.146 } 00:25:24.146 03:20:26 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:24.146 03:20:26 -- common/autotest_common.sh@653 -- # es=1 00:25:24.146 03:20:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:24.146 03:20:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:24.146 03:20:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:24.146 03:20:26 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:24.146 03:20:26 -- common/autotest_common.sh@650 -- # local es=0 00:25:24.146 03:20:26 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:24.146 03:20:26 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:24.146 03:20:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:24.146 03:20:26 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:24.146 03:20:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:24.146 03:20:26 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:24.146 03:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.146 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.146 request: 00:25:24.146 { 00:25:24.146 "name": "NVMe0", 00:25:24.146 "trtype": "tcp", 00:25:24.146 "traddr": "10.0.0.2", 00:25:24.146 "hostaddr": "10.0.0.2", 00:25:24.146 "hostsvcid": "60000", 00:25:24.146 "adrfam": "ipv4", 00:25:24.146 "trsvcid": "4420", 00:25:24.146 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:24.146 "multipath": "failover", 00:25:24.146 "method": "bdev_nvme_attach_controller", 00:25:24.146 "req_id": 1 00:25:24.146 } 00:25:24.146 Got JSON-RPC error response 00:25:24.146 response: 00:25:24.146 { 00:25:24.146 "code": -114, 00:25:24.146 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:24.146 } 00:25:24.146 03:20:26 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:24.146 03:20:26 -- common/autotest_common.sh@653 -- # es=1 00:25:24.146 03:20:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:24.146 03:20:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:24.146 03:20:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:24.146 03:20:26 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:24.146 03:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.146 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.405 00:25:24.405 03:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:24.405 03:20:26 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:24.405 03:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.405 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.406 03:20:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:24.406 03:20:26 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:24.406 03:20:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.406 03:20:26 -- common/autotest_common.sh@10 -- # set +x 00:25:24.665 00:25:24.665 03:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:24.665 03:20:27 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:24.665 03:20:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:24.665 03:20:27 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:24.665 03:20:27 -- common/autotest_common.sh@10 -- # set +x 00:25:24.665 03:20:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:24.665 03:20:27 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:24.665 03:20:27 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:25.601 0 00:25:25.860 03:20:28 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:25.861 03:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.861 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:25:25.861 03:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.861 03:20:28 -- host/multicontroller.sh@100 -- # killprocess 2534498 00:25:25.861 03:20:28 -- common/autotest_common.sh@936 -- # '[' -z 2534498 ']' 00:25:25.861 03:20:28 -- common/autotest_common.sh@940 -- # kill -0 2534498 00:25:25.861 03:20:28 -- common/autotest_common.sh@941 -- # uname 00:25:25.861 03:20:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:25.861 03:20:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2534498 00:25:25.861 03:20:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:25.861 03:20:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:25.861 03:20:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2534498' 00:25:25.861 killing process with pid 2534498 00:25:25.861 03:20:28 -- common/autotest_common.sh@955 -- # kill 2534498 00:25:25.861 03:20:28 -- common/autotest_common.sh@960 -- # wait 2534498 00:25:26.121 03:20:28 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:26.121 03:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.121 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:25:26.121 03:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.121 03:20:28 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:26.121 03:20:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:26.121 03:20:28 -- common/autotest_common.sh@10 -- # set +x 00:25:26.121 03:20:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:26.121 03:20:28 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:26.121 03:20:28 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:26.121 03:20:28 -- common/autotest_common.sh@1607 -- # read -r file 00:25:26.121 03:20:28 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:26.121 03:20:28 -- common/autotest_common.sh@1606 -- # sort -u 00:25:26.121 03:20:28 -- common/autotest_common.sh@1608 -- # cat 00:25:26.121 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:26.121 [2024-11-27 03:20:25.417946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:26.121 [2024-11-27 03:20:25.418033] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2534498 ] 00:25:26.121 EAL: No free 2048 kB hugepages reported on node 1 00:25:26.121 [2024-11-27 03:20:25.479933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:26.121 [2024-11-27 03:20:25.563775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:26.121 [2024-11-27 03:20:27.057812] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 1f034d35-b985-4730-8471-9676784d97a6 already exists 00:25:26.121 [2024-11-27 03:20:27.057871] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:1f034d35-b985-4730-8471-9676784d97a6 alias for bdev NVMe1n1 00:25:26.121 [2024-11-27 03:20:27.057889] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:26.121 Running I/O for 1 seconds... 00:25:26.121 00:25:26.121 Latency(us) 00:25:26.121 [2024-11-27T02:20:28.740Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:26.121 [2024-11-27T02:20:28.740Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:26.121 NVMe0n1 : 1.01 18278.19 71.40 0.00 0.00 6992.44 2111.72 12718.84 00:25:26.121 [2024-11-27T02:20:28.740Z] =================================================================================================================== 00:25:26.121 [2024-11-27T02:20:28.740Z] Total : 18278.19 71.40 0.00 0.00 6992.44 2111.72 12718.84 00:25:26.121 Received shutdown signal, test time was about 1.000000 seconds 00:25:26.121 00:25:26.121 Latency(us) 00:25:26.121 [2024-11-27T02:20:28.740Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:26.121 [2024-11-27T02:20:28.740Z] =================================================================================================================== 00:25:26.121 [2024-11-27T02:20:28.740Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:26.121 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:26.121 03:20:28 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:26.121 03:20:28 -- common/autotest_common.sh@1607 -- # read -r file 00:25:26.121 03:20:28 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:26.121 03:20:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:26.121 03:20:28 -- nvmf/common.sh@116 -- # sync 00:25:26.121 03:20:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:26.121 03:20:28 -- nvmf/common.sh@119 -- # set +e 00:25:26.121 03:20:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:26.121 03:20:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:26.121 rmmod nvme_tcp 00:25:26.121 rmmod nvme_fabrics 00:25:26.121 rmmod nvme_keyring 00:25:26.121 03:20:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:26.121 03:20:28 -- nvmf/common.sh@123 -- # set -e 00:25:26.121 03:20:28 -- nvmf/common.sh@124 -- # return 0 00:25:26.121 03:20:28 -- nvmf/common.sh@477 -- # '[' -n 2534343 ']' 00:25:26.121 03:20:28 -- nvmf/common.sh@478 -- # killprocess 2534343 00:25:26.121 03:20:28 -- common/autotest_common.sh@936 -- # '[' -z 2534343 ']' 00:25:26.121 03:20:28 -- common/autotest_common.sh@940 -- # kill -0 2534343 00:25:26.121 03:20:28 -- common/autotest_common.sh@941 -- # uname 00:25:26.121 03:20:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:26.121 03:20:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2534343 00:25:26.121 03:20:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:26.121 03:20:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:26.121 03:20:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2534343' 00:25:26.121 killing process with pid 2534343 00:25:26.121 03:20:28 -- common/autotest_common.sh@955 -- # kill 2534343 00:25:26.121 03:20:28 -- common/autotest_common.sh@960 -- # wait 2534343 00:25:26.381 03:20:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:26.381 03:20:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:26.381 03:20:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:26.381 03:20:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:26.381 03:20:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:26.381 03:20:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:26.381 03:20:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:26.381 03:20:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:28.916 03:20:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:28.916 00:25:28.916 real 0m8.939s 00:25:28.916 user 0m17.560s 00:25:28.916 sys 0m2.345s 00:25:28.916 03:20:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:28.916 03:20:30 -- common/autotest_common.sh@10 -- # set +x 00:25:28.916 ************************************ 00:25:28.916 END TEST nvmf_multicontroller 00:25:28.916 ************************************ 00:25:28.916 03:20:30 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:28.916 03:20:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:28.916 03:20:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:28.916 03:20:30 -- common/autotest_common.sh@10 -- # set +x 00:25:28.916 ************************************ 00:25:28.916 START TEST nvmf_aer 00:25:28.916 ************************************ 00:25:28.916 03:20:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:28.916 * Looking for test storage... 00:25:28.916 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:28.916 03:20:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:28.916 03:20:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:28.916 03:20:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:28.916 03:20:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:28.916 03:20:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:28.916 03:20:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:28.916 03:20:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:28.916 03:20:31 -- scripts/common.sh@335 -- # IFS=.-: 00:25:28.916 03:20:31 -- scripts/common.sh@335 -- # read -ra ver1 00:25:28.916 03:20:31 -- scripts/common.sh@336 -- # IFS=.-: 00:25:28.916 03:20:31 -- scripts/common.sh@336 -- # read -ra ver2 00:25:28.916 03:20:31 -- scripts/common.sh@337 -- # local 'op=<' 00:25:28.916 03:20:31 -- scripts/common.sh@339 -- # ver1_l=2 00:25:28.916 03:20:31 -- scripts/common.sh@340 -- # ver2_l=1 00:25:28.916 03:20:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:28.916 03:20:31 -- scripts/common.sh@343 -- # case "$op" in 00:25:28.916 03:20:31 -- scripts/common.sh@344 -- # : 1 00:25:28.916 03:20:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:28.916 03:20:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:28.916 03:20:31 -- scripts/common.sh@364 -- # decimal 1 00:25:28.916 03:20:31 -- scripts/common.sh@352 -- # local d=1 00:25:28.916 03:20:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:28.916 03:20:31 -- scripts/common.sh@354 -- # echo 1 00:25:28.916 03:20:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:28.916 03:20:31 -- scripts/common.sh@365 -- # decimal 2 00:25:28.916 03:20:31 -- scripts/common.sh@352 -- # local d=2 00:25:28.916 03:20:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:28.916 03:20:31 -- scripts/common.sh@354 -- # echo 2 00:25:28.916 03:20:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:28.916 03:20:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:28.916 03:20:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:28.916 03:20:31 -- scripts/common.sh@367 -- # return 0 00:25:28.916 03:20:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:28.916 03:20:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:28.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:28.916 --rc genhtml_branch_coverage=1 00:25:28.916 --rc genhtml_function_coverage=1 00:25:28.916 --rc genhtml_legend=1 00:25:28.916 --rc geninfo_all_blocks=1 00:25:28.916 --rc geninfo_unexecuted_blocks=1 00:25:28.916 00:25:28.916 ' 00:25:28.916 03:20:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:28.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:28.916 --rc genhtml_branch_coverage=1 00:25:28.916 --rc genhtml_function_coverage=1 00:25:28.916 --rc genhtml_legend=1 00:25:28.916 --rc geninfo_all_blocks=1 00:25:28.916 --rc geninfo_unexecuted_blocks=1 00:25:28.916 00:25:28.916 ' 00:25:28.916 03:20:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:28.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:28.916 --rc genhtml_branch_coverage=1 00:25:28.916 --rc genhtml_function_coverage=1 00:25:28.916 --rc genhtml_legend=1 00:25:28.916 --rc geninfo_all_blocks=1 00:25:28.916 --rc geninfo_unexecuted_blocks=1 00:25:28.916 00:25:28.916 ' 00:25:28.916 03:20:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:28.916 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:28.916 --rc genhtml_branch_coverage=1 00:25:28.916 --rc genhtml_function_coverage=1 00:25:28.916 --rc genhtml_legend=1 00:25:28.916 --rc geninfo_all_blocks=1 00:25:28.916 --rc geninfo_unexecuted_blocks=1 00:25:28.916 00:25:28.916 ' 00:25:28.916 03:20:31 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:28.916 03:20:31 -- nvmf/common.sh@7 -- # uname -s 00:25:28.916 03:20:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:28.916 03:20:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:28.916 03:20:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:28.916 03:20:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:28.916 03:20:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:28.916 03:20:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:28.916 03:20:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:28.916 03:20:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:28.916 03:20:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:28.916 03:20:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:28.916 03:20:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:28.916 03:20:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:28.916 03:20:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:28.916 03:20:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:28.916 03:20:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:28.916 03:20:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:28.916 03:20:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:28.916 03:20:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:28.916 03:20:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:28.916 03:20:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.917 03:20:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.917 03:20:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.917 03:20:31 -- paths/export.sh@5 -- # export PATH 00:25:28.917 03:20:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:28.917 03:20:31 -- nvmf/common.sh@46 -- # : 0 00:25:28.917 03:20:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:28.917 03:20:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:28.917 03:20:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:28.917 03:20:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:28.917 03:20:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:28.917 03:20:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:28.917 03:20:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:28.917 03:20:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:28.917 03:20:31 -- host/aer.sh@11 -- # nvmftestinit 00:25:28.917 03:20:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:28.917 03:20:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:28.917 03:20:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:28.917 03:20:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:28.917 03:20:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:28.917 03:20:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:28.917 03:20:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:28.917 03:20:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:28.917 03:20:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:28.917 03:20:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:28.917 03:20:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:28.917 03:20:31 -- common/autotest_common.sh@10 -- # set +x 00:25:30.822 03:20:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:30.822 03:20:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:30.822 03:20:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:30.822 03:20:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:30.822 03:20:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:30.822 03:20:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:30.822 03:20:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:30.822 03:20:33 -- nvmf/common.sh@294 -- # net_devs=() 00:25:30.822 03:20:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:30.822 03:20:33 -- nvmf/common.sh@295 -- # e810=() 00:25:30.822 03:20:33 -- nvmf/common.sh@295 -- # local -ga e810 00:25:30.822 03:20:33 -- nvmf/common.sh@296 -- # x722=() 00:25:30.822 03:20:33 -- nvmf/common.sh@296 -- # local -ga x722 00:25:30.822 03:20:33 -- nvmf/common.sh@297 -- # mlx=() 00:25:30.822 03:20:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:30.822 03:20:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:30.822 03:20:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:30.822 03:20:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:30.822 03:20:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:30.822 03:20:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:30.822 03:20:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:30.822 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:30.822 03:20:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:30.822 03:20:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:30.822 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:30.822 03:20:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:30.822 03:20:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:30.822 03:20:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:30.822 03:20:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:30.822 03:20:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:30.822 03:20:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:30.822 03:20:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:30.823 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:30.823 03:20:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:30.823 03:20:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:30.823 03:20:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:30.823 03:20:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:30.823 03:20:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:30.823 03:20:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:30.823 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:30.823 03:20:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:30.823 03:20:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:30.823 03:20:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:30.823 03:20:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:30.823 03:20:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:30.823 03:20:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:30.823 03:20:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:30.823 03:20:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:30.823 03:20:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:30.823 03:20:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:30.823 03:20:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:30.823 03:20:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:30.823 03:20:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:30.823 03:20:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:30.823 03:20:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:30.823 03:20:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:30.823 03:20:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:30.823 03:20:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:30.823 03:20:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:30.823 03:20:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:30.823 03:20:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:30.823 03:20:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:30.823 03:20:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:30.823 03:20:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:30.823 03:20:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:30.823 03:20:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:30.823 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:30.823 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.243 ms 00:25:30.823 00:25:30.823 --- 10.0.0.2 ping statistics --- 00:25:30.823 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:30.823 rtt min/avg/max/mdev = 0.243/0.243/0.243/0.000 ms 00:25:30.823 03:20:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:30.823 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:30.823 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.055 ms 00:25:30.823 00:25:30.823 --- 10.0.0.1 ping statistics --- 00:25:30.823 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:30.823 rtt min/avg/max/mdev = 0.055/0.055/0.055/0.000 ms 00:25:30.823 03:20:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:30.823 03:20:33 -- nvmf/common.sh@410 -- # return 0 00:25:30.823 03:20:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:30.823 03:20:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:30.823 03:20:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:30.823 03:20:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:30.823 03:20:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:30.823 03:20:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:30.823 03:20:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:30.823 03:20:33 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:30.823 03:20:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:30.823 03:20:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:30.823 03:20:33 -- common/autotest_common.sh@10 -- # set +x 00:25:30.823 03:20:33 -- nvmf/common.sh@469 -- # nvmfpid=2536873 00:25:30.823 03:20:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:30.823 03:20:33 -- nvmf/common.sh@470 -- # waitforlisten 2536873 00:25:30.823 03:20:33 -- common/autotest_common.sh@829 -- # '[' -z 2536873 ']' 00:25:30.823 03:20:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:30.823 03:20:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:30.823 03:20:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:30.823 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:30.823 03:20:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:30.823 03:20:33 -- common/autotest_common.sh@10 -- # set +x 00:25:31.082 [2024-11-27 03:20:33.447396] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:31.083 [2024-11-27 03:20:33.447466] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:31.083 EAL: No free 2048 kB hugepages reported on node 1 00:25:31.083 [2024-11-27 03:20:33.517004] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:31.083 [2024-11-27 03:20:33.610390] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:31.083 [2024-11-27 03:20:33.610558] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:31.083 [2024-11-27 03:20:33.610578] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:31.083 [2024-11-27 03:20:33.610590] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:31.083 [2024-11-27 03:20:33.610659] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:31.083 [2024-11-27 03:20:33.610678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:31.083 [2024-11-27 03:20:33.610739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:31.083 [2024-11-27 03:20:33.610742] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:32.021 03:20:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:32.021 03:20:34 -- common/autotest_common.sh@862 -- # return 0 00:25:32.021 03:20:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:32.021 03:20:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:32.021 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.021 03:20:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:32.021 03:20:34 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:32.021 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.021 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.021 [2024-11-27 03:20:34.501364] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:32.021 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.021 03:20:34 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:32.021 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.021 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.021 Malloc0 00:25:32.021 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.021 03:20:34 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:32.021 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.021 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.021 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.021 03:20:34 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:32.021 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.021 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.021 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.021 03:20:34 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:32.021 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.021 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.021 [2024-11-27 03:20:34.555017] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:32.021 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.021 03:20:34 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:32.021 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.021 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.021 [2024-11-27 03:20:34.562737] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:32.021 [ 00:25:32.021 { 00:25:32.021 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:32.021 "subtype": "Discovery", 00:25:32.021 "listen_addresses": [], 00:25:32.021 "allow_any_host": true, 00:25:32.021 "hosts": [] 00:25:32.021 }, 00:25:32.021 { 00:25:32.021 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:32.021 "subtype": "NVMe", 00:25:32.021 "listen_addresses": [ 00:25:32.021 { 00:25:32.021 "transport": "TCP", 00:25:32.021 "trtype": "TCP", 00:25:32.021 "adrfam": "IPv4", 00:25:32.021 "traddr": "10.0.0.2", 00:25:32.021 "trsvcid": "4420" 00:25:32.021 } 00:25:32.021 ], 00:25:32.021 "allow_any_host": true, 00:25:32.021 "hosts": [], 00:25:32.021 "serial_number": "SPDK00000000000001", 00:25:32.021 "model_number": "SPDK bdev Controller", 00:25:32.021 "max_namespaces": 2, 00:25:32.021 "min_cntlid": 1, 00:25:32.021 "max_cntlid": 65519, 00:25:32.021 "namespaces": [ 00:25:32.021 { 00:25:32.021 "nsid": 1, 00:25:32.021 "bdev_name": "Malloc0", 00:25:32.021 "name": "Malloc0", 00:25:32.021 "nguid": "CF6A135D915B4E4BBB1B7E78E3589622", 00:25:32.021 "uuid": "cf6a135d-915b-4e4b-bb1b-7e78e3589622" 00:25:32.021 } 00:25:32.021 ] 00:25:32.021 } 00:25:32.021 ] 00:25:32.021 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.021 03:20:34 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:32.021 03:20:34 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:32.021 03:20:34 -- host/aer.sh@33 -- # aerpid=2537031 00:25:32.021 03:20:34 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:32.021 03:20:34 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:32.021 03:20:34 -- common/autotest_common.sh@1254 -- # local i=0 00:25:32.021 03:20:34 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:32.021 03:20:34 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:32.021 03:20:34 -- common/autotest_common.sh@1257 -- # i=1 00:25:32.021 03:20:34 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:32.021 EAL: No free 2048 kB hugepages reported on node 1 00:25:32.280 03:20:34 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:32.280 03:20:34 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:32.280 03:20:34 -- common/autotest_common.sh@1257 -- # i=2 00:25:32.280 03:20:34 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:32.280 03:20:34 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:32.280 03:20:34 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:32.280 03:20:34 -- common/autotest_common.sh@1265 -- # return 0 00:25:32.280 03:20:34 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:32.280 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.280 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.280 Malloc1 00:25:32.280 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.280 03:20:34 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:32.280 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.280 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.280 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.280 03:20:34 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:32.280 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.280 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.280 Asynchronous Event Request test 00:25:32.280 Attaching to 10.0.0.2 00:25:32.280 Attached to 10.0.0.2 00:25:32.280 Registering asynchronous event callbacks... 00:25:32.280 Starting namespace attribute notice tests for all controllers... 00:25:32.280 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:32.280 aer_cb - Changed Namespace 00:25:32.280 Cleaning up... 00:25:32.280 [ 00:25:32.280 { 00:25:32.280 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:32.280 "subtype": "Discovery", 00:25:32.280 "listen_addresses": [], 00:25:32.280 "allow_any_host": true, 00:25:32.280 "hosts": [] 00:25:32.280 }, 00:25:32.280 { 00:25:32.280 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:32.280 "subtype": "NVMe", 00:25:32.280 "listen_addresses": [ 00:25:32.280 { 00:25:32.280 "transport": "TCP", 00:25:32.281 "trtype": "TCP", 00:25:32.281 "adrfam": "IPv4", 00:25:32.281 "traddr": "10.0.0.2", 00:25:32.281 "trsvcid": "4420" 00:25:32.281 } 00:25:32.281 ], 00:25:32.281 "allow_any_host": true, 00:25:32.281 "hosts": [], 00:25:32.281 "serial_number": "SPDK00000000000001", 00:25:32.281 "model_number": "SPDK bdev Controller", 00:25:32.281 "max_namespaces": 2, 00:25:32.281 "min_cntlid": 1, 00:25:32.281 "max_cntlid": 65519, 00:25:32.281 "namespaces": [ 00:25:32.281 { 00:25:32.281 "nsid": 1, 00:25:32.281 "bdev_name": "Malloc0", 00:25:32.281 "name": "Malloc0", 00:25:32.281 "nguid": "CF6A135D915B4E4BBB1B7E78E3589622", 00:25:32.281 "uuid": "cf6a135d-915b-4e4b-bb1b-7e78e3589622" 00:25:32.281 }, 00:25:32.281 { 00:25:32.281 "nsid": 2, 00:25:32.281 "bdev_name": "Malloc1", 00:25:32.281 "name": "Malloc1", 00:25:32.281 "nguid": "8DE78E3D753B4621855E6945D16A0CC2", 00:25:32.281 "uuid": "8de78e3d-753b-4621-855e-6945d16a0cc2" 00:25:32.281 } 00:25:32.281 ] 00:25:32.281 } 00:25:32.281 ] 00:25:32.281 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.281 03:20:34 -- host/aer.sh@43 -- # wait 2537031 00:25:32.281 03:20:34 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:32.281 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.281 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.281 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.281 03:20:34 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:32.281 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.281 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.538 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.538 03:20:34 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:32.538 03:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:32.538 03:20:34 -- common/autotest_common.sh@10 -- # set +x 00:25:32.538 03:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:32.538 03:20:34 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:32.538 03:20:34 -- host/aer.sh@51 -- # nvmftestfini 00:25:32.538 03:20:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:32.538 03:20:34 -- nvmf/common.sh@116 -- # sync 00:25:32.538 03:20:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:32.538 03:20:34 -- nvmf/common.sh@119 -- # set +e 00:25:32.538 03:20:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:32.538 03:20:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:32.538 rmmod nvme_tcp 00:25:32.538 rmmod nvme_fabrics 00:25:32.538 rmmod nvme_keyring 00:25:32.538 03:20:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:32.538 03:20:34 -- nvmf/common.sh@123 -- # set -e 00:25:32.538 03:20:34 -- nvmf/common.sh@124 -- # return 0 00:25:32.538 03:20:34 -- nvmf/common.sh@477 -- # '[' -n 2536873 ']' 00:25:32.538 03:20:34 -- nvmf/common.sh@478 -- # killprocess 2536873 00:25:32.538 03:20:34 -- common/autotest_common.sh@936 -- # '[' -z 2536873 ']' 00:25:32.538 03:20:34 -- common/autotest_common.sh@940 -- # kill -0 2536873 00:25:32.538 03:20:34 -- common/autotest_common.sh@941 -- # uname 00:25:32.538 03:20:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:32.538 03:20:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2536873 00:25:32.538 03:20:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:32.539 03:20:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:32.539 03:20:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2536873' 00:25:32.539 killing process with pid 2536873 00:25:32.539 03:20:35 -- common/autotest_common.sh@955 -- # kill 2536873 00:25:32.539 [2024-11-27 03:20:35.024781] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:32.539 03:20:35 -- common/autotest_common.sh@960 -- # wait 2536873 00:25:32.797 03:20:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:32.797 03:20:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:32.797 03:20:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:32.797 03:20:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:32.797 03:20:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:32.797 03:20:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:32.797 03:20:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:32.797 03:20:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:34.702 03:20:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:34.702 00:25:34.702 real 0m6.299s 00:25:34.702 user 0m7.514s 00:25:34.702 sys 0m2.035s 00:25:34.702 03:20:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:34.702 03:20:37 -- common/autotest_common.sh@10 -- # set +x 00:25:34.702 ************************************ 00:25:34.702 END TEST nvmf_aer 00:25:34.702 ************************************ 00:25:34.702 03:20:37 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:34.702 03:20:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:34.702 03:20:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:34.702 03:20:37 -- common/autotest_common.sh@10 -- # set +x 00:25:34.702 ************************************ 00:25:34.702 START TEST nvmf_async_init 00:25:34.702 ************************************ 00:25:34.702 03:20:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:34.961 * Looking for test storage... 00:25:34.961 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:34.961 03:20:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:34.961 03:20:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:34.961 03:20:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:34.961 03:20:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:34.961 03:20:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:34.961 03:20:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:34.961 03:20:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:34.961 03:20:37 -- scripts/common.sh@335 -- # IFS=.-: 00:25:34.961 03:20:37 -- scripts/common.sh@335 -- # read -ra ver1 00:25:34.961 03:20:37 -- scripts/common.sh@336 -- # IFS=.-: 00:25:34.961 03:20:37 -- scripts/common.sh@336 -- # read -ra ver2 00:25:34.961 03:20:37 -- scripts/common.sh@337 -- # local 'op=<' 00:25:34.961 03:20:37 -- scripts/common.sh@339 -- # ver1_l=2 00:25:34.961 03:20:37 -- scripts/common.sh@340 -- # ver2_l=1 00:25:34.961 03:20:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:34.961 03:20:37 -- scripts/common.sh@343 -- # case "$op" in 00:25:34.961 03:20:37 -- scripts/common.sh@344 -- # : 1 00:25:34.961 03:20:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:34.961 03:20:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:34.961 03:20:37 -- scripts/common.sh@364 -- # decimal 1 00:25:34.961 03:20:37 -- scripts/common.sh@352 -- # local d=1 00:25:34.961 03:20:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:34.961 03:20:37 -- scripts/common.sh@354 -- # echo 1 00:25:34.961 03:20:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:34.961 03:20:37 -- scripts/common.sh@365 -- # decimal 2 00:25:34.961 03:20:37 -- scripts/common.sh@352 -- # local d=2 00:25:34.961 03:20:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:34.961 03:20:37 -- scripts/common.sh@354 -- # echo 2 00:25:34.961 03:20:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:34.961 03:20:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:34.961 03:20:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:34.961 03:20:37 -- scripts/common.sh@367 -- # return 0 00:25:34.961 03:20:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:34.961 03:20:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:34.961 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:34.961 --rc genhtml_branch_coverage=1 00:25:34.961 --rc genhtml_function_coverage=1 00:25:34.961 --rc genhtml_legend=1 00:25:34.961 --rc geninfo_all_blocks=1 00:25:34.961 --rc geninfo_unexecuted_blocks=1 00:25:34.961 00:25:34.961 ' 00:25:34.961 03:20:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:34.961 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:34.961 --rc genhtml_branch_coverage=1 00:25:34.961 --rc genhtml_function_coverage=1 00:25:34.962 --rc genhtml_legend=1 00:25:34.962 --rc geninfo_all_blocks=1 00:25:34.962 --rc geninfo_unexecuted_blocks=1 00:25:34.962 00:25:34.962 ' 00:25:34.962 03:20:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:34.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:34.962 --rc genhtml_branch_coverage=1 00:25:34.962 --rc genhtml_function_coverage=1 00:25:34.962 --rc genhtml_legend=1 00:25:34.962 --rc geninfo_all_blocks=1 00:25:34.962 --rc geninfo_unexecuted_blocks=1 00:25:34.962 00:25:34.962 ' 00:25:34.962 03:20:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:34.962 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:34.962 --rc genhtml_branch_coverage=1 00:25:34.962 --rc genhtml_function_coverage=1 00:25:34.962 --rc genhtml_legend=1 00:25:34.962 --rc geninfo_all_blocks=1 00:25:34.962 --rc geninfo_unexecuted_blocks=1 00:25:34.962 00:25:34.962 ' 00:25:34.962 03:20:37 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:34.962 03:20:37 -- nvmf/common.sh@7 -- # uname -s 00:25:34.962 03:20:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:34.962 03:20:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:34.962 03:20:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:34.962 03:20:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:34.962 03:20:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:34.962 03:20:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:34.962 03:20:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:34.962 03:20:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:34.962 03:20:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:34.962 03:20:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:34.962 03:20:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:34.962 03:20:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:34.962 03:20:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:34.962 03:20:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:34.962 03:20:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:34.962 03:20:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:34.962 03:20:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:34.962 03:20:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:34.962 03:20:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:34.962 03:20:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.962 03:20:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.962 03:20:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.962 03:20:37 -- paths/export.sh@5 -- # export PATH 00:25:34.962 03:20:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:34.962 03:20:37 -- nvmf/common.sh@46 -- # : 0 00:25:34.962 03:20:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:34.962 03:20:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:34.962 03:20:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:34.962 03:20:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:34.962 03:20:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:34.962 03:20:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:34.962 03:20:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:34.962 03:20:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:34.962 03:20:37 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:34.962 03:20:37 -- host/async_init.sh@14 -- # null_block_size=512 00:25:34.962 03:20:37 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:34.962 03:20:37 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:34.962 03:20:37 -- host/async_init.sh@20 -- # uuidgen 00:25:34.962 03:20:37 -- host/async_init.sh@20 -- # tr -d - 00:25:34.962 03:20:37 -- host/async_init.sh@20 -- # nguid=097d3abeecc74b3c996f7d81b3b4dbc5 00:25:34.962 03:20:37 -- host/async_init.sh@22 -- # nvmftestinit 00:25:34.962 03:20:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:34.962 03:20:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:34.962 03:20:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:34.962 03:20:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:34.962 03:20:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:34.962 03:20:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:34.962 03:20:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:34.962 03:20:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:34.962 03:20:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:34.962 03:20:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:34.962 03:20:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:34.962 03:20:37 -- common/autotest_common.sh@10 -- # set +x 00:25:37.494 03:20:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:37.494 03:20:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:37.494 03:20:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:37.494 03:20:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:37.494 03:20:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:37.494 03:20:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:37.494 03:20:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:37.494 03:20:39 -- nvmf/common.sh@294 -- # net_devs=() 00:25:37.494 03:20:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:37.494 03:20:39 -- nvmf/common.sh@295 -- # e810=() 00:25:37.494 03:20:39 -- nvmf/common.sh@295 -- # local -ga e810 00:25:37.494 03:20:39 -- nvmf/common.sh@296 -- # x722=() 00:25:37.494 03:20:39 -- nvmf/common.sh@296 -- # local -ga x722 00:25:37.494 03:20:39 -- nvmf/common.sh@297 -- # mlx=() 00:25:37.494 03:20:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:37.494 03:20:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:37.494 03:20:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:37.494 03:20:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:37.494 03:20:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:37.494 03:20:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:37.494 03:20:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:37.494 03:20:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:37.495 03:20:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:37.495 03:20:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:37.495 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:37.495 03:20:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:37.495 03:20:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:37.495 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:37.495 03:20:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:37.495 03:20:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:37.495 03:20:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:37.495 03:20:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:37.495 03:20:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:37.495 03:20:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:37.495 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:37.495 03:20:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:37.495 03:20:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:37.495 03:20:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:37.495 03:20:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:37.495 03:20:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:37.495 03:20:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:37.495 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:37.495 03:20:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:37.495 03:20:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:37.495 03:20:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:37.495 03:20:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:37.495 03:20:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:37.495 03:20:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:37.495 03:20:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:37.495 03:20:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:37.495 03:20:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:37.495 03:20:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:37.495 03:20:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:37.495 03:20:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:37.495 03:20:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:37.495 03:20:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:37.495 03:20:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:37.495 03:20:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:37.495 03:20:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:37.495 03:20:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:37.495 03:20:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:37.495 03:20:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:37.495 03:20:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:37.495 03:20:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:37.495 03:20:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:37.495 03:20:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:37.495 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:37.495 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:25:37.495 00:25:37.495 --- 10.0.0.2 ping statistics --- 00:25:37.495 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:37.495 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:25:37.495 03:20:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:37.495 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:37.495 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:25:37.495 00:25:37.495 --- 10.0.0.1 ping statistics --- 00:25:37.495 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:37.495 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:25:37.495 03:20:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:37.495 03:20:39 -- nvmf/common.sh@410 -- # return 0 00:25:37.495 03:20:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:37.495 03:20:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:37.495 03:20:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:37.495 03:20:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:37.495 03:20:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:37.495 03:20:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:37.495 03:20:39 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:37.495 03:20:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:37.495 03:20:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:37.495 03:20:39 -- common/autotest_common.sh@10 -- # set +x 00:25:37.495 03:20:39 -- nvmf/common.sh@469 -- # nvmfpid=2539102 00:25:37.495 03:20:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:37.495 03:20:39 -- nvmf/common.sh@470 -- # waitforlisten 2539102 00:25:37.495 03:20:39 -- common/autotest_common.sh@829 -- # '[' -z 2539102 ']' 00:25:37.495 03:20:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:37.495 03:20:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:37.495 03:20:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:37.495 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:37.495 03:20:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:37.495 03:20:39 -- common/autotest_common.sh@10 -- # set +x 00:25:37.495 [2024-11-27 03:20:39.777862] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:37.496 [2024-11-27 03:20:39.777927] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:37.496 EAL: No free 2048 kB hugepages reported on node 1 00:25:37.496 [2024-11-27 03:20:39.843801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:37.496 [2024-11-27 03:20:39.931851] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:37.496 [2024-11-27 03:20:39.932014] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:37.496 [2024-11-27 03:20:39.932033] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:37.496 [2024-11-27 03:20:39.932047] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:37.496 [2024-11-27 03:20:39.932077] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:37.496 03:20:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:37.496 03:20:40 -- common/autotest_common.sh@862 -- # return 0 00:25:37.496 03:20:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:37.496 03:20:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:37.496 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.496 03:20:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:37.496 03:20:40 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:37.496 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.496 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.496 [2024-11-27 03:20:40.077726] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:37.496 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.496 03:20:40 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:37.496 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.496 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.496 null0 00:25:37.496 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.496 03:20:40 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:37.496 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.496 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.496 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.496 03:20:40 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:37.496 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.496 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.496 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.496 03:20:40 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 097d3abeecc74b3c996f7d81b3b4dbc5 00:25:37.496 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.496 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.753 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.753 03:20:40 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:37.753 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.753 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.753 [2024-11-27 03:20:40.118020] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:37.753 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.753 03:20:40 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:37.753 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.753 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.753 nvme0n1 00:25:37.753 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.753 03:20:40 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:37.753 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.753 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.753 [ 00:25:37.753 { 00:25:37.753 "name": "nvme0n1", 00:25:37.753 "aliases": [ 00:25:37.753 "097d3abe-ecc7-4b3c-996f-7d81b3b4dbc5" 00:25:37.753 ], 00:25:37.753 "product_name": "NVMe disk", 00:25:37.753 "block_size": 512, 00:25:37.754 "num_blocks": 2097152, 00:25:37.754 "uuid": "097d3abe-ecc7-4b3c-996f-7d81b3b4dbc5", 00:25:37.754 "assigned_rate_limits": { 00:25:37.754 "rw_ios_per_sec": 0, 00:25:37.754 "rw_mbytes_per_sec": 0, 00:25:37.754 "r_mbytes_per_sec": 0, 00:25:37.754 "w_mbytes_per_sec": 0 00:25:37.754 }, 00:25:37.754 "claimed": false, 00:25:37.754 "zoned": false, 00:25:37.754 "supported_io_types": { 00:25:37.754 "read": true, 00:25:37.754 "write": true, 00:25:37.754 "unmap": false, 00:25:37.754 "write_zeroes": true, 00:25:37.754 "flush": true, 00:25:37.754 "reset": true, 00:25:37.754 "compare": true, 00:25:37.754 "compare_and_write": true, 00:25:37.754 "abort": true, 00:25:37.754 "nvme_admin": true, 00:25:37.754 "nvme_io": true 00:25:37.754 }, 00:25:37.754 "driver_specific": { 00:25:37.754 "nvme": [ 00:25:37.754 { 00:25:37.754 "trid": { 00:25:37.754 "trtype": "TCP", 00:25:37.754 "adrfam": "IPv4", 00:25:37.754 "traddr": "10.0.0.2", 00:25:37.754 "trsvcid": "4420", 00:25:37.754 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:37.754 }, 00:25:37.754 "ctrlr_data": { 00:25:37.754 "cntlid": 1, 00:25:37.754 "vendor_id": "0x8086", 00:25:37.754 "model_number": "SPDK bdev Controller", 00:25:37.754 "serial_number": "00000000000000000000", 00:25:37.754 "firmware_revision": "24.01.1", 00:25:37.754 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:37.754 "oacs": { 00:25:37.754 "security": 0, 00:25:37.754 "format": 0, 00:25:37.754 "firmware": 0, 00:25:37.754 "ns_manage": 0 00:25:37.754 }, 00:25:37.754 "multi_ctrlr": true, 00:25:37.754 "ana_reporting": false 00:25:37.754 }, 00:25:37.754 "vs": { 00:25:37.754 "nvme_version": "1.3" 00:25:37.754 }, 00:25:37.754 "ns_data": { 00:25:37.754 "id": 1, 00:25:37.754 "can_share": true 00:25:37.754 } 00:25:37.754 } 00:25:37.754 ], 00:25:37.754 "mp_policy": "active_passive" 00:25:37.754 } 00:25:37.754 } 00:25:37.754 ] 00:25:37.754 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:37.754 03:20:40 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:37.754 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:37.754 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:37.754 [2024-11-27 03:20:40.366608] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:37.754 [2024-11-27 03:20:40.366698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xcd13f0 (9): Bad file descriptor 00:25:38.012 [2024-11-27 03:20:40.498672] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:38.012 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.012 03:20:40 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:38.012 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.012 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.012 [ 00:25:38.012 { 00:25:38.012 "name": "nvme0n1", 00:25:38.012 "aliases": [ 00:25:38.012 "097d3abe-ecc7-4b3c-996f-7d81b3b4dbc5" 00:25:38.012 ], 00:25:38.012 "product_name": "NVMe disk", 00:25:38.012 "block_size": 512, 00:25:38.012 "num_blocks": 2097152, 00:25:38.012 "uuid": "097d3abe-ecc7-4b3c-996f-7d81b3b4dbc5", 00:25:38.012 "assigned_rate_limits": { 00:25:38.012 "rw_ios_per_sec": 0, 00:25:38.012 "rw_mbytes_per_sec": 0, 00:25:38.012 "r_mbytes_per_sec": 0, 00:25:38.012 "w_mbytes_per_sec": 0 00:25:38.012 }, 00:25:38.012 "claimed": false, 00:25:38.012 "zoned": false, 00:25:38.012 "supported_io_types": { 00:25:38.012 "read": true, 00:25:38.012 "write": true, 00:25:38.012 "unmap": false, 00:25:38.012 "write_zeroes": true, 00:25:38.012 "flush": true, 00:25:38.012 "reset": true, 00:25:38.012 "compare": true, 00:25:38.012 "compare_and_write": true, 00:25:38.012 "abort": true, 00:25:38.012 "nvme_admin": true, 00:25:38.012 "nvme_io": true 00:25:38.012 }, 00:25:38.012 "driver_specific": { 00:25:38.012 "nvme": [ 00:25:38.012 { 00:25:38.012 "trid": { 00:25:38.012 "trtype": "TCP", 00:25:38.012 "adrfam": "IPv4", 00:25:38.012 "traddr": "10.0.0.2", 00:25:38.012 "trsvcid": "4420", 00:25:38.012 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:38.012 }, 00:25:38.012 "ctrlr_data": { 00:25:38.012 "cntlid": 2, 00:25:38.012 "vendor_id": "0x8086", 00:25:38.012 "model_number": "SPDK bdev Controller", 00:25:38.012 "serial_number": "00000000000000000000", 00:25:38.012 "firmware_revision": "24.01.1", 00:25:38.012 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:38.012 "oacs": { 00:25:38.012 "security": 0, 00:25:38.012 "format": 0, 00:25:38.012 "firmware": 0, 00:25:38.012 "ns_manage": 0 00:25:38.012 }, 00:25:38.012 "multi_ctrlr": true, 00:25:38.012 "ana_reporting": false 00:25:38.012 }, 00:25:38.012 "vs": { 00:25:38.012 "nvme_version": "1.3" 00:25:38.012 }, 00:25:38.012 "ns_data": { 00:25:38.012 "id": 1, 00:25:38.012 "can_share": true 00:25:38.012 } 00:25:38.012 } 00:25:38.012 ], 00:25:38.012 "mp_policy": "active_passive" 00:25:38.012 } 00:25:38.012 } 00:25:38.012 ] 00:25:38.012 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.012 03:20:40 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:38.012 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.012 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.012 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.012 03:20:40 -- host/async_init.sh@53 -- # mktemp 00:25:38.012 03:20:40 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.RdYtFw8GVQ 00:25:38.012 03:20:40 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:38.012 03:20:40 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.RdYtFw8GVQ 00:25:38.012 03:20:40 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:38.012 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.012 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.012 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.012 03:20:40 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:38.012 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.012 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.012 [2024-11-27 03:20:40.543196] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:38.012 [2024-11-27 03:20:40.543336] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:38.012 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.012 03:20:40 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.RdYtFw8GVQ 00:25:38.012 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.012 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.012 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.012 03:20:40 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.RdYtFw8GVQ 00:25:38.012 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.012 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.012 [2024-11-27 03:20:40.559227] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:38.012 nvme0n1 00:25:38.012 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.012 03:20:40 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:38.012 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.012 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.271 [ 00:25:38.271 { 00:25:38.271 "name": "nvme0n1", 00:25:38.271 "aliases": [ 00:25:38.271 "097d3abe-ecc7-4b3c-996f-7d81b3b4dbc5" 00:25:38.271 ], 00:25:38.271 "product_name": "NVMe disk", 00:25:38.271 "block_size": 512, 00:25:38.271 "num_blocks": 2097152, 00:25:38.271 "uuid": "097d3abe-ecc7-4b3c-996f-7d81b3b4dbc5", 00:25:38.271 "assigned_rate_limits": { 00:25:38.271 "rw_ios_per_sec": 0, 00:25:38.271 "rw_mbytes_per_sec": 0, 00:25:38.271 "r_mbytes_per_sec": 0, 00:25:38.271 "w_mbytes_per_sec": 0 00:25:38.271 }, 00:25:38.271 "claimed": false, 00:25:38.271 "zoned": false, 00:25:38.271 "supported_io_types": { 00:25:38.271 "read": true, 00:25:38.271 "write": true, 00:25:38.271 "unmap": false, 00:25:38.271 "write_zeroes": true, 00:25:38.271 "flush": true, 00:25:38.271 "reset": true, 00:25:38.271 "compare": true, 00:25:38.271 "compare_and_write": true, 00:25:38.271 "abort": true, 00:25:38.271 "nvme_admin": true, 00:25:38.271 "nvme_io": true 00:25:38.271 }, 00:25:38.271 "driver_specific": { 00:25:38.271 "nvme": [ 00:25:38.271 { 00:25:38.271 "trid": { 00:25:38.271 "trtype": "TCP", 00:25:38.271 "adrfam": "IPv4", 00:25:38.271 "traddr": "10.0.0.2", 00:25:38.271 "trsvcid": "4421", 00:25:38.271 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:38.271 }, 00:25:38.271 "ctrlr_data": { 00:25:38.271 "cntlid": 3, 00:25:38.271 "vendor_id": "0x8086", 00:25:38.271 "model_number": "SPDK bdev Controller", 00:25:38.271 "serial_number": "00000000000000000000", 00:25:38.271 "firmware_revision": "24.01.1", 00:25:38.271 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:38.271 "oacs": { 00:25:38.271 "security": 0, 00:25:38.271 "format": 0, 00:25:38.271 "firmware": 0, 00:25:38.271 "ns_manage": 0 00:25:38.271 }, 00:25:38.271 "multi_ctrlr": true, 00:25:38.271 "ana_reporting": false 00:25:38.271 }, 00:25:38.271 "vs": { 00:25:38.271 "nvme_version": "1.3" 00:25:38.271 }, 00:25:38.271 "ns_data": { 00:25:38.271 "id": 1, 00:25:38.271 "can_share": true 00:25:38.271 } 00:25:38.271 } 00:25:38.271 ], 00:25:38.271 "mp_policy": "active_passive" 00:25:38.271 } 00:25:38.271 } 00:25:38.271 ] 00:25:38.271 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.271 03:20:40 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:38.271 03:20:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:38.271 03:20:40 -- common/autotest_common.sh@10 -- # set +x 00:25:38.271 03:20:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:38.271 03:20:40 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.RdYtFw8GVQ 00:25:38.271 03:20:40 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:38.271 03:20:40 -- host/async_init.sh@78 -- # nvmftestfini 00:25:38.271 03:20:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:38.271 03:20:40 -- nvmf/common.sh@116 -- # sync 00:25:38.271 03:20:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:38.271 03:20:40 -- nvmf/common.sh@119 -- # set +e 00:25:38.271 03:20:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:38.271 03:20:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:38.271 rmmod nvme_tcp 00:25:38.271 rmmod nvme_fabrics 00:25:38.271 rmmod nvme_keyring 00:25:38.271 03:20:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:38.271 03:20:40 -- nvmf/common.sh@123 -- # set -e 00:25:38.271 03:20:40 -- nvmf/common.sh@124 -- # return 0 00:25:38.271 03:20:40 -- nvmf/common.sh@477 -- # '[' -n 2539102 ']' 00:25:38.271 03:20:40 -- nvmf/common.sh@478 -- # killprocess 2539102 00:25:38.271 03:20:40 -- common/autotest_common.sh@936 -- # '[' -z 2539102 ']' 00:25:38.271 03:20:40 -- common/autotest_common.sh@940 -- # kill -0 2539102 00:25:38.271 03:20:40 -- common/autotest_common.sh@941 -- # uname 00:25:38.271 03:20:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:38.271 03:20:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2539102 00:25:38.271 03:20:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:38.271 03:20:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:38.271 03:20:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2539102' 00:25:38.271 killing process with pid 2539102 00:25:38.271 03:20:40 -- common/autotest_common.sh@955 -- # kill 2539102 00:25:38.271 03:20:40 -- common/autotest_common.sh@960 -- # wait 2539102 00:25:38.530 03:20:40 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:38.530 03:20:40 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:38.530 03:20:40 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:38.530 03:20:40 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:38.530 03:20:40 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:38.530 03:20:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:38.530 03:20:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:38.530 03:20:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.436 03:20:42 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:40.436 00:25:40.436 real 0m5.684s 00:25:40.436 user 0m2.193s 00:25:40.436 sys 0m1.939s 00:25:40.436 03:20:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:40.436 03:20:42 -- common/autotest_common.sh@10 -- # set +x 00:25:40.436 ************************************ 00:25:40.436 END TEST nvmf_async_init 00:25:40.436 ************************************ 00:25:40.436 03:20:43 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:40.436 03:20:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:40.436 03:20:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:40.436 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:40.436 ************************************ 00:25:40.436 START TEST dma 00:25:40.436 ************************************ 00:25:40.436 03:20:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:40.694 * Looking for test storage... 00:25:40.694 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:40.694 03:20:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:40.694 03:20:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:40.694 03:20:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:40.694 03:20:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:40.694 03:20:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:40.695 03:20:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:40.695 03:20:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:40.695 03:20:43 -- scripts/common.sh@335 -- # IFS=.-: 00:25:40.695 03:20:43 -- scripts/common.sh@335 -- # read -ra ver1 00:25:40.695 03:20:43 -- scripts/common.sh@336 -- # IFS=.-: 00:25:40.695 03:20:43 -- scripts/common.sh@336 -- # read -ra ver2 00:25:40.695 03:20:43 -- scripts/common.sh@337 -- # local 'op=<' 00:25:40.695 03:20:43 -- scripts/common.sh@339 -- # ver1_l=2 00:25:40.695 03:20:43 -- scripts/common.sh@340 -- # ver2_l=1 00:25:40.695 03:20:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:40.695 03:20:43 -- scripts/common.sh@343 -- # case "$op" in 00:25:40.695 03:20:43 -- scripts/common.sh@344 -- # : 1 00:25:40.695 03:20:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:40.695 03:20:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:40.695 03:20:43 -- scripts/common.sh@364 -- # decimal 1 00:25:40.695 03:20:43 -- scripts/common.sh@352 -- # local d=1 00:25:40.695 03:20:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:40.695 03:20:43 -- scripts/common.sh@354 -- # echo 1 00:25:40.695 03:20:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:40.695 03:20:43 -- scripts/common.sh@365 -- # decimal 2 00:25:40.695 03:20:43 -- scripts/common.sh@352 -- # local d=2 00:25:40.695 03:20:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:40.695 03:20:43 -- scripts/common.sh@354 -- # echo 2 00:25:40.695 03:20:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:40.695 03:20:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:40.695 03:20:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:40.695 03:20:43 -- scripts/common.sh@367 -- # return 0 00:25:40.695 03:20:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:40.695 03:20:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:40.695 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.695 --rc genhtml_branch_coverage=1 00:25:40.695 --rc genhtml_function_coverage=1 00:25:40.695 --rc genhtml_legend=1 00:25:40.695 --rc geninfo_all_blocks=1 00:25:40.695 --rc geninfo_unexecuted_blocks=1 00:25:40.695 00:25:40.695 ' 00:25:40.695 03:20:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:40.695 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.695 --rc genhtml_branch_coverage=1 00:25:40.695 --rc genhtml_function_coverage=1 00:25:40.695 --rc genhtml_legend=1 00:25:40.695 --rc geninfo_all_blocks=1 00:25:40.695 --rc geninfo_unexecuted_blocks=1 00:25:40.695 00:25:40.695 ' 00:25:40.695 03:20:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:40.695 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.695 --rc genhtml_branch_coverage=1 00:25:40.695 --rc genhtml_function_coverage=1 00:25:40.695 --rc genhtml_legend=1 00:25:40.695 --rc geninfo_all_blocks=1 00:25:40.695 --rc geninfo_unexecuted_blocks=1 00:25:40.695 00:25:40.695 ' 00:25:40.695 03:20:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:40.695 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.695 --rc genhtml_branch_coverage=1 00:25:40.695 --rc genhtml_function_coverage=1 00:25:40.695 --rc genhtml_legend=1 00:25:40.695 --rc geninfo_all_blocks=1 00:25:40.695 --rc geninfo_unexecuted_blocks=1 00:25:40.695 00:25:40.695 ' 00:25:40.695 03:20:43 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:40.695 03:20:43 -- nvmf/common.sh@7 -- # uname -s 00:25:40.695 03:20:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:40.695 03:20:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:40.695 03:20:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:40.695 03:20:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:40.695 03:20:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:40.695 03:20:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:40.695 03:20:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:40.695 03:20:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:40.695 03:20:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:40.695 03:20:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:40.695 03:20:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.695 03:20:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.695 03:20:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:40.695 03:20:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:40.695 03:20:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:40.695 03:20:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:40.695 03:20:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:40.695 03:20:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:40.695 03:20:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:40.695 03:20:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.695 03:20:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.695 03:20:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.695 03:20:43 -- paths/export.sh@5 -- # export PATH 00:25:40.695 03:20:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.695 03:20:43 -- nvmf/common.sh@46 -- # : 0 00:25:40.695 03:20:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:40.695 03:20:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:40.695 03:20:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:40.695 03:20:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:40.695 03:20:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:40.695 03:20:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:40.695 03:20:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:40.695 03:20:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:40.695 03:20:43 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:40.695 03:20:43 -- host/dma.sh@13 -- # exit 0 00:25:40.695 00:25:40.695 real 0m0.161s 00:25:40.695 user 0m0.105s 00:25:40.696 sys 0m0.065s 00:25:40.696 03:20:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:40.696 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:40.696 ************************************ 00:25:40.696 END TEST dma 00:25:40.696 ************************************ 00:25:40.696 03:20:43 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:40.696 03:20:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:40.696 03:20:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:40.696 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:40.696 ************************************ 00:25:40.696 START TEST nvmf_identify 00:25:40.696 ************************************ 00:25:40.696 03:20:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:40.696 * Looking for test storage... 00:25:40.696 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:40.696 03:20:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:40.696 03:20:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:40.696 03:20:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:40.954 03:20:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:40.954 03:20:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:40.954 03:20:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:40.954 03:20:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:40.954 03:20:43 -- scripts/common.sh@335 -- # IFS=.-: 00:25:40.954 03:20:43 -- scripts/common.sh@335 -- # read -ra ver1 00:25:40.954 03:20:43 -- scripts/common.sh@336 -- # IFS=.-: 00:25:40.954 03:20:43 -- scripts/common.sh@336 -- # read -ra ver2 00:25:40.954 03:20:43 -- scripts/common.sh@337 -- # local 'op=<' 00:25:40.954 03:20:43 -- scripts/common.sh@339 -- # ver1_l=2 00:25:40.954 03:20:43 -- scripts/common.sh@340 -- # ver2_l=1 00:25:40.954 03:20:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:40.954 03:20:43 -- scripts/common.sh@343 -- # case "$op" in 00:25:40.954 03:20:43 -- scripts/common.sh@344 -- # : 1 00:25:40.954 03:20:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:40.954 03:20:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:40.954 03:20:43 -- scripts/common.sh@364 -- # decimal 1 00:25:40.954 03:20:43 -- scripts/common.sh@352 -- # local d=1 00:25:40.954 03:20:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:40.954 03:20:43 -- scripts/common.sh@354 -- # echo 1 00:25:40.954 03:20:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:40.954 03:20:43 -- scripts/common.sh@365 -- # decimal 2 00:25:40.954 03:20:43 -- scripts/common.sh@352 -- # local d=2 00:25:40.954 03:20:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:40.954 03:20:43 -- scripts/common.sh@354 -- # echo 2 00:25:40.954 03:20:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:40.954 03:20:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:40.954 03:20:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:40.954 03:20:43 -- scripts/common.sh@367 -- # return 0 00:25:40.954 03:20:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:40.954 03:20:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:40.954 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.954 --rc genhtml_branch_coverage=1 00:25:40.954 --rc genhtml_function_coverage=1 00:25:40.954 --rc genhtml_legend=1 00:25:40.954 --rc geninfo_all_blocks=1 00:25:40.954 --rc geninfo_unexecuted_blocks=1 00:25:40.954 00:25:40.954 ' 00:25:40.954 03:20:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:40.954 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.954 --rc genhtml_branch_coverage=1 00:25:40.954 --rc genhtml_function_coverage=1 00:25:40.954 --rc genhtml_legend=1 00:25:40.954 --rc geninfo_all_blocks=1 00:25:40.954 --rc geninfo_unexecuted_blocks=1 00:25:40.954 00:25:40.954 ' 00:25:40.954 03:20:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:40.954 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.954 --rc genhtml_branch_coverage=1 00:25:40.954 --rc genhtml_function_coverage=1 00:25:40.954 --rc genhtml_legend=1 00:25:40.954 --rc geninfo_all_blocks=1 00:25:40.954 --rc geninfo_unexecuted_blocks=1 00:25:40.954 00:25:40.954 ' 00:25:40.954 03:20:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:40.954 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.954 --rc genhtml_branch_coverage=1 00:25:40.954 --rc genhtml_function_coverage=1 00:25:40.954 --rc genhtml_legend=1 00:25:40.954 --rc geninfo_all_blocks=1 00:25:40.954 --rc geninfo_unexecuted_blocks=1 00:25:40.954 00:25:40.954 ' 00:25:40.954 03:20:43 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:40.954 03:20:43 -- nvmf/common.sh@7 -- # uname -s 00:25:40.954 03:20:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:40.954 03:20:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:40.954 03:20:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:40.954 03:20:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:40.954 03:20:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:40.954 03:20:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:40.954 03:20:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:40.954 03:20:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:40.954 03:20:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:40.955 03:20:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:40.955 03:20:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.955 03:20:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.955 03:20:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:40.955 03:20:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:40.955 03:20:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:40.955 03:20:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:40.955 03:20:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:40.955 03:20:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:40.955 03:20:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:40.955 03:20:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.955 03:20:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.955 03:20:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.955 03:20:43 -- paths/export.sh@5 -- # export PATH 00:25:40.955 03:20:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.955 03:20:43 -- nvmf/common.sh@46 -- # : 0 00:25:40.955 03:20:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:40.955 03:20:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:40.955 03:20:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:40.955 03:20:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:40.955 03:20:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:40.955 03:20:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:40.955 03:20:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:40.955 03:20:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:40.955 03:20:43 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:40.955 03:20:43 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:40.955 03:20:43 -- host/identify.sh@14 -- # nvmftestinit 00:25:40.955 03:20:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:40.955 03:20:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:40.955 03:20:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:40.955 03:20:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:40.955 03:20:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:40.955 03:20:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.955 03:20:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.955 03:20:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.955 03:20:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:40.955 03:20:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:40.955 03:20:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:40.955 03:20:43 -- common/autotest_common.sh@10 -- # set +x 00:25:42.857 03:20:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:42.857 03:20:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:42.857 03:20:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:42.857 03:20:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:42.857 03:20:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:42.857 03:20:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:42.857 03:20:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:42.857 03:20:45 -- nvmf/common.sh@294 -- # net_devs=() 00:25:42.857 03:20:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:42.857 03:20:45 -- nvmf/common.sh@295 -- # e810=() 00:25:42.857 03:20:45 -- nvmf/common.sh@295 -- # local -ga e810 00:25:42.857 03:20:45 -- nvmf/common.sh@296 -- # x722=() 00:25:42.857 03:20:45 -- nvmf/common.sh@296 -- # local -ga x722 00:25:42.857 03:20:45 -- nvmf/common.sh@297 -- # mlx=() 00:25:42.857 03:20:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:42.857 03:20:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:42.857 03:20:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:42.857 03:20:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:42.857 03:20:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:42.857 03:20:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:42.857 03:20:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:42.857 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:42.857 03:20:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:42.857 03:20:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:42.857 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:42.857 03:20:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:42.857 03:20:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:42.857 03:20:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:42.857 03:20:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:42.857 03:20:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:42.857 03:20:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:42.857 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:42.857 03:20:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:42.857 03:20:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:42.857 03:20:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:42.857 03:20:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:42.857 03:20:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:42.857 03:20:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:42.857 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:42.857 03:20:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:42.857 03:20:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:42.857 03:20:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:42.857 03:20:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:42.857 03:20:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:42.857 03:20:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:42.857 03:20:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:42.857 03:20:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:42.857 03:20:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:42.857 03:20:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:42.857 03:20:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:42.857 03:20:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:42.857 03:20:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:42.857 03:20:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:42.857 03:20:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:42.857 03:20:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:42.857 03:20:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:42.857 03:20:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:42.857 03:20:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:42.857 03:20:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:42.857 03:20:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:42.857 03:20:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:43.116 03:20:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:43.116 03:20:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:43.116 03:20:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:43.116 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:43.116 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.192 ms 00:25:43.116 00:25:43.116 --- 10.0.0.2 ping statistics --- 00:25:43.116 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.116 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:25:43.116 03:20:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:43.116 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:43.116 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.080 ms 00:25:43.116 00:25:43.116 --- 10.0.0.1 ping statistics --- 00:25:43.116 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.116 rtt min/avg/max/mdev = 0.080/0.080/0.080/0.000 ms 00:25:43.116 03:20:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:43.116 03:20:45 -- nvmf/common.sh@410 -- # return 0 00:25:43.116 03:20:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:43.116 03:20:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:43.116 03:20:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:43.116 03:20:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:43.116 03:20:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:43.116 03:20:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:43.116 03:20:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:43.116 03:20:45 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:43.116 03:20:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:43.116 03:20:45 -- common/autotest_common.sh@10 -- # set +x 00:25:43.116 03:20:45 -- host/identify.sh@19 -- # nvmfpid=2541256 00:25:43.116 03:20:45 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:43.116 03:20:45 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:43.116 03:20:45 -- host/identify.sh@23 -- # waitforlisten 2541256 00:25:43.116 03:20:45 -- common/autotest_common.sh@829 -- # '[' -z 2541256 ']' 00:25:43.116 03:20:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:43.116 03:20:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.116 03:20:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:43.116 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:43.116 03:20:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.116 03:20:45 -- common/autotest_common.sh@10 -- # set +x 00:25:43.116 [2024-11-27 03:20:45.595459] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:43.116 [2024-11-27 03:20:45.595551] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:43.116 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.116 [2024-11-27 03:20:45.664322] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:43.374 [2024-11-27 03:20:45.755422] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:43.374 [2024-11-27 03:20:45.755582] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:43.374 [2024-11-27 03:20:45.755612] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:43.374 [2024-11-27 03:20:45.755627] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:43.374 [2024-11-27 03:20:45.755681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:43.374 [2024-11-27 03:20:45.755762] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:43.374 [2024-11-27 03:20:45.755782] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:43.374 [2024-11-27 03:20:45.755784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:44.310 03:20:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:44.310 03:20:46 -- common/autotest_common.sh@862 -- # return 0 00:25:44.310 03:20:46 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:44.310 03:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.310 03:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.310 [2024-11-27 03:20:46.567120] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:44.310 03:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.310 03:20:46 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:44.310 03:20:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:44.310 03:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.310 03:20:46 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:44.310 03:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.310 03:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.310 Malloc0 00:25:44.310 03:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.310 03:20:46 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:44.310 03:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.310 03:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.310 03:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.310 03:20:46 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:44.310 03:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.310 03:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.310 03:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.310 03:20:46 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:44.310 03:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.310 03:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.310 [2024-11-27 03:20:46.648241] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:44.310 03:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.310 03:20:46 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:44.310 03:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.310 03:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.311 03:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.311 03:20:46 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:44.311 03:20:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.311 03:20:46 -- common/autotest_common.sh@10 -- # set +x 00:25:44.311 [2024-11-27 03:20:46.664003] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:44.311 [ 00:25:44.311 { 00:25:44.311 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:44.311 "subtype": "Discovery", 00:25:44.311 "listen_addresses": [ 00:25:44.311 { 00:25:44.311 "transport": "TCP", 00:25:44.311 "trtype": "TCP", 00:25:44.311 "adrfam": "IPv4", 00:25:44.311 "traddr": "10.0.0.2", 00:25:44.311 "trsvcid": "4420" 00:25:44.311 } 00:25:44.311 ], 00:25:44.311 "allow_any_host": true, 00:25:44.311 "hosts": [] 00:25:44.311 }, 00:25:44.311 { 00:25:44.311 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:44.311 "subtype": "NVMe", 00:25:44.311 "listen_addresses": [ 00:25:44.311 { 00:25:44.311 "transport": "TCP", 00:25:44.311 "trtype": "TCP", 00:25:44.311 "adrfam": "IPv4", 00:25:44.311 "traddr": "10.0.0.2", 00:25:44.311 "trsvcid": "4420" 00:25:44.311 } 00:25:44.311 ], 00:25:44.311 "allow_any_host": true, 00:25:44.311 "hosts": [], 00:25:44.311 "serial_number": "SPDK00000000000001", 00:25:44.311 "model_number": "SPDK bdev Controller", 00:25:44.311 "max_namespaces": 32, 00:25:44.311 "min_cntlid": 1, 00:25:44.311 "max_cntlid": 65519, 00:25:44.311 "namespaces": [ 00:25:44.311 { 00:25:44.311 "nsid": 1, 00:25:44.311 "bdev_name": "Malloc0", 00:25:44.311 "name": "Malloc0", 00:25:44.311 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:44.311 "eui64": "ABCDEF0123456789", 00:25:44.311 "uuid": "b2fe5496-b633-4ac8-8264-acb0c982152e" 00:25:44.311 } 00:25:44.311 ] 00:25:44.311 } 00:25:44.311 ] 00:25:44.311 03:20:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.311 03:20:46 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:44.311 [2024-11-27 03:20:46.690654] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:44.311 [2024-11-27 03:20:46.690694] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2541419 ] 00:25:44.311 EAL: No free 2048 kB hugepages reported on node 1 00:25:44.311 [2024-11-27 03:20:46.722326] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:44.311 [2024-11-27 03:20:46.722385] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:44.311 [2024-11-27 03:20:46.722395] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:44.311 [2024-11-27 03:20:46.722410] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:44.311 [2024-11-27 03:20:46.722424] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:44.311 [2024-11-27 03:20:46.725584] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:44.311 [2024-11-27 03:20:46.725648] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x1d1f420 0 00:25:44.311 [2024-11-27 03:20:46.733538] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:44.311 [2024-11-27 03:20:46.733563] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:44.311 [2024-11-27 03:20:46.733571] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:44.311 [2024-11-27 03:20:46.733577] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:44.311 [2024-11-27 03:20:46.733628] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.733640] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.733652] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.311 [2024-11-27 03:20:46.733670] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:44.311 [2024-11-27 03:20:46.733697] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.311 [2024-11-27 03:20:46.741555] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.311 [2024-11-27 03:20:46.741572] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.311 [2024-11-27 03:20:46.741580] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.741587] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84b00) on tqpair=0x1d1f420 00:25:44.311 [2024-11-27 03:20:46.741607] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:44.311 [2024-11-27 03:20:46.741619] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:44.311 [2024-11-27 03:20:46.741628] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:44.311 [2024-11-27 03:20:46.741646] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.741655] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.741661] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.311 [2024-11-27 03:20:46.741673] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.311 [2024-11-27 03:20:46.741696] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.311 [2024-11-27 03:20:46.741846] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.311 [2024-11-27 03:20:46.741861] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.311 [2024-11-27 03:20:46.741868] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.741875] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84b00) on tqpair=0x1d1f420 00:25:44.311 [2024-11-27 03:20:46.741885] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:44.311 [2024-11-27 03:20:46.741899] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:44.311 [2024-11-27 03:20:46.741912] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.741920] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.741926] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.311 [2024-11-27 03:20:46.741937] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.311 [2024-11-27 03:20:46.741959] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.311 [2024-11-27 03:20:46.742045] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.311 [2024-11-27 03:20:46.742059] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.311 [2024-11-27 03:20:46.742066] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.742073] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84b00) on tqpair=0x1d1f420 00:25:44.311 [2024-11-27 03:20:46.742083] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:44.311 [2024-11-27 03:20:46.742097] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:44.311 [2024-11-27 03:20:46.742110] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.742117] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.742129] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.311 [2024-11-27 03:20:46.742140] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.311 [2024-11-27 03:20:46.742161] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.311 [2024-11-27 03:20:46.742246] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.311 [2024-11-27 03:20:46.742261] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.311 [2024-11-27 03:20:46.742267] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.311 [2024-11-27 03:20:46.742274] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84b00) on tqpair=0x1d1f420 00:25:44.312 [2024-11-27 03:20:46.742284] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:44.312 [2024-11-27 03:20:46.742301] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.742310] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.742317] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.312 [2024-11-27 03:20:46.742327] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.312 [2024-11-27 03:20:46.742348] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.312 [2024-11-27 03:20:46.742431] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.312 [2024-11-27 03:20:46.742445] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.312 [2024-11-27 03:20:46.742452] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.742459] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84b00) on tqpair=0x1d1f420 00:25:44.312 [2024-11-27 03:20:46.742468] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:44.312 [2024-11-27 03:20:46.742477] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:44.312 [2024-11-27 03:20:46.742490] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:44.312 [2024-11-27 03:20:46.742600] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:44.312 [2024-11-27 03:20:46.742611] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:44.312 [2024-11-27 03:20:46.742626] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.742634] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.742640] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.312 [2024-11-27 03:20:46.742651] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.312 [2024-11-27 03:20:46.742672] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.312 [2024-11-27 03:20:46.742805] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.312 [2024-11-27 03:20:46.742820] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.312 [2024-11-27 03:20:46.742826] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.742833] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84b00) on tqpair=0x1d1f420 00:25:44.312 [2024-11-27 03:20:46.742843] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:44.312 [2024-11-27 03:20:46.742864] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.742874] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.742881] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.312 [2024-11-27 03:20:46.742892] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.312 [2024-11-27 03:20:46.742913] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.312 [2024-11-27 03:20:46.743006] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.312 [2024-11-27 03:20:46.743020] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.312 [2024-11-27 03:20:46.743027] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.743034] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84b00) on tqpair=0x1d1f420 00:25:44.312 [2024-11-27 03:20:46.743043] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:44.312 [2024-11-27 03:20:46.743051] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:44.312 [2024-11-27 03:20:46.743065] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:44.312 [2024-11-27 03:20:46.743085] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:44.312 [2024-11-27 03:20:46.743100] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.743107] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.743114] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.312 [2024-11-27 03:20:46.743125] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.312 [2024-11-27 03:20:46.743146] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.312 [2024-11-27 03:20:46.743296] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.312 [2024-11-27 03:20:46.743311] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.312 [2024-11-27 03:20:46.743333] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.743340] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1f420): datao=0, datal=4096, cccid=0 00:25:44.312 [2024-11-27 03:20:46.743348] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d84b00) on tqpair(0x1d1f420): expected_datao=0, payload_size=4096 00:25:44.312 [2024-11-27 03:20:46.743367] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.743376] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.784541] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.312 [2024-11-27 03:20:46.784560] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.312 [2024-11-27 03:20:46.784583] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.784590] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84b00) on tqpair=0x1d1f420 00:25:44.312 [2024-11-27 03:20:46.784603] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:44.312 [2024-11-27 03:20:46.784613] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:44.312 [2024-11-27 03:20:46.784620] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:44.312 [2024-11-27 03:20:46.784629] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:44.312 [2024-11-27 03:20:46.784641] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:44.312 [2024-11-27 03:20:46.784650] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:44.312 [2024-11-27 03:20:46.784670] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:44.312 [2024-11-27 03:20:46.784684] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.784692] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.784699] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.312 [2024-11-27 03:20:46.784711] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:44.312 [2024-11-27 03:20:46.784734] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.312 [2024-11-27 03:20:46.784921] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.312 [2024-11-27 03:20:46.784936] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.312 [2024-11-27 03:20:46.784943] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.784949] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84b00) on tqpair=0x1d1f420 00:25:44.312 [2024-11-27 03:20:46.784963] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.784970] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.312 [2024-11-27 03:20:46.784977] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x1d1f420) 00:25:44.312 [2024-11-27 03:20:46.784987] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.312 [2024-11-27 03:20:46.784997] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785004] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785010] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x1d1f420) 00:25:44.313 [2024-11-27 03:20:46.785019] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.313 [2024-11-27 03:20:46.785029] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785049] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785056] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x1d1f420) 00:25:44.313 [2024-11-27 03:20:46.785065] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.313 [2024-11-27 03:20:46.785075] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785081] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785088] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1f420) 00:25:44.313 [2024-11-27 03:20:46.785096] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.313 [2024-11-27 03:20:46.785104] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:44.313 [2024-11-27 03:20:46.785124] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:44.313 [2024-11-27 03:20:46.785136] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785143] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785164] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1f420) 00:25:44.313 [2024-11-27 03:20:46.785177] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.313 [2024-11-27 03:20:46.785201] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84b00, cid 0, qid 0 00:25:44.313 [2024-11-27 03:20:46.785211] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84c60, cid 1, qid 0 00:25:44.313 [2024-11-27 03:20:46.785233] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84dc0, cid 2, qid 0 00:25:44.313 [2024-11-27 03:20:46.785241] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84f20, cid 3, qid 0 00:25:44.313 [2024-11-27 03:20:46.785248] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d85080, cid 4, qid 0 00:25:44.313 [2024-11-27 03:20:46.785406] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.313 [2024-11-27 03:20:46.785421] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.313 [2024-11-27 03:20:46.785428] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785434] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d85080) on tqpair=0x1d1f420 00:25:44.313 [2024-11-27 03:20:46.785444] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:44.313 [2024-11-27 03:20:46.785453] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:44.313 [2024-11-27 03:20:46.785470] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785480] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785486] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1f420) 00:25:44.313 [2024-11-27 03:20:46.785497] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.313 [2024-11-27 03:20:46.785518] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d85080, cid 4, qid 0 00:25:44.313 [2024-11-27 03:20:46.785734] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.313 [2024-11-27 03:20:46.785750] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.313 [2024-11-27 03:20:46.785757] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785763] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1f420): datao=0, datal=4096, cccid=4 00:25:44.313 [2024-11-27 03:20:46.785771] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d85080) on tqpair(0x1d1f420): expected_datao=0, payload_size=4096 00:25:44.313 [2024-11-27 03:20:46.785782] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785789] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785801] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.313 [2024-11-27 03:20:46.785810] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.313 [2024-11-27 03:20:46.785817] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785823] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d85080) on tqpair=0x1d1f420 00:25:44.313 [2024-11-27 03:20:46.785843] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:44.313 [2024-11-27 03:20:46.785879] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785890] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785896] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1f420) 00:25:44.313 [2024-11-27 03:20:46.785907] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.313 [2024-11-27 03:20:46.785918] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785925] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.785936] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x1d1f420) 00:25:44.313 [2024-11-27 03:20:46.785945] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.313 [2024-11-27 03:20:46.785971] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d85080, cid 4, qid 0 00:25:44.313 [2024-11-27 03:20:46.785983] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d851e0, cid 5, qid 0 00:25:44.313 [2024-11-27 03:20:46.786165] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.313 [2024-11-27 03:20:46.786180] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.313 [2024-11-27 03:20:46.786187] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.786193] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1f420): datao=0, datal=1024, cccid=4 00:25:44.313 [2024-11-27 03:20:46.786201] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d85080) on tqpair(0x1d1f420): expected_datao=0, payload_size=1024 00:25:44.313 [2024-11-27 03:20:46.786212] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.786219] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.786228] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.313 [2024-11-27 03:20:46.786237] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.313 [2024-11-27 03:20:46.786243] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.786265] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d851e0) on tqpair=0x1d1f420 00:25:44.313 [2024-11-27 03:20:46.826692] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.313 [2024-11-27 03:20:46.826711] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.313 [2024-11-27 03:20:46.826719] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.826726] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d85080) on tqpair=0x1d1f420 00:25:44.313 [2024-11-27 03:20:46.826745] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.826754] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.313 [2024-11-27 03:20:46.826761] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1f420) 00:25:44.313 [2024-11-27 03:20:46.826772] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.313 [2024-11-27 03:20:46.826802] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d85080, cid 4, qid 0 00:25:44.313 [2024-11-27 03:20:46.826910] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.313 [2024-11-27 03:20:46.826926] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.313 [2024-11-27 03:20:46.826933] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.826939] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1f420): datao=0, datal=3072, cccid=4 00:25:44.314 [2024-11-27 03:20:46.826947] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d85080) on tqpair(0x1d1f420): expected_datao=0, payload_size=3072 00:25:44.314 [2024-11-27 03:20:46.826958] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.826965] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.826977] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.314 [2024-11-27 03:20:46.826987] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.314 [2024-11-27 03:20:46.826994] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.827001] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d85080) on tqpair=0x1d1f420 00:25:44.314 [2024-11-27 03:20:46.827016] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.827029] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.827037] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x1d1f420) 00:25:44.314 [2024-11-27 03:20:46.827047] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.314 [2024-11-27 03:20:46.827076] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d85080, cid 4, qid 0 00:25:44.314 [2024-11-27 03:20:46.827180] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.314 [2024-11-27 03:20:46.827195] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.314 [2024-11-27 03:20:46.827202] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.827208] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x1d1f420): datao=0, datal=8, cccid=4 00:25:44.314 [2024-11-27 03:20:46.827216] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1d85080) on tqpair(0x1d1f420): expected_datao=0, payload_size=8 00:25:44.314 [2024-11-27 03:20:46.827226] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.827233] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.867689] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.314 [2024-11-27 03:20:46.867708] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.314 [2024-11-27 03:20:46.867716] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.314 [2024-11-27 03:20:46.867723] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d85080) on tqpair=0x1d1f420 00:25:44.314 ===================================================== 00:25:44.314 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:44.314 ===================================================== 00:25:44.314 Controller Capabilities/Features 00:25:44.314 ================================ 00:25:44.314 Vendor ID: 0000 00:25:44.314 Subsystem Vendor ID: 0000 00:25:44.314 Serial Number: .................... 00:25:44.314 Model Number: ........................................ 00:25:44.314 Firmware Version: 24.01.1 00:25:44.314 Recommended Arb Burst: 0 00:25:44.314 IEEE OUI Identifier: 00 00 00 00:25:44.314 Multi-path I/O 00:25:44.314 May have multiple subsystem ports: No 00:25:44.314 May have multiple controllers: No 00:25:44.314 Associated with SR-IOV VF: No 00:25:44.314 Max Data Transfer Size: 131072 00:25:44.314 Max Number of Namespaces: 0 00:25:44.314 Max Number of I/O Queues: 1024 00:25:44.314 NVMe Specification Version (VS): 1.3 00:25:44.314 NVMe Specification Version (Identify): 1.3 00:25:44.314 Maximum Queue Entries: 128 00:25:44.314 Contiguous Queues Required: Yes 00:25:44.314 Arbitration Mechanisms Supported 00:25:44.314 Weighted Round Robin: Not Supported 00:25:44.314 Vendor Specific: Not Supported 00:25:44.314 Reset Timeout: 15000 ms 00:25:44.314 Doorbell Stride: 4 bytes 00:25:44.314 NVM Subsystem Reset: Not Supported 00:25:44.314 Command Sets Supported 00:25:44.314 NVM Command Set: Supported 00:25:44.314 Boot Partition: Not Supported 00:25:44.314 Memory Page Size Minimum: 4096 bytes 00:25:44.314 Memory Page Size Maximum: 4096 bytes 00:25:44.314 Persistent Memory Region: Not Supported 00:25:44.314 Optional Asynchronous Events Supported 00:25:44.314 Namespace Attribute Notices: Not Supported 00:25:44.314 Firmware Activation Notices: Not Supported 00:25:44.314 ANA Change Notices: Not Supported 00:25:44.314 PLE Aggregate Log Change Notices: Not Supported 00:25:44.314 LBA Status Info Alert Notices: Not Supported 00:25:44.314 EGE Aggregate Log Change Notices: Not Supported 00:25:44.314 Normal NVM Subsystem Shutdown event: Not Supported 00:25:44.314 Zone Descriptor Change Notices: Not Supported 00:25:44.314 Discovery Log Change Notices: Supported 00:25:44.314 Controller Attributes 00:25:44.314 128-bit Host Identifier: Not Supported 00:25:44.314 Non-Operational Permissive Mode: Not Supported 00:25:44.314 NVM Sets: Not Supported 00:25:44.314 Read Recovery Levels: Not Supported 00:25:44.314 Endurance Groups: Not Supported 00:25:44.314 Predictable Latency Mode: Not Supported 00:25:44.314 Traffic Based Keep ALive: Not Supported 00:25:44.314 Namespace Granularity: Not Supported 00:25:44.314 SQ Associations: Not Supported 00:25:44.314 UUID List: Not Supported 00:25:44.314 Multi-Domain Subsystem: Not Supported 00:25:44.314 Fixed Capacity Management: Not Supported 00:25:44.314 Variable Capacity Management: Not Supported 00:25:44.314 Delete Endurance Group: Not Supported 00:25:44.314 Delete NVM Set: Not Supported 00:25:44.314 Extended LBA Formats Supported: Not Supported 00:25:44.314 Flexible Data Placement Supported: Not Supported 00:25:44.314 00:25:44.314 Controller Memory Buffer Support 00:25:44.314 ================================ 00:25:44.314 Supported: No 00:25:44.314 00:25:44.314 Persistent Memory Region Support 00:25:44.314 ================================ 00:25:44.314 Supported: No 00:25:44.314 00:25:44.314 Admin Command Set Attributes 00:25:44.314 ============================ 00:25:44.314 Security Send/Receive: Not Supported 00:25:44.314 Format NVM: Not Supported 00:25:44.314 Firmware Activate/Download: Not Supported 00:25:44.314 Namespace Management: Not Supported 00:25:44.314 Device Self-Test: Not Supported 00:25:44.314 Directives: Not Supported 00:25:44.314 NVMe-MI: Not Supported 00:25:44.314 Virtualization Management: Not Supported 00:25:44.314 Doorbell Buffer Config: Not Supported 00:25:44.314 Get LBA Status Capability: Not Supported 00:25:44.314 Command & Feature Lockdown Capability: Not Supported 00:25:44.314 Abort Command Limit: 1 00:25:44.314 Async Event Request Limit: 4 00:25:44.314 Number of Firmware Slots: N/A 00:25:44.314 Firmware Slot 1 Read-Only: N/A 00:25:44.314 Firmware Activation Without Reset: N/A 00:25:44.314 Multiple Update Detection Support: N/A 00:25:44.314 Firmware Update Granularity: No Information Provided 00:25:44.314 Per-Namespace SMART Log: No 00:25:44.314 Asymmetric Namespace Access Log Page: Not Supported 00:25:44.314 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:44.314 Command Effects Log Page: Not Supported 00:25:44.314 Get Log Page Extended Data: Supported 00:25:44.314 Telemetry Log Pages: Not Supported 00:25:44.314 Persistent Event Log Pages: Not Supported 00:25:44.314 Supported Log Pages Log Page: May Support 00:25:44.314 Commands Supported & Effects Log Page: Not Supported 00:25:44.314 Feature Identifiers & Effects Log Page:May Support 00:25:44.315 NVMe-MI Commands & Effects Log Page: May Support 00:25:44.315 Data Area 4 for Telemetry Log: Not Supported 00:25:44.315 Error Log Page Entries Supported: 128 00:25:44.315 Keep Alive: Not Supported 00:25:44.315 00:25:44.315 NVM Command Set Attributes 00:25:44.315 ========================== 00:25:44.315 Submission Queue Entry Size 00:25:44.315 Max: 1 00:25:44.315 Min: 1 00:25:44.315 Completion Queue Entry Size 00:25:44.315 Max: 1 00:25:44.315 Min: 1 00:25:44.315 Number of Namespaces: 0 00:25:44.315 Compare Command: Not Supported 00:25:44.315 Write Uncorrectable Command: Not Supported 00:25:44.315 Dataset Management Command: Not Supported 00:25:44.315 Write Zeroes Command: Not Supported 00:25:44.315 Set Features Save Field: Not Supported 00:25:44.315 Reservations: Not Supported 00:25:44.315 Timestamp: Not Supported 00:25:44.315 Copy: Not Supported 00:25:44.315 Volatile Write Cache: Not Present 00:25:44.315 Atomic Write Unit (Normal): 1 00:25:44.315 Atomic Write Unit (PFail): 1 00:25:44.315 Atomic Compare & Write Unit: 1 00:25:44.315 Fused Compare & Write: Supported 00:25:44.315 Scatter-Gather List 00:25:44.315 SGL Command Set: Supported 00:25:44.315 SGL Keyed: Supported 00:25:44.315 SGL Bit Bucket Descriptor: Not Supported 00:25:44.315 SGL Metadata Pointer: Not Supported 00:25:44.315 Oversized SGL: Not Supported 00:25:44.315 SGL Metadata Address: Not Supported 00:25:44.315 SGL Offset: Supported 00:25:44.315 Transport SGL Data Block: Not Supported 00:25:44.315 Replay Protected Memory Block: Not Supported 00:25:44.315 00:25:44.315 Firmware Slot Information 00:25:44.315 ========================= 00:25:44.315 Active slot: 0 00:25:44.315 00:25:44.315 00:25:44.315 Error Log 00:25:44.315 ========= 00:25:44.315 00:25:44.315 Active Namespaces 00:25:44.315 ================= 00:25:44.315 Discovery Log Page 00:25:44.315 ================== 00:25:44.315 Generation Counter: 2 00:25:44.315 Number of Records: 2 00:25:44.315 Record Format: 0 00:25:44.315 00:25:44.315 Discovery Log Entry 0 00:25:44.315 ---------------------- 00:25:44.315 Transport Type: 3 (TCP) 00:25:44.315 Address Family: 1 (IPv4) 00:25:44.315 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:44.315 Entry Flags: 00:25:44.315 Duplicate Returned Information: 1 00:25:44.315 Explicit Persistent Connection Support for Discovery: 1 00:25:44.315 Transport Requirements: 00:25:44.315 Secure Channel: Not Required 00:25:44.315 Port ID: 0 (0x0000) 00:25:44.315 Controller ID: 65535 (0xffff) 00:25:44.315 Admin Max SQ Size: 128 00:25:44.315 Transport Service Identifier: 4420 00:25:44.315 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:44.315 Transport Address: 10.0.0.2 00:25:44.315 Discovery Log Entry 1 00:25:44.315 ---------------------- 00:25:44.315 Transport Type: 3 (TCP) 00:25:44.315 Address Family: 1 (IPv4) 00:25:44.315 Subsystem Type: 2 (NVM Subsystem) 00:25:44.315 Entry Flags: 00:25:44.315 Duplicate Returned Information: 0 00:25:44.315 Explicit Persistent Connection Support for Discovery: 0 00:25:44.315 Transport Requirements: 00:25:44.315 Secure Channel: Not Required 00:25:44.315 Port ID: 0 (0x0000) 00:25:44.315 Controller ID: 65535 (0xffff) 00:25:44.315 Admin Max SQ Size: 128 00:25:44.315 Transport Service Identifier: 4420 00:25:44.315 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:44.315 Transport Address: 10.0.0.2 [2024-11-27 03:20:46.867848] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:44.315 [2024-11-27 03:20:46.867873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.315 [2024-11-27 03:20:46.867885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.315 [2024-11-27 03:20:46.867895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.315 [2024-11-27 03:20:46.867905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.315 [2024-11-27 03:20:46.867918] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.315 [2024-11-27 03:20:46.867926] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.315 [2024-11-27 03:20:46.867933] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1f420) 00:25:44.315 [2024-11-27 03:20:46.867944] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.315 [2024-11-27 03:20:46.867983] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84f20, cid 3, qid 0 00:25:44.315 [2024-11-27 03:20:46.868168] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.315 [2024-11-27 03:20:46.868184] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.315 [2024-11-27 03:20:46.868191] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.315 [2024-11-27 03:20:46.868197] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84f20) on tqpair=0x1d1f420 00:25:44.315 [2024-11-27 03:20:46.868210] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.315 [2024-11-27 03:20:46.868218] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.315 [2024-11-27 03:20:46.868225] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1f420) 00:25:44.315 [2024-11-27 03:20:46.868236] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.315 [2024-11-27 03:20:46.868262] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84f20, cid 3, qid 0 00:25:44.315 [2024-11-27 03:20:46.868423] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.315 [2024-11-27 03:20:46.868440] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.315 [2024-11-27 03:20:46.868447] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.315 [2024-11-27 03:20:46.868454] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84f20) on tqpair=0x1d1f420 00:25:44.315 [2024-11-27 03:20:46.868464] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:44.315 [2024-11-27 03:20:46.868472] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:44.315 [2024-11-27 03:20:46.868488] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.315 [2024-11-27 03:20:46.868498] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.315 [2024-11-27 03:20:46.868504] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x1d1f420) 00:25:44.316 [2024-11-27 03:20:46.868515] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.316 [2024-11-27 03:20:46.872559] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1d84f20, cid 3, qid 0 00:25:44.316 [2024-11-27 03:20:46.872748] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.316 [2024-11-27 03:20:46.872763] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.316 [2024-11-27 03:20:46.872770] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.316 [2024-11-27 03:20:46.872777] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1d84f20) on tqpair=0x1d1f420 00:25:44.316 [2024-11-27 03:20:46.872792] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 4 milliseconds 00:25:44.316 00:25:44.316 03:20:46 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:44.316 [2024-11-27 03:20:46.906135] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:44.316 [2024-11-27 03:20:46.906178] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2541421 ] 00:25:44.316 EAL: No free 2048 kB hugepages reported on node 1 00:25:44.577 [2024-11-27 03:20:46.938355] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:44.577 [2024-11-27 03:20:46.938403] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:44.577 [2024-11-27 03:20:46.938414] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:44.577 [2024-11-27 03:20:46.938432] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:44.577 [2024-11-27 03:20:46.938444] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:44.577 [2024-11-27 03:20:46.941564] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:44.577 [2024-11-27 03:20:46.941606] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x21ba420 0 00:25:44.577 [2024-11-27 03:20:46.949541] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:44.577 [2024-11-27 03:20:46.949560] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:44.577 [2024-11-27 03:20:46.949567] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:44.577 [2024-11-27 03:20:46.949573] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:44.577 [2024-11-27 03:20:46.949610] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.949625] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.949632] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.577 [2024-11-27 03:20:46.949646] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:44.577 [2024-11-27 03:20:46.949670] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.577 [2024-11-27 03:20:46.957541] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.577 [2024-11-27 03:20:46.957559] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.577 [2024-11-27 03:20:46.957566] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.957573] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221fb00) on tqpair=0x21ba420 00:25:44.577 [2024-11-27 03:20:46.957591] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:44.577 [2024-11-27 03:20:46.957602] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:44.577 [2024-11-27 03:20:46.957611] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:44.577 [2024-11-27 03:20:46.957627] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.957636] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.957642] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.577 [2024-11-27 03:20:46.957653] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.577 [2024-11-27 03:20:46.957676] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.577 [2024-11-27 03:20:46.957802] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.577 [2024-11-27 03:20:46.957817] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.577 [2024-11-27 03:20:46.957824] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.957831] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221fb00) on tqpair=0x21ba420 00:25:44.577 [2024-11-27 03:20:46.957840] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:44.577 [2024-11-27 03:20:46.957854] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:44.577 [2024-11-27 03:20:46.957866] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.957874] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.957880] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.577 [2024-11-27 03:20:46.957891] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.577 [2024-11-27 03:20:46.957912] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.577 [2024-11-27 03:20:46.957999] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.577 [2024-11-27 03:20:46.958011] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.577 [2024-11-27 03:20:46.958018] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958025] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221fb00) on tqpair=0x21ba420 00:25:44.577 [2024-11-27 03:20:46.958034] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:44.577 [2024-11-27 03:20:46.958047] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:44.577 [2024-11-27 03:20:46.958060] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958067] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958078] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.577 [2024-11-27 03:20:46.958089] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.577 [2024-11-27 03:20:46.958110] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.577 [2024-11-27 03:20:46.958196] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.577 [2024-11-27 03:20:46.958210] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.577 [2024-11-27 03:20:46.958216] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958223] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221fb00) on tqpair=0x21ba420 00:25:44.577 [2024-11-27 03:20:46.958233] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:44.577 [2024-11-27 03:20:46.958250] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958259] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958265] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.577 [2024-11-27 03:20:46.958276] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.577 [2024-11-27 03:20:46.958297] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.577 [2024-11-27 03:20:46.958385] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.577 [2024-11-27 03:20:46.958399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.577 [2024-11-27 03:20:46.958405] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958412] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221fb00) on tqpair=0x21ba420 00:25:44.577 [2024-11-27 03:20:46.958420] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:44.577 [2024-11-27 03:20:46.958429] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:44.577 [2024-11-27 03:20:46.958442] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:44.577 [2024-11-27 03:20:46.958552] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:44.577 [2024-11-27 03:20:46.958561] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:44.577 [2024-11-27 03:20:46.958574] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958581] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958588] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.577 [2024-11-27 03:20:46.958598] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.577 [2024-11-27 03:20:46.958620] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.577 [2024-11-27 03:20:46.958740] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.577 [2024-11-27 03:20:46.958754] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.577 [2024-11-27 03:20:46.958761] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958767] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221fb00) on tqpair=0x21ba420 00:25:44.577 [2024-11-27 03:20:46.958777] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:44.577 [2024-11-27 03:20:46.958793] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958806] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.577 [2024-11-27 03:20:46.958824] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.577 [2024-11-27 03:20:46.958845] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.577 [2024-11-27 03:20:46.958932] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.577 [2024-11-27 03:20:46.958944] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.577 [2024-11-27 03:20:46.958951] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.958957] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221fb00) on tqpair=0x21ba420 00:25:44.577 [2024-11-27 03:20:46.958966] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:44.577 [2024-11-27 03:20:46.958974] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:44.577 [2024-11-27 03:20:46.958987] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:44.577 [2024-11-27 03:20:46.959001] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:44.577 [2024-11-27 03:20:46.959014] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.577 [2024-11-27 03:20:46.959022] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959028] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:46.959039] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.578 [2024-11-27 03:20:46.959060] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.578 [2024-11-27 03:20:46.959194] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.578 [2024-11-27 03:20:46.959208] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.578 [2024-11-27 03:20:46.959215] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959221] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21ba420): datao=0, datal=4096, cccid=0 00:25:44.578 [2024-11-27 03:20:46.959229] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x221fb00) on tqpair(0x21ba420): expected_datao=0, payload_size=4096 00:25:44.578 [2024-11-27 03:20:46.959252] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959261] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959306] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.578 [2024-11-27 03:20:46.959317] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.578 [2024-11-27 03:20:46.959323] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959330] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221fb00) on tqpair=0x21ba420 00:25:44.578 [2024-11-27 03:20:46.959342] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:44.578 [2024-11-27 03:20:46.959350] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:44.578 [2024-11-27 03:20:46.959358] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:44.578 [2024-11-27 03:20:46.959365] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:44.578 [2024-11-27 03:20:46.959372] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:44.578 [2024-11-27 03:20:46.959384] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:46.959402] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:46.959415] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959422] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959428] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:46.959439] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:44.578 [2024-11-27 03:20:46.959460] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.578 [2024-11-27 03:20:46.959558] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.578 [2024-11-27 03:20:46.959572] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.578 [2024-11-27 03:20:46.959579] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959586] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221fb00) on tqpair=0x21ba420 00:25:44.578 [2024-11-27 03:20:46.959597] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959604] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959610] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:46.959620] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.578 [2024-11-27 03:20:46.959630] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959636] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959643] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:46.959651] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.578 [2024-11-27 03:20:46.959661] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959667] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959673] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:46.959682] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.578 [2024-11-27 03:20:46.959691] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959698] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959704] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:46.959712] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.578 [2024-11-27 03:20:46.959721] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:46.959739] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:46.959751] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959758] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.959764] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:46.959774] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.578 [2024-11-27 03:20:46.959797] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fb00, cid 0, qid 0 00:25:44.578 [2024-11-27 03:20:46.959811] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fc60, cid 1, qid 0 00:25:44.578 [2024-11-27 03:20:46.959819] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221fdc0, cid 2, qid 0 00:25:44.578 [2024-11-27 03:20:46.959827] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221ff20, cid 3, qid 0 00:25:44.578 [2024-11-27 03:20:46.959835] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2220080, cid 4, qid 0 00:25:44.578 [2024-11-27 03:20:46.959978] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.578 [2024-11-27 03:20:46.959990] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.578 [2024-11-27 03:20:46.959997] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.960003] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2220080) on tqpair=0x21ba420 00:25:44.578 [2024-11-27 03:20:46.960012] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:44.578 [2024-11-27 03:20:46.960021] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:46.960034] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:46.960049] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:46.960060] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.960067] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.960074] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:46.960084] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:44.578 [2024-11-27 03:20:46.960104] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2220080, cid 4, qid 0 00:25:44.578 [2024-11-27 03:20:46.960295] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.578 [2024-11-27 03:20:46.960307] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.578 [2024-11-27 03:20:46.960314] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.960321] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2220080) on tqpair=0x21ba420 00:25:44.578 [2024-11-27 03:20:46.960386] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:46.960403] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:46.960417] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.960425] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.960431] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:46.960441] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.578 [2024-11-27 03:20:46.960462] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2220080, cid 4, qid 0 00:25:44.578 [2024-11-27 03:20:46.960583] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.578 [2024-11-27 03:20:46.960599] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.578 [2024-11-27 03:20:46.960605] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.960612] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21ba420): datao=0, datal=4096, cccid=4 00:25:44.578 [2024-11-27 03:20:46.960619] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2220080) on tqpair(0x21ba420): expected_datao=0, payload_size=4096 00:25:44.578 [2024-11-27 03:20:46.960641] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:46.960650] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:47.003535] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.578 [2024-11-27 03:20:47.003554] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.578 [2024-11-27 03:20:47.003561] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:47.003568] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2220080) on tqpair=0x21ba420 00:25:44.578 [2024-11-27 03:20:47.003589] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:44.578 [2024-11-27 03:20:47.003605] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:47.003622] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:44.578 [2024-11-27 03:20:47.003635] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:47.003643] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.578 [2024-11-27 03:20:47.003650] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21ba420) 00:25:44.578 [2024-11-27 03:20:47.003660] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.003683] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2220080, cid 4, qid 0 00:25:44.579 [2024-11-27 03:20:47.003831] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.579 [2024-11-27 03:20:47.003846] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.579 [2024-11-27 03:20:47.003853] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.003859] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21ba420): datao=0, datal=4096, cccid=4 00:25:44.579 [2024-11-27 03:20:47.003867] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2220080) on tqpair(0x21ba420): expected_datao=0, payload_size=4096 00:25:44.579 [2024-11-27 03:20:47.003885] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.003893] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.048536] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.579 [2024-11-27 03:20:47.048555] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.579 [2024-11-27 03:20:47.048564] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.048571] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2220080) on tqpair=0x21ba420 00:25:44.579 [2024-11-27 03:20:47.048596] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:44.579 [2024-11-27 03:20:47.048616] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:44.579 [2024-11-27 03:20:47.048630] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.048638] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.048644] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.048655] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.048680] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2220080, cid 4, qid 0 00:25:44.579 [2024-11-27 03:20:47.048824] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.579 [2024-11-27 03:20:47.048840] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.579 [2024-11-27 03:20:47.048852] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.048859] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21ba420): datao=0, datal=4096, cccid=4 00:25:44.579 [2024-11-27 03:20:47.048867] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2220080) on tqpair(0x21ba420): expected_datao=0, payload_size=4096 00:25:44.579 [2024-11-27 03:20:47.048878] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.048886] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.089661] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.579 [2024-11-27 03:20:47.089681] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.579 [2024-11-27 03:20:47.089689] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.089695] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2220080) on tqpair=0x21ba420 00:25:44.579 [2024-11-27 03:20:47.089710] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:44.579 [2024-11-27 03:20:47.089725] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:44.579 [2024-11-27 03:20:47.089742] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:44.579 [2024-11-27 03:20:47.089753] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:44.579 [2024-11-27 03:20:47.089761] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:44.579 [2024-11-27 03:20:47.089770] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:44.579 [2024-11-27 03:20:47.089777] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:44.579 [2024-11-27 03:20:47.089786] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:44.579 [2024-11-27 03:20:47.089805] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.089814] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.089820] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.089832] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.089843] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.089850] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.089856] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.089865] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:44.579 [2024-11-27 03:20:47.089892] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2220080, cid 4, qid 0 00:25:44.579 [2024-11-27 03:20:47.089904] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22201e0, cid 5, qid 0 00:25:44.579 [2024-11-27 03:20:47.090004] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.579 [2024-11-27 03:20:47.090018] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.579 [2024-11-27 03:20:47.090025] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090032] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2220080) on tqpair=0x21ba420 00:25:44.579 [2024-11-27 03:20:47.090044] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.579 [2024-11-27 03:20:47.090054] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.579 [2024-11-27 03:20:47.090064] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090071] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22201e0) on tqpair=0x21ba420 00:25:44.579 [2024-11-27 03:20:47.090088] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090097] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090104] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.090114] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.090135] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22201e0, cid 5, qid 0 00:25:44.579 [2024-11-27 03:20:47.090227] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.579 [2024-11-27 03:20:47.090241] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.579 [2024-11-27 03:20:47.090247] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090254] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22201e0) on tqpair=0x21ba420 00:25:44.579 [2024-11-27 03:20:47.090270] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090279] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090286] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.090296] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.090317] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22201e0, cid 5, qid 0 00:25:44.579 [2024-11-27 03:20:47.090415] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.579 [2024-11-27 03:20:47.090428] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.579 [2024-11-27 03:20:47.090434] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090441] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22201e0) on tqpair=0x21ba420 00:25:44.579 [2024-11-27 03:20:47.090457] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090466] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090472] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.090482] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.090502] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22201e0, cid 5, qid 0 00:25:44.579 [2024-11-27 03:20:47.090601] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.579 [2024-11-27 03:20:47.090615] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.579 [2024-11-27 03:20:47.090621] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090628] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22201e0) on tqpair=0x21ba420 00:25:44.579 [2024-11-27 03:20:47.090648] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090658] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090665] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.090675] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.090687] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090694] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090700] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.090713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.090725] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090732] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090739] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.090748] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.090759] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090766] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.579 [2024-11-27 03:20:47.090773] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x21ba420) 00:25:44.579 [2024-11-27 03:20:47.090782] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.579 [2024-11-27 03:20:47.090804] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22201e0, cid 5, qid 0 00:25:44.579 [2024-11-27 03:20:47.090816] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2220080, cid 4, qid 0 00:25:44.580 [2024-11-27 03:20:47.090824] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x2220340, cid 6, qid 0 00:25:44.580 [2024-11-27 03:20:47.090831] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22204a0, cid 7, qid 0 00:25:44.580 [2024-11-27 03:20:47.091035] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.580 [2024-11-27 03:20:47.091049] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.580 [2024-11-27 03:20:47.091056] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091062] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21ba420): datao=0, datal=8192, cccid=5 00:25:44.580 [2024-11-27 03:20:47.091070] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22201e0) on tqpair(0x21ba420): expected_datao=0, payload_size=8192 00:25:44.580 [2024-11-27 03:20:47.091089] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091099] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091111] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.580 [2024-11-27 03:20:47.091120] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.580 [2024-11-27 03:20:47.091127] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091133] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21ba420): datao=0, datal=512, cccid=4 00:25:44.580 [2024-11-27 03:20:47.091140] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2220080) on tqpair(0x21ba420): expected_datao=0, payload_size=512 00:25:44.580 [2024-11-27 03:20:47.091150] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091157] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091165] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.580 [2024-11-27 03:20:47.091173] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.580 [2024-11-27 03:20:47.091180] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091186] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21ba420): datao=0, datal=512, cccid=6 00:25:44.580 [2024-11-27 03:20:47.091193] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x2220340) on tqpair(0x21ba420): expected_datao=0, payload_size=512 00:25:44.580 [2024-11-27 03:20:47.091203] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091209] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091221] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:44.580 [2024-11-27 03:20:47.091231] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:44.580 [2024-11-27 03:20:47.091238] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091244] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x21ba420): datao=0, datal=4096, cccid=7 00:25:44.580 [2024-11-27 03:20:47.091251] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x22204a0) on tqpair(0x21ba420): expected_datao=0, payload_size=4096 00:25:44.580 [2024-11-27 03:20:47.091261] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091267] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091282] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.580 [2024-11-27 03:20:47.091291] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.580 [2024-11-27 03:20:47.091297] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091304] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22201e0) on tqpair=0x21ba420 00:25:44.580 [2024-11-27 03:20:47.091324] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.580 [2024-11-27 03:20:47.091335] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.580 [2024-11-27 03:20:47.091342] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091348] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2220080) on tqpair=0x21ba420 00:25:44.580 [2024-11-27 03:20:47.091377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.580 [2024-11-27 03:20:47.091388] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.580 [2024-11-27 03:20:47.091394] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091400] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x2220340) on tqpair=0x21ba420 00:25:44.580 [2024-11-27 03:20:47.091411] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.580 [2024-11-27 03:20:47.091435] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.580 [2024-11-27 03:20:47.091441] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.580 [2024-11-27 03:20:47.091447] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22204a0) on tqpair=0x21ba420 00:25:44.580 ===================================================== 00:25:44.580 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:44.580 ===================================================== 00:25:44.580 Controller Capabilities/Features 00:25:44.580 ================================ 00:25:44.580 Vendor ID: 8086 00:25:44.580 Subsystem Vendor ID: 8086 00:25:44.580 Serial Number: SPDK00000000000001 00:25:44.580 Model Number: SPDK bdev Controller 00:25:44.580 Firmware Version: 24.01.1 00:25:44.580 Recommended Arb Burst: 6 00:25:44.580 IEEE OUI Identifier: e4 d2 5c 00:25:44.580 Multi-path I/O 00:25:44.580 May have multiple subsystem ports: Yes 00:25:44.580 May have multiple controllers: Yes 00:25:44.580 Associated with SR-IOV VF: No 00:25:44.580 Max Data Transfer Size: 131072 00:25:44.580 Max Number of Namespaces: 32 00:25:44.580 Max Number of I/O Queues: 127 00:25:44.580 NVMe Specification Version (VS): 1.3 00:25:44.580 NVMe Specification Version (Identify): 1.3 00:25:44.580 Maximum Queue Entries: 128 00:25:44.580 Contiguous Queues Required: Yes 00:25:44.580 Arbitration Mechanisms Supported 00:25:44.580 Weighted Round Robin: Not Supported 00:25:44.580 Vendor Specific: Not Supported 00:25:44.580 Reset Timeout: 15000 ms 00:25:44.580 Doorbell Stride: 4 bytes 00:25:44.580 NVM Subsystem Reset: Not Supported 00:25:44.580 Command Sets Supported 00:25:44.580 NVM Command Set: Supported 00:25:44.580 Boot Partition: Not Supported 00:25:44.580 Memory Page Size Minimum: 4096 bytes 00:25:44.580 Memory Page Size Maximum: 4096 bytes 00:25:44.580 Persistent Memory Region: Not Supported 00:25:44.580 Optional Asynchronous Events Supported 00:25:44.580 Namespace Attribute Notices: Supported 00:25:44.580 Firmware Activation Notices: Not Supported 00:25:44.580 ANA Change Notices: Not Supported 00:25:44.580 PLE Aggregate Log Change Notices: Not Supported 00:25:44.580 LBA Status Info Alert Notices: Not Supported 00:25:44.580 EGE Aggregate Log Change Notices: Not Supported 00:25:44.580 Normal NVM Subsystem Shutdown event: Not Supported 00:25:44.580 Zone Descriptor Change Notices: Not Supported 00:25:44.580 Discovery Log Change Notices: Not Supported 00:25:44.580 Controller Attributes 00:25:44.580 128-bit Host Identifier: Supported 00:25:44.580 Non-Operational Permissive Mode: Not Supported 00:25:44.580 NVM Sets: Not Supported 00:25:44.580 Read Recovery Levels: Not Supported 00:25:44.580 Endurance Groups: Not Supported 00:25:44.580 Predictable Latency Mode: Not Supported 00:25:44.580 Traffic Based Keep ALive: Not Supported 00:25:44.580 Namespace Granularity: Not Supported 00:25:44.580 SQ Associations: Not Supported 00:25:44.580 UUID List: Not Supported 00:25:44.580 Multi-Domain Subsystem: Not Supported 00:25:44.580 Fixed Capacity Management: Not Supported 00:25:44.580 Variable Capacity Management: Not Supported 00:25:44.580 Delete Endurance Group: Not Supported 00:25:44.580 Delete NVM Set: Not Supported 00:25:44.580 Extended LBA Formats Supported: Not Supported 00:25:44.580 Flexible Data Placement Supported: Not Supported 00:25:44.580 00:25:44.580 Controller Memory Buffer Support 00:25:44.580 ================================ 00:25:44.580 Supported: No 00:25:44.580 00:25:44.580 Persistent Memory Region Support 00:25:44.580 ================================ 00:25:44.580 Supported: No 00:25:44.580 00:25:44.580 Admin Command Set Attributes 00:25:44.580 ============================ 00:25:44.580 Security Send/Receive: Not Supported 00:25:44.580 Format NVM: Not Supported 00:25:44.580 Firmware Activate/Download: Not Supported 00:25:44.580 Namespace Management: Not Supported 00:25:44.580 Device Self-Test: Not Supported 00:25:44.580 Directives: Not Supported 00:25:44.580 NVMe-MI: Not Supported 00:25:44.580 Virtualization Management: Not Supported 00:25:44.580 Doorbell Buffer Config: Not Supported 00:25:44.580 Get LBA Status Capability: Not Supported 00:25:44.580 Command & Feature Lockdown Capability: Not Supported 00:25:44.580 Abort Command Limit: 4 00:25:44.580 Async Event Request Limit: 4 00:25:44.580 Number of Firmware Slots: N/A 00:25:44.580 Firmware Slot 1 Read-Only: N/A 00:25:44.580 Firmware Activation Without Reset: N/A 00:25:44.580 Multiple Update Detection Support: N/A 00:25:44.580 Firmware Update Granularity: No Information Provided 00:25:44.580 Per-Namespace SMART Log: No 00:25:44.580 Asymmetric Namespace Access Log Page: Not Supported 00:25:44.580 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:44.580 Command Effects Log Page: Supported 00:25:44.580 Get Log Page Extended Data: Supported 00:25:44.580 Telemetry Log Pages: Not Supported 00:25:44.580 Persistent Event Log Pages: Not Supported 00:25:44.580 Supported Log Pages Log Page: May Support 00:25:44.580 Commands Supported & Effects Log Page: Not Supported 00:25:44.580 Feature Identifiers & Effects Log Page:May Support 00:25:44.580 NVMe-MI Commands & Effects Log Page: May Support 00:25:44.580 Data Area 4 for Telemetry Log: Not Supported 00:25:44.580 Error Log Page Entries Supported: 128 00:25:44.580 Keep Alive: Supported 00:25:44.580 Keep Alive Granularity: 10000 ms 00:25:44.580 00:25:44.580 NVM Command Set Attributes 00:25:44.580 ========================== 00:25:44.580 Submission Queue Entry Size 00:25:44.580 Max: 64 00:25:44.581 Min: 64 00:25:44.581 Completion Queue Entry Size 00:25:44.581 Max: 16 00:25:44.581 Min: 16 00:25:44.581 Number of Namespaces: 32 00:25:44.581 Compare Command: Supported 00:25:44.581 Write Uncorrectable Command: Not Supported 00:25:44.581 Dataset Management Command: Supported 00:25:44.581 Write Zeroes Command: Supported 00:25:44.581 Set Features Save Field: Not Supported 00:25:44.581 Reservations: Supported 00:25:44.581 Timestamp: Not Supported 00:25:44.581 Copy: Supported 00:25:44.581 Volatile Write Cache: Present 00:25:44.581 Atomic Write Unit (Normal): 1 00:25:44.581 Atomic Write Unit (PFail): 1 00:25:44.581 Atomic Compare & Write Unit: 1 00:25:44.581 Fused Compare & Write: Supported 00:25:44.581 Scatter-Gather List 00:25:44.581 SGL Command Set: Supported 00:25:44.581 SGL Keyed: Supported 00:25:44.581 SGL Bit Bucket Descriptor: Not Supported 00:25:44.581 SGL Metadata Pointer: Not Supported 00:25:44.581 Oversized SGL: Not Supported 00:25:44.581 SGL Metadata Address: Not Supported 00:25:44.581 SGL Offset: Supported 00:25:44.581 Transport SGL Data Block: Not Supported 00:25:44.581 Replay Protected Memory Block: Not Supported 00:25:44.581 00:25:44.581 Firmware Slot Information 00:25:44.581 ========================= 00:25:44.581 Active slot: 1 00:25:44.581 Slot 1 Firmware Revision: 24.01.1 00:25:44.581 00:25:44.581 00:25:44.581 Commands Supported and Effects 00:25:44.581 ============================== 00:25:44.581 Admin Commands 00:25:44.581 -------------- 00:25:44.581 Get Log Page (02h): Supported 00:25:44.581 Identify (06h): Supported 00:25:44.581 Abort (08h): Supported 00:25:44.581 Set Features (09h): Supported 00:25:44.581 Get Features (0Ah): Supported 00:25:44.581 Asynchronous Event Request (0Ch): Supported 00:25:44.581 Keep Alive (18h): Supported 00:25:44.581 I/O Commands 00:25:44.581 ------------ 00:25:44.581 Flush (00h): Supported LBA-Change 00:25:44.581 Write (01h): Supported LBA-Change 00:25:44.581 Read (02h): Supported 00:25:44.581 Compare (05h): Supported 00:25:44.581 Write Zeroes (08h): Supported LBA-Change 00:25:44.581 Dataset Management (09h): Supported LBA-Change 00:25:44.581 Copy (19h): Supported LBA-Change 00:25:44.581 Unknown (79h): Supported LBA-Change 00:25:44.581 Unknown (7Ah): Supported 00:25:44.581 00:25:44.581 Error Log 00:25:44.581 ========= 00:25:44.581 00:25:44.581 Arbitration 00:25:44.581 =========== 00:25:44.581 Arbitration Burst: 1 00:25:44.581 00:25:44.581 Power Management 00:25:44.581 ================ 00:25:44.581 Number of Power States: 1 00:25:44.581 Current Power State: Power State #0 00:25:44.581 Power State #0: 00:25:44.581 Max Power: 0.00 W 00:25:44.581 Non-Operational State: Operational 00:25:44.581 Entry Latency: Not Reported 00:25:44.581 Exit Latency: Not Reported 00:25:44.581 Relative Read Throughput: 0 00:25:44.581 Relative Read Latency: 0 00:25:44.581 Relative Write Throughput: 0 00:25:44.581 Relative Write Latency: 0 00:25:44.581 Idle Power: Not Reported 00:25:44.581 Active Power: Not Reported 00:25:44.581 Non-Operational Permissive Mode: Not Supported 00:25:44.581 00:25:44.581 Health Information 00:25:44.581 ================== 00:25:44.581 Critical Warnings: 00:25:44.581 Available Spare Space: OK 00:25:44.581 Temperature: OK 00:25:44.581 Device Reliability: OK 00:25:44.581 Read Only: No 00:25:44.581 Volatile Memory Backup: OK 00:25:44.581 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:44.581 Temperature Threshold: [2024-11-27 03:20:47.091592] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.091604] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.091611] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x21ba420) 00:25:44.581 [2024-11-27 03:20:47.091621] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.581 [2024-11-27 03:20:47.091643] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x22204a0, cid 7, qid 0 00:25:44.581 [2024-11-27 03:20:47.091780] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.581 [2024-11-27 03:20:47.091795] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.581 [2024-11-27 03:20:47.091802] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.091808] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x22204a0) on tqpair=0x21ba420 00:25:44.581 [2024-11-27 03:20:47.091852] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:44.581 [2024-11-27 03:20:47.091873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.581 [2024-11-27 03:20:47.091885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.581 [2024-11-27 03:20:47.091895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.581 [2024-11-27 03:20:47.091904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:44.581 [2024-11-27 03:20:47.091921] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.091930] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.091936] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21ba420) 00:25:44.581 [2024-11-27 03:20:47.091947] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.581 [2024-11-27 03:20:47.091983] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221ff20, cid 3, qid 0 00:25:44.581 [2024-11-27 03:20:47.092137] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.581 [2024-11-27 03:20:47.092149] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.581 [2024-11-27 03:20:47.092156] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.092162] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221ff20) on tqpair=0x21ba420 00:25:44.581 [2024-11-27 03:20:47.092175] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.092182] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.092189] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21ba420) 00:25:44.581 [2024-11-27 03:20:47.092199] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.581 [2024-11-27 03:20:47.092224] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221ff20, cid 3, qid 0 00:25:44.581 [2024-11-27 03:20:47.092334] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.581 [2024-11-27 03:20:47.092349] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.581 [2024-11-27 03:20:47.092355] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.092362] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221ff20) on tqpair=0x21ba420 00:25:44.581 [2024-11-27 03:20:47.092370] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:44.581 [2024-11-27 03:20:47.092378] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:44.581 [2024-11-27 03:20:47.092394] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.092403] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.092409] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21ba420) 00:25:44.581 [2024-11-27 03:20:47.092420] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.581 [2024-11-27 03:20:47.092440] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221ff20, cid 3, qid 0 00:25:44.581 [2024-11-27 03:20:47.092521] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.581 [2024-11-27 03:20:47.096545] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.581 [2024-11-27 03:20:47.096553] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.581 [2024-11-27 03:20:47.096560] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221ff20) on tqpair=0x21ba420 00:25:44.582 [2024-11-27 03:20:47.096579] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:44.582 [2024-11-27 03:20:47.096588] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:44.582 [2024-11-27 03:20:47.096595] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x21ba420) 00:25:44.582 [2024-11-27 03:20:47.096605] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:44.582 [2024-11-27 03:20:47.096626] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x221ff20, cid 3, qid 0 00:25:44.582 [2024-11-27 03:20:47.096751] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:44.582 [2024-11-27 03:20:47.096767] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:44.582 [2024-11-27 03:20:47.096774] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:44.582 [2024-11-27 03:20:47.096781] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x221ff20) on tqpair=0x21ba420 00:25:44.582 [2024-11-27 03:20:47.096795] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:25:44.582 0 Kelvin (-273 Celsius) 00:25:44.582 Available Spare: 0% 00:25:44.582 Available Spare Threshold: 0% 00:25:44.582 Life Percentage Used: 0% 00:25:44.582 Data Units Read: 0 00:25:44.582 Data Units Written: 0 00:25:44.582 Host Read Commands: 0 00:25:44.582 Host Write Commands: 0 00:25:44.582 Controller Busy Time: 0 minutes 00:25:44.582 Power Cycles: 0 00:25:44.582 Power On Hours: 0 hours 00:25:44.582 Unsafe Shutdowns: 0 00:25:44.582 Unrecoverable Media Errors: 0 00:25:44.582 Lifetime Error Log Entries: 0 00:25:44.582 Warning Temperature Time: 0 minutes 00:25:44.582 Critical Temperature Time: 0 minutes 00:25:44.582 00:25:44.582 Number of Queues 00:25:44.582 ================ 00:25:44.582 Number of I/O Submission Queues: 127 00:25:44.582 Number of I/O Completion Queues: 127 00:25:44.582 00:25:44.582 Active Namespaces 00:25:44.582 ================= 00:25:44.582 Namespace ID:1 00:25:44.582 Error Recovery Timeout: Unlimited 00:25:44.582 Command Set Identifier: NVM (00h) 00:25:44.582 Deallocate: Supported 00:25:44.582 Deallocated/Unwritten Error: Not Supported 00:25:44.582 Deallocated Read Value: Unknown 00:25:44.582 Deallocate in Write Zeroes: Not Supported 00:25:44.582 Deallocated Guard Field: 0xFFFF 00:25:44.582 Flush: Supported 00:25:44.582 Reservation: Supported 00:25:44.582 Namespace Sharing Capabilities: Multiple Controllers 00:25:44.582 Size (in LBAs): 131072 (0GiB) 00:25:44.582 Capacity (in LBAs): 131072 (0GiB) 00:25:44.582 Utilization (in LBAs): 131072 (0GiB) 00:25:44.582 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:44.582 EUI64: ABCDEF0123456789 00:25:44.582 UUID: b2fe5496-b633-4ac8-8264-acb0c982152e 00:25:44.582 Thin Provisioning: Not Supported 00:25:44.582 Per-NS Atomic Units: Yes 00:25:44.582 Atomic Boundary Size (Normal): 0 00:25:44.582 Atomic Boundary Size (PFail): 0 00:25:44.582 Atomic Boundary Offset: 0 00:25:44.582 Maximum Single Source Range Length: 65535 00:25:44.582 Maximum Copy Length: 65535 00:25:44.582 Maximum Source Range Count: 1 00:25:44.582 NGUID/EUI64 Never Reused: No 00:25:44.582 Namespace Write Protected: No 00:25:44.582 Number of LBA Formats: 1 00:25:44.582 Current LBA Format: LBA Format #00 00:25:44.582 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:44.582 00:25:44.582 03:20:47 -- host/identify.sh@51 -- # sync 00:25:44.582 03:20:47 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:44.582 03:20:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.582 03:20:47 -- common/autotest_common.sh@10 -- # set +x 00:25:44.582 03:20:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.582 03:20:47 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:44.582 03:20:47 -- host/identify.sh@56 -- # nvmftestfini 00:25:44.582 03:20:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:44.582 03:20:47 -- nvmf/common.sh@116 -- # sync 00:25:44.582 03:20:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:44.582 03:20:47 -- nvmf/common.sh@119 -- # set +e 00:25:44.582 03:20:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:44.582 03:20:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:44.582 rmmod nvme_tcp 00:25:44.582 rmmod nvme_fabrics 00:25:44.582 rmmod nvme_keyring 00:25:44.582 03:20:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:44.582 03:20:47 -- nvmf/common.sh@123 -- # set -e 00:25:44.582 03:20:47 -- nvmf/common.sh@124 -- # return 0 00:25:44.582 03:20:47 -- nvmf/common.sh@477 -- # '[' -n 2541256 ']' 00:25:44.582 03:20:47 -- nvmf/common.sh@478 -- # killprocess 2541256 00:25:44.582 03:20:47 -- common/autotest_common.sh@936 -- # '[' -z 2541256 ']' 00:25:44.582 03:20:47 -- common/autotest_common.sh@940 -- # kill -0 2541256 00:25:44.582 03:20:47 -- common/autotest_common.sh@941 -- # uname 00:25:44.582 03:20:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:44.582 03:20:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2541256 00:25:44.840 03:20:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:44.840 03:20:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:44.840 03:20:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2541256' 00:25:44.840 killing process with pid 2541256 00:25:44.840 03:20:47 -- common/autotest_common.sh@955 -- # kill 2541256 00:25:44.840 [2024-11-27 03:20:47.217481] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:44.840 03:20:47 -- common/autotest_common.sh@960 -- # wait 2541256 00:25:45.099 03:20:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:45.099 03:20:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:45.099 03:20:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:45.099 03:20:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:45.099 03:20:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:45.099 03:20:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:45.099 03:20:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:45.099 03:20:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.075 03:20:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:47.075 00:25:47.075 real 0m6.293s 00:25:47.075 user 0m7.752s 00:25:47.075 sys 0m1.963s 00:25:47.075 03:20:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:47.075 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:25:47.075 ************************************ 00:25:47.075 END TEST nvmf_identify 00:25:47.075 ************************************ 00:25:47.075 03:20:49 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:47.075 03:20:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:47.075 03:20:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:47.075 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:25:47.075 ************************************ 00:25:47.075 START TEST nvmf_perf 00:25:47.075 ************************************ 00:25:47.075 03:20:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:47.075 * Looking for test storage... 00:25:47.075 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:47.075 03:20:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:47.075 03:20:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:47.075 03:20:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:47.075 03:20:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:47.075 03:20:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:47.075 03:20:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:47.075 03:20:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:47.075 03:20:49 -- scripts/common.sh@335 -- # IFS=.-: 00:25:47.075 03:20:49 -- scripts/common.sh@335 -- # read -ra ver1 00:25:47.075 03:20:49 -- scripts/common.sh@336 -- # IFS=.-: 00:25:47.075 03:20:49 -- scripts/common.sh@336 -- # read -ra ver2 00:25:47.075 03:20:49 -- scripts/common.sh@337 -- # local 'op=<' 00:25:47.075 03:20:49 -- scripts/common.sh@339 -- # ver1_l=2 00:25:47.075 03:20:49 -- scripts/common.sh@340 -- # ver2_l=1 00:25:47.075 03:20:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:47.076 03:20:49 -- scripts/common.sh@343 -- # case "$op" in 00:25:47.076 03:20:49 -- scripts/common.sh@344 -- # : 1 00:25:47.076 03:20:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:47.076 03:20:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:47.076 03:20:49 -- scripts/common.sh@364 -- # decimal 1 00:25:47.076 03:20:49 -- scripts/common.sh@352 -- # local d=1 00:25:47.076 03:20:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:47.076 03:20:49 -- scripts/common.sh@354 -- # echo 1 00:25:47.076 03:20:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:47.076 03:20:49 -- scripts/common.sh@365 -- # decimal 2 00:25:47.076 03:20:49 -- scripts/common.sh@352 -- # local d=2 00:25:47.076 03:20:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:47.076 03:20:49 -- scripts/common.sh@354 -- # echo 2 00:25:47.076 03:20:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:47.076 03:20:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:47.076 03:20:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:47.076 03:20:49 -- scripts/common.sh@367 -- # return 0 00:25:47.076 03:20:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:47.076 03:20:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:47.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.076 --rc genhtml_branch_coverage=1 00:25:47.076 --rc genhtml_function_coverage=1 00:25:47.076 --rc genhtml_legend=1 00:25:47.076 --rc geninfo_all_blocks=1 00:25:47.076 --rc geninfo_unexecuted_blocks=1 00:25:47.076 00:25:47.076 ' 00:25:47.076 03:20:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:47.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.076 --rc genhtml_branch_coverage=1 00:25:47.076 --rc genhtml_function_coverage=1 00:25:47.076 --rc genhtml_legend=1 00:25:47.076 --rc geninfo_all_blocks=1 00:25:47.076 --rc geninfo_unexecuted_blocks=1 00:25:47.076 00:25:47.076 ' 00:25:47.076 03:20:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:47.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.076 --rc genhtml_branch_coverage=1 00:25:47.076 --rc genhtml_function_coverage=1 00:25:47.076 --rc genhtml_legend=1 00:25:47.076 --rc geninfo_all_blocks=1 00:25:47.076 --rc geninfo_unexecuted_blocks=1 00:25:47.076 00:25:47.076 ' 00:25:47.076 03:20:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:47.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.076 --rc genhtml_branch_coverage=1 00:25:47.076 --rc genhtml_function_coverage=1 00:25:47.076 --rc genhtml_legend=1 00:25:47.076 --rc geninfo_all_blocks=1 00:25:47.076 --rc geninfo_unexecuted_blocks=1 00:25:47.076 00:25:47.076 ' 00:25:47.076 03:20:49 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:47.076 03:20:49 -- nvmf/common.sh@7 -- # uname -s 00:25:47.076 03:20:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:47.076 03:20:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:47.076 03:20:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:47.076 03:20:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:47.076 03:20:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:47.076 03:20:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:47.076 03:20:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:47.076 03:20:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:47.076 03:20:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:47.076 03:20:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:47.076 03:20:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.076 03:20:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.076 03:20:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:47.076 03:20:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:47.076 03:20:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:47.076 03:20:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:47.076 03:20:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:47.076 03:20:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:47.076 03:20:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:47.076 03:20:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.076 03:20:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.076 03:20:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.076 03:20:49 -- paths/export.sh@5 -- # export PATH 00:25:47.076 03:20:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.076 03:20:49 -- nvmf/common.sh@46 -- # : 0 00:25:47.076 03:20:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:47.076 03:20:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:47.076 03:20:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:47.076 03:20:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:47.076 03:20:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:47.076 03:20:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:47.076 03:20:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:47.076 03:20:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:47.076 03:20:49 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:47.076 03:20:49 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:47.076 03:20:49 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:47.076 03:20:49 -- host/perf.sh@17 -- # nvmftestinit 00:25:47.076 03:20:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:47.076 03:20:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:47.076 03:20:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:47.076 03:20:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:47.076 03:20:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:47.076 03:20:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:47.076 03:20:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:47.076 03:20:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.076 03:20:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:47.076 03:20:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:47.076 03:20:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:47.076 03:20:49 -- common/autotest_common.sh@10 -- # set +x 00:25:49.606 03:20:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:49.606 03:20:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:49.606 03:20:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:49.606 03:20:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:49.606 03:20:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:49.606 03:20:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:49.606 03:20:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:49.606 03:20:51 -- nvmf/common.sh@294 -- # net_devs=() 00:25:49.606 03:20:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:49.606 03:20:51 -- nvmf/common.sh@295 -- # e810=() 00:25:49.606 03:20:51 -- nvmf/common.sh@295 -- # local -ga e810 00:25:49.606 03:20:51 -- nvmf/common.sh@296 -- # x722=() 00:25:49.606 03:20:51 -- nvmf/common.sh@296 -- # local -ga x722 00:25:49.606 03:20:51 -- nvmf/common.sh@297 -- # mlx=() 00:25:49.606 03:20:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:49.606 03:20:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:49.606 03:20:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:49.606 03:20:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:49.606 03:20:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:49.606 03:20:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.606 03:20:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:49.606 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:49.606 03:20:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.606 03:20:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:49.606 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:49.606 03:20:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:49.606 03:20:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.606 03:20:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.606 03:20:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.606 03:20:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.606 03:20:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:49.606 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:49.606 03:20:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.606 03:20:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.606 03:20:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.606 03:20:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.606 03:20:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.606 03:20:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:49.606 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:49.606 03:20:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.606 03:20:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:49.606 03:20:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:49.606 03:20:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:49.606 03:20:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:49.606 03:20:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:49.606 03:20:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:49.606 03:20:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:49.606 03:20:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:49.606 03:20:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:49.606 03:20:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:49.606 03:20:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:49.606 03:20:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:49.606 03:20:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:49.606 03:20:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:49.606 03:20:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:49.606 03:20:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:49.606 03:20:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:49.606 03:20:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:49.606 03:20:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:49.606 03:20:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:49.606 03:20:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:49.606 03:20:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:49.606 03:20:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:49.606 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:49.606 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:25:49.606 00:25:49.606 --- 10.0.0.2 ping statistics --- 00:25:49.606 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.606 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:25:49.606 03:20:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:49.606 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:49.606 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.112 ms 00:25:49.606 00:25:49.606 --- 10.0.0.1 ping statistics --- 00:25:49.606 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.606 rtt min/avg/max/mdev = 0.112/0.112/0.112/0.000 ms 00:25:49.606 03:20:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:49.606 03:20:51 -- nvmf/common.sh@410 -- # return 0 00:25:49.606 03:20:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:49.606 03:20:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:49.606 03:20:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:49.606 03:20:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:49.606 03:20:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:49.606 03:20:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:49.606 03:20:51 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:49.606 03:20:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:49.606 03:20:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:49.606 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:25:49.606 03:20:51 -- nvmf/common.sh@469 -- # nvmfpid=2543394 00:25:49.606 03:20:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:49.606 03:20:51 -- nvmf/common.sh@470 -- # waitforlisten 2543394 00:25:49.606 03:20:51 -- common/autotest_common.sh@829 -- # '[' -z 2543394 ']' 00:25:49.606 03:20:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:49.606 03:20:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:49.606 03:20:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:49.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:49.606 03:20:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:49.606 03:20:51 -- common/autotest_common.sh@10 -- # set +x 00:25:49.606 [2024-11-27 03:20:51.999483] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:49.606 [2024-11-27 03:20:51.999575] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:49.606 EAL: No free 2048 kB hugepages reported on node 1 00:25:49.606 [2024-11-27 03:20:52.070206] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:49.606 [2024-11-27 03:20:52.160353] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:49.606 [2024-11-27 03:20:52.160514] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:49.606 [2024-11-27 03:20:52.160543] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:49.606 [2024-11-27 03:20:52.160558] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:49.606 [2024-11-27 03:20:52.160623] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:49.606 [2024-11-27 03:20:52.160676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:49.606 [2024-11-27 03:20:52.160790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:49.606 [2024-11-27 03:20:52.160793] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:50.540 03:20:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:50.540 03:20:52 -- common/autotest_common.sh@862 -- # return 0 00:25:50.540 03:20:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:50.540 03:20:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:50.540 03:20:52 -- common/autotest_common.sh@10 -- # set +x 00:25:50.540 03:20:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:50.540 03:20:52 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:50.540 03:20:52 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:53.822 03:20:56 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:53.822 03:20:56 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:53.822 03:20:56 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:25:53.822 03:20:56 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:54.080 03:20:56 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:54.080 03:20:56 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:25:54.080 03:20:56 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:54.080 03:20:56 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:25:54.080 03:20:56 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:25:54.338 [2024-11-27 03:20:56.898729] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:54.338 03:20:56 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:54.596 03:20:57 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:54.596 03:20:57 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:54.854 03:20:57 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:54.854 03:20:57 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:55.112 03:20:57 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:55.369 [2024-11-27 03:20:57.909549] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:55.369 03:20:57 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:55.626 03:20:58 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:25:55.626 03:20:58 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:55.626 03:20:58 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:55.626 03:20:58 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:25:56.998 Initializing NVMe Controllers 00:25:56.998 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:25:56.998 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:25:56.998 Initialization complete. Launching workers. 00:25:56.998 ======================================================== 00:25:56.998 Latency(us) 00:25:56.998 Device Information : IOPS MiB/s Average min max 00:25:56.998 PCIE (0000:88:00.0) NSID 1 from core 0: 87286.53 340.96 366.02 10.26 4322.76 00:25:56.998 ======================================================== 00:25:56.998 Total : 87286.53 340.96 366.02 10.26 4322.76 00:25:56.998 00:25:56.998 03:20:59 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:56.998 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.372 Initializing NVMe Controllers 00:25:58.372 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:58.372 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:58.372 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:58.372 Initialization complete. Launching workers. 00:25:58.372 ======================================================== 00:25:58.372 Latency(us) 00:25:58.372 Device Information : IOPS MiB/s Average min max 00:25:58.372 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 91.00 0.36 10990.88 142.29 45881.00 00:25:58.372 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 64.00 0.25 15991.11 3992.24 47897.45 00:25:58.372 ======================================================== 00:25:58.372 Total : 155.00 0.61 13055.49 142.29 47897.45 00:25:58.372 00:25:58.372 03:21:00 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:58.372 EAL: No free 2048 kB hugepages reported on node 1 00:25:59.306 Initializing NVMe Controllers 00:25:59.306 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:59.306 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:59.306 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:59.306 Initialization complete. Launching workers. 00:25:59.306 ======================================================== 00:25:59.306 Latency(us) 00:25:59.306 Device Information : IOPS MiB/s Average min max 00:25:59.306 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8037.84 31.40 4023.62 918.37 44623.24 00:25:59.306 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3924.92 15.33 8188.97 4458.18 18431.13 00:25:59.306 ======================================================== 00:25:59.306 Total : 11962.76 46.73 5390.25 918.37 44623.24 00:25:59.306 00:25:59.306 03:21:01 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:25:59.306 03:21:01 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:25:59.306 03:21:01 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:59.306 EAL: No free 2048 kB hugepages reported on node 1 00:26:01.834 Initializing NVMe Controllers 00:26:01.834 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:01.834 Controller IO queue size 128, less than required. 00:26:01.834 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:01.834 Controller IO queue size 128, less than required. 00:26:01.834 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:01.834 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:01.834 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:01.834 Initialization complete. Launching workers. 00:26:01.834 ======================================================== 00:26:01.834 Latency(us) 00:26:01.834 Device Information : IOPS MiB/s Average min max 00:26:01.834 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1717.46 429.36 75846.66 49635.71 126866.58 00:26:01.834 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 560.99 140.25 230896.34 77895.21 371625.74 00:26:01.834 ======================================================== 00:26:01.834 Total : 2278.44 569.61 114022.16 49635.71 371625.74 00:26:01.834 00:26:01.834 03:21:04 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:01.834 EAL: No free 2048 kB hugepages reported on node 1 00:26:02.398 No valid NVMe controllers or AIO or URING devices found 00:26:02.398 Initializing NVMe Controllers 00:26:02.398 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:02.398 Controller IO queue size 128, less than required. 00:26:02.398 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:02.398 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:02.398 Controller IO queue size 128, less than required. 00:26:02.398 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:02.398 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:02.398 WARNING: Some requested NVMe devices were skipped 00:26:02.398 03:21:04 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:02.398 EAL: No free 2048 kB hugepages reported on node 1 00:26:04.926 Initializing NVMe Controllers 00:26:04.926 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:04.926 Controller IO queue size 128, less than required. 00:26:04.926 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:04.926 Controller IO queue size 128, less than required. 00:26:04.926 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:04.926 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:04.926 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:04.926 Initialization complete. Launching workers. 00:26:04.926 00:26:04.926 ==================== 00:26:04.926 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:04.926 TCP transport: 00:26:04.926 polls: 8868 00:26:04.926 idle_polls: 5981 00:26:04.926 sock_completions: 2887 00:26:04.926 nvme_completions: 5621 00:26:04.926 submitted_requests: 8671 00:26:04.926 queued_requests: 1 00:26:04.926 00:26:04.926 ==================== 00:26:04.926 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:04.926 TCP transport: 00:26:04.926 polls: 12195 00:26:04.926 idle_polls: 8767 00:26:04.926 sock_completions: 3428 00:26:04.926 nvme_completions: 6399 00:26:04.926 submitted_requests: 9851 00:26:04.926 queued_requests: 1 00:26:04.926 ======================================================== 00:26:04.926 Latency(us) 00:26:04.926 Device Information : IOPS MiB/s Average min max 00:26:04.926 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1468.16 367.04 89286.86 48195.69 145770.54 00:26:04.926 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1662.55 415.64 77843.15 40079.74 112740.88 00:26:04.926 ======================================================== 00:26:04.926 Total : 3130.70 782.68 83209.73 40079.74 145770.54 00:26:04.926 00:26:04.926 03:21:07 -- host/perf.sh@66 -- # sync 00:26:04.926 03:21:07 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:05.184 03:21:07 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:05.184 03:21:07 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:05.184 03:21:07 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:08.463 03:21:10 -- host/perf.sh@72 -- # ls_guid=12362bcb-2454-4a4a-b153-789aeab61b9e 00:26:08.463 03:21:10 -- host/perf.sh@73 -- # get_lvs_free_mb 12362bcb-2454-4a4a-b153-789aeab61b9e 00:26:08.463 03:21:10 -- common/autotest_common.sh@1353 -- # local lvs_uuid=12362bcb-2454-4a4a-b153-789aeab61b9e 00:26:08.463 03:21:10 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:08.463 03:21:10 -- common/autotest_common.sh@1355 -- # local fc 00:26:08.463 03:21:10 -- common/autotest_common.sh@1356 -- # local cs 00:26:08.463 03:21:10 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:08.721 03:21:11 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:08.721 { 00:26:08.721 "uuid": "12362bcb-2454-4a4a-b153-789aeab61b9e", 00:26:08.721 "name": "lvs_0", 00:26:08.721 "base_bdev": "Nvme0n1", 00:26:08.721 "total_data_clusters": 238234, 00:26:08.721 "free_clusters": 238234, 00:26:08.721 "block_size": 512, 00:26:08.721 "cluster_size": 4194304 00:26:08.721 } 00:26:08.721 ]' 00:26:08.721 03:21:11 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="12362bcb-2454-4a4a-b153-789aeab61b9e") .free_clusters' 00:26:08.721 03:21:11 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:08.721 03:21:11 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="12362bcb-2454-4a4a-b153-789aeab61b9e") .cluster_size' 00:26:08.721 03:21:11 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:08.721 03:21:11 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:08.721 03:21:11 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:08.721 952936 00:26:08.721 03:21:11 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:08.721 03:21:11 -- host/perf.sh@78 -- # free_mb=20480 00:26:08.721 03:21:11 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 12362bcb-2454-4a4a-b153-789aeab61b9e lbd_0 20480 00:26:09.287 03:21:11 -- host/perf.sh@80 -- # lb_guid=cbfb62ea-781f-45d0-a6ed-e49930e06048 00:26:09.287 03:21:11 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore cbfb62ea-781f-45d0-a6ed-e49930e06048 lvs_n_0 00:26:10.219 03:21:12 -- host/perf.sh@83 -- # ls_nested_guid=89f5d4aa-87db-4c3f-956f-0e868f29b64b 00:26:10.219 03:21:12 -- host/perf.sh@84 -- # get_lvs_free_mb 89f5d4aa-87db-4c3f-956f-0e868f29b64b 00:26:10.219 03:21:12 -- common/autotest_common.sh@1353 -- # local lvs_uuid=89f5d4aa-87db-4c3f-956f-0e868f29b64b 00:26:10.219 03:21:12 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:10.219 03:21:12 -- common/autotest_common.sh@1355 -- # local fc 00:26:10.219 03:21:12 -- common/autotest_common.sh@1356 -- # local cs 00:26:10.219 03:21:12 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:10.477 03:21:12 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:10.477 { 00:26:10.477 "uuid": "12362bcb-2454-4a4a-b153-789aeab61b9e", 00:26:10.477 "name": "lvs_0", 00:26:10.477 "base_bdev": "Nvme0n1", 00:26:10.477 "total_data_clusters": 238234, 00:26:10.477 "free_clusters": 233114, 00:26:10.477 "block_size": 512, 00:26:10.477 "cluster_size": 4194304 00:26:10.477 }, 00:26:10.477 { 00:26:10.477 "uuid": "89f5d4aa-87db-4c3f-956f-0e868f29b64b", 00:26:10.477 "name": "lvs_n_0", 00:26:10.477 "base_bdev": "cbfb62ea-781f-45d0-a6ed-e49930e06048", 00:26:10.477 "total_data_clusters": 5114, 00:26:10.477 "free_clusters": 5114, 00:26:10.477 "block_size": 512, 00:26:10.477 "cluster_size": 4194304 00:26:10.477 } 00:26:10.477 ]' 00:26:10.477 03:21:12 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="89f5d4aa-87db-4c3f-956f-0e868f29b64b") .free_clusters' 00:26:10.477 03:21:12 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:10.477 03:21:12 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="89f5d4aa-87db-4c3f-956f-0e868f29b64b") .cluster_size' 00:26:10.477 03:21:13 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:10.477 03:21:13 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:10.477 03:21:13 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:10.477 20456 00:26:10.477 03:21:13 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:10.477 03:21:13 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 89f5d4aa-87db-4c3f-956f-0e868f29b64b lbd_nest_0 20456 00:26:10.735 03:21:13 -- host/perf.sh@88 -- # lb_nested_guid=3148ab47-84a5-44b2-8a70-3c393f5bd4b2 00:26:10.735 03:21:13 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:10.992 03:21:13 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:10.992 03:21:13 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 3148ab47-84a5-44b2-8a70-3c393f5bd4b2 00:26:11.250 03:21:13 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:11.508 03:21:14 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:11.508 03:21:14 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:11.508 03:21:14 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:11.508 03:21:14 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:11.508 03:21:14 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:11.508 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.700 Initializing NVMe Controllers 00:26:23.700 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:23.700 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:23.700 Initialization complete. Launching workers. 00:26:23.700 ======================================================== 00:26:23.700 Latency(us) 00:26:23.700 Device Information : IOPS MiB/s Average min max 00:26:23.700 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 47.60 0.02 21069.72 178.76 48778.17 00:26:23.700 ======================================================== 00:26:23.700 Total : 47.60 0.02 21069.72 178.76 48778.17 00:26:23.700 00:26:23.700 03:21:24 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:23.700 03:21:24 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:23.700 EAL: No free 2048 kB hugepages reported on node 1 00:26:33.663 Initializing NVMe Controllers 00:26:33.663 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:33.663 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:33.663 Initialization complete. Launching workers. 00:26:33.663 ======================================================== 00:26:33.663 Latency(us) 00:26:33.663 Device Information : IOPS MiB/s Average min max 00:26:33.663 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 76.80 9.60 13027.45 4984.77 47901.49 00:26:33.663 ======================================================== 00:26:33.663 Total : 76.80 9.60 13027.45 4984.77 47901.49 00:26:33.663 00:26:33.663 03:21:34 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:33.663 03:21:34 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:33.663 03:21:34 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:33.663 EAL: No free 2048 kB hugepages reported on node 1 00:26:43.629 Initializing NVMe Controllers 00:26:43.629 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:43.629 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:43.629 Initialization complete. Launching workers. 00:26:43.629 ======================================================== 00:26:43.629 Latency(us) 00:26:43.629 Device Information : IOPS MiB/s Average min max 00:26:43.629 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7492.10 3.66 4271.78 381.11 11124.64 00:26:43.629 ======================================================== 00:26:43.629 Total : 7492.10 3.66 4271.78 381.11 11124.64 00:26:43.629 00:26:43.629 03:21:44 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:43.629 03:21:44 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:43.629 EAL: No free 2048 kB hugepages reported on node 1 00:26:53.701 Initializing NVMe Controllers 00:26:53.701 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:53.701 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:53.701 Initialization complete. Launching workers. 00:26:53.701 ======================================================== 00:26:53.701 Latency(us) 00:26:53.701 Device Information : IOPS MiB/s Average min max 00:26:53.701 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4083.09 510.39 7836.94 753.55 18920.58 00:26:53.701 ======================================================== 00:26:53.701 Total : 4083.09 510.39 7836.94 753.55 18920.58 00:26:53.701 00:26:53.701 03:21:55 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:53.701 03:21:55 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:53.701 03:21:55 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:53.701 EAL: No free 2048 kB hugepages reported on node 1 00:27:03.666 Initializing NVMe Controllers 00:27:03.666 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:03.666 Controller IO queue size 128, less than required. 00:27:03.666 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:03.666 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:03.666 Initialization complete. Launching workers. 00:27:03.666 ======================================================== 00:27:03.666 Latency(us) 00:27:03.666 Device Information : IOPS MiB/s Average min max 00:27:03.666 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12048.37 5.88 10632.16 1896.63 25412.72 00:27:03.666 ======================================================== 00:27:03.666 Total : 12048.37 5.88 10632.16 1896.63 25412.72 00:27:03.666 00:27:03.666 03:22:05 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:03.666 03:22:05 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:03.666 EAL: No free 2048 kB hugepages reported on node 1 00:27:13.636 Initializing NVMe Controllers 00:27:13.636 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:13.636 Controller IO queue size 128, less than required. 00:27:13.636 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:13.636 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:13.636 Initialization complete. Launching workers. 00:27:13.636 ======================================================== 00:27:13.636 Latency(us) 00:27:13.636 Device Information : IOPS MiB/s Average min max 00:27:13.636 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1202.30 150.29 107395.39 15377.57 220027.65 00:27:13.636 ======================================================== 00:27:13.636 Total : 1202.30 150.29 107395.39 15377.57 220027.65 00:27:13.636 00:27:13.636 03:22:16 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:13.895 03:22:16 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3148ab47-84a5-44b2-8a70-3c393f5bd4b2 00:27:14.829 03:22:17 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:14.829 03:22:17 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete cbfb62ea-781f-45d0-a6ed-e49930e06048 00:27:15.087 03:22:17 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:15.346 03:22:17 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:15.346 03:22:17 -- host/perf.sh@114 -- # nvmftestfini 00:27:15.346 03:22:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:15.346 03:22:17 -- nvmf/common.sh@116 -- # sync 00:27:15.346 03:22:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:15.346 03:22:17 -- nvmf/common.sh@119 -- # set +e 00:27:15.346 03:22:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:15.346 03:22:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:15.346 rmmod nvme_tcp 00:27:15.346 rmmod nvme_fabrics 00:27:15.605 rmmod nvme_keyring 00:27:15.605 03:22:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:15.605 03:22:17 -- nvmf/common.sh@123 -- # set -e 00:27:15.605 03:22:17 -- nvmf/common.sh@124 -- # return 0 00:27:15.605 03:22:17 -- nvmf/common.sh@477 -- # '[' -n 2543394 ']' 00:27:15.605 03:22:17 -- nvmf/common.sh@478 -- # killprocess 2543394 00:27:15.605 03:22:17 -- common/autotest_common.sh@936 -- # '[' -z 2543394 ']' 00:27:15.605 03:22:17 -- common/autotest_common.sh@940 -- # kill -0 2543394 00:27:15.605 03:22:17 -- common/autotest_common.sh@941 -- # uname 00:27:15.605 03:22:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:15.605 03:22:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2543394 00:27:15.605 03:22:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:15.605 03:22:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:15.605 03:22:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2543394' 00:27:15.605 killing process with pid 2543394 00:27:15.605 03:22:18 -- common/autotest_common.sh@955 -- # kill 2543394 00:27:15.605 03:22:18 -- common/autotest_common.sh@960 -- # wait 2543394 00:27:17.511 03:22:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:17.511 03:22:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:17.511 03:22:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:17.511 03:22:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:17.511 03:22:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:17.511 03:22:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:17.511 03:22:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:17.511 03:22:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:19.418 03:22:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:19.418 00:27:19.418 real 1m32.168s 00:27:19.418 user 5m40.581s 00:27:19.418 sys 0m15.588s 00:27:19.418 03:22:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:19.418 03:22:21 -- common/autotest_common.sh@10 -- # set +x 00:27:19.418 ************************************ 00:27:19.418 END TEST nvmf_perf 00:27:19.418 ************************************ 00:27:19.418 03:22:21 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:19.418 03:22:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:19.418 03:22:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:19.418 03:22:21 -- common/autotest_common.sh@10 -- # set +x 00:27:19.418 ************************************ 00:27:19.418 START TEST nvmf_fio_host 00:27:19.418 ************************************ 00:27:19.418 03:22:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:19.418 * Looking for test storage... 00:27:19.418 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:19.418 03:22:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:19.418 03:22:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:19.418 03:22:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:19.418 03:22:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:19.418 03:22:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:19.418 03:22:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:19.419 03:22:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:19.419 03:22:21 -- scripts/common.sh@335 -- # IFS=.-: 00:27:19.419 03:22:21 -- scripts/common.sh@335 -- # read -ra ver1 00:27:19.419 03:22:21 -- scripts/common.sh@336 -- # IFS=.-: 00:27:19.419 03:22:21 -- scripts/common.sh@336 -- # read -ra ver2 00:27:19.419 03:22:21 -- scripts/common.sh@337 -- # local 'op=<' 00:27:19.419 03:22:21 -- scripts/common.sh@339 -- # ver1_l=2 00:27:19.419 03:22:21 -- scripts/common.sh@340 -- # ver2_l=1 00:27:19.419 03:22:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:19.419 03:22:21 -- scripts/common.sh@343 -- # case "$op" in 00:27:19.419 03:22:21 -- scripts/common.sh@344 -- # : 1 00:27:19.419 03:22:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:19.419 03:22:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:19.419 03:22:21 -- scripts/common.sh@364 -- # decimal 1 00:27:19.419 03:22:21 -- scripts/common.sh@352 -- # local d=1 00:27:19.419 03:22:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:19.419 03:22:21 -- scripts/common.sh@354 -- # echo 1 00:27:19.419 03:22:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:19.419 03:22:21 -- scripts/common.sh@365 -- # decimal 2 00:27:19.419 03:22:21 -- scripts/common.sh@352 -- # local d=2 00:27:19.419 03:22:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:19.419 03:22:21 -- scripts/common.sh@354 -- # echo 2 00:27:19.419 03:22:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:19.419 03:22:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:19.419 03:22:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:19.419 03:22:21 -- scripts/common.sh@367 -- # return 0 00:27:19.419 03:22:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:19.419 03:22:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:19.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:19.419 --rc genhtml_branch_coverage=1 00:27:19.419 --rc genhtml_function_coverage=1 00:27:19.419 --rc genhtml_legend=1 00:27:19.419 --rc geninfo_all_blocks=1 00:27:19.419 --rc geninfo_unexecuted_blocks=1 00:27:19.419 00:27:19.419 ' 00:27:19.419 03:22:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:19.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:19.419 --rc genhtml_branch_coverage=1 00:27:19.419 --rc genhtml_function_coverage=1 00:27:19.419 --rc genhtml_legend=1 00:27:19.419 --rc geninfo_all_blocks=1 00:27:19.419 --rc geninfo_unexecuted_blocks=1 00:27:19.419 00:27:19.419 ' 00:27:19.419 03:22:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:19.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:19.419 --rc genhtml_branch_coverage=1 00:27:19.419 --rc genhtml_function_coverage=1 00:27:19.419 --rc genhtml_legend=1 00:27:19.419 --rc geninfo_all_blocks=1 00:27:19.419 --rc geninfo_unexecuted_blocks=1 00:27:19.419 00:27:19.419 ' 00:27:19.419 03:22:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:19.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:19.419 --rc genhtml_branch_coverage=1 00:27:19.419 --rc genhtml_function_coverage=1 00:27:19.419 --rc genhtml_legend=1 00:27:19.419 --rc geninfo_all_blocks=1 00:27:19.419 --rc geninfo_unexecuted_blocks=1 00:27:19.419 00:27:19.419 ' 00:27:19.419 03:22:21 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:19.419 03:22:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:19.419 03:22:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:19.419 03:22:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:19.419 03:22:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.419 03:22:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.419 03:22:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.419 03:22:21 -- paths/export.sh@5 -- # export PATH 00:27:19.419 03:22:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.419 03:22:21 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:19.419 03:22:21 -- nvmf/common.sh@7 -- # uname -s 00:27:19.419 03:22:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:19.419 03:22:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:19.419 03:22:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:19.419 03:22:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:19.419 03:22:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:19.419 03:22:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:19.419 03:22:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:19.419 03:22:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:19.419 03:22:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:19.419 03:22:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:19.419 03:22:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:19.419 03:22:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:19.419 03:22:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:19.419 03:22:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:19.419 03:22:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:19.419 03:22:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:19.419 03:22:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:19.419 03:22:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:19.419 03:22:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:19.419 03:22:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.419 03:22:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.419 03:22:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.419 03:22:21 -- paths/export.sh@5 -- # export PATH 00:27:19.419 03:22:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:19.419 03:22:21 -- nvmf/common.sh@46 -- # : 0 00:27:19.419 03:22:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:19.419 03:22:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:19.419 03:22:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:19.419 03:22:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:19.419 03:22:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:19.419 03:22:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:19.419 03:22:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:19.419 03:22:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:19.419 03:22:21 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:19.419 03:22:21 -- host/fio.sh@14 -- # nvmftestinit 00:27:19.419 03:22:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:19.419 03:22:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:19.419 03:22:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:19.419 03:22:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:19.419 03:22:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:19.419 03:22:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:19.419 03:22:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:19.419 03:22:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:19.419 03:22:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:19.419 03:22:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:19.419 03:22:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:19.419 03:22:21 -- common/autotest_common.sh@10 -- # set +x 00:27:21.327 03:22:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:21.327 03:22:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:21.327 03:22:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:21.327 03:22:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:21.327 03:22:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:21.327 03:22:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:21.327 03:22:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:21.327 03:22:23 -- nvmf/common.sh@294 -- # net_devs=() 00:27:21.327 03:22:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:21.327 03:22:23 -- nvmf/common.sh@295 -- # e810=() 00:27:21.327 03:22:23 -- nvmf/common.sh@295 -- # local -ga e810 00:27:21.327 03:22:23 -- nvmf/common.sh@296 -- # x722=() 00:27:21.327 03:22:23 -- nvmf/common.sh@296 -- # local -ga x722 00:27:21.327 03:22:23 -- nvmf/common.sh@297 -- # mlx=() 00:27:21.327 03:22:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:21.327 03:22:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:21.327 03:22:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:21.327 03:22:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:21.327 03:22:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:21.327 03:22:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:21.327 03:22:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:21.327 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:21.327 03:22:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:21.327 03:22:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:21.327 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:21.327 03:22:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:21.327 03:22:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:21.327 03:22:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:21.327 03:22:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:21.327 03:22:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:21.327 03:22:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:21.327 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:21.327 03:22:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:21.327 03:22:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:21.327 03:22:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:21.327 03:22:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:21.327 03:22:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:21.327 03:22:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:21.327 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:21.327 03:22:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:21.327 03:22:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:21.327 03:22:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:21.327 03:22:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:21.327 03:22:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:21.327 03:22:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:21.327 03:22:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:21.327 03:22:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:21.327 03:22:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:21.327 03:22:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:21.327 03:22:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:21.327 03:22:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:21.327 03:22:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:21.327 03:22:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:21.327 03:22:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:21.327 03:22:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:21.327 03:22:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:21.327 03:22:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:21.327 03:22:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:21.327 03:22:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:21.327 03:22:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:21.327 03:22:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:21.586 03:22:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:21.586 03:22:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:21.586 03:22:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:21.586 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:21.586 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.152 ms 00:27:21.586 00:27:21.586 --- 10.0.0.2 ping statistics --- 00:27:21.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:21.586 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:27:21.586 03:22:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:21.586 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:21.586 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.066 ms 00:27:21.586 00:27:21.586 --- 10.0.0.1 ping statistics --- 00:27:21.586 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:21.586 rtt min/avg/max/mdev = 0.066/0.066/0.066/0.000 ms 00:27:21.586 03:22:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:21.586 03:22:23 -- nvmf/common.sh@410 -- # return 0 00:27:21.586 03:22:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:21.586 03:22:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:21.586 03:22:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:21.586 03:22:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:21.586 03:22:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:21.586 03:22:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:21.586 03:22:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:21.586 03:22:23 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:21.586 03:22:23 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:21.586 03:22:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:21.586 03:22:23 -- common/autotest_common.sh@10 -- # set +x 00:27:21.586 03:22:23 -- host/fio.sh@24 -- # nvmfpid=2556563 00:27:21.587 03:22:23 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:21.587 03:22:23 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:21.587 03:22:23 -- host/fio.sh@28 -- # waitforlisten 2556563 00:27:21.587 03:22:23 -- common/autotest_common.sh@829 -- # '[' -z 2556563 ']' 00:27:21.587 03:22:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:21.587 03:22:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:21.587 03:22:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:21.587 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:21.587 03:22:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:21.587 03:22:23 -- common/autotest_common.sh@10 -- # set +x 00:27:21.587 [2024-11-27 03:22:24.035813] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:21.587 [2024-11-27 03:22:24.035884] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:21.587 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.587 [2024-11-27 03:22:24.101940] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:21.587 [2024-11-27 03:22:24.186247] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:21.587 [2024-11-27 03:22:24.186421] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:21.587 [2024-11-27 03:22:24.186438] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:21.587 [2024-11-27 03:22:24.186450] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:21.587 [2024-11-27 03:22:24.186509] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:21.587 [2024-11-27 03:22:24.186600] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:21.587 [2024-11-27 03:22:24.186557] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:21.587 [2024-11-27 03:22:24.186586] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:22.524 03:22:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:22.524 03:22:25 -- common/autotest_common.sh@862 -- # return 0 00:27:22.524 03:22:25 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:22.783 [2024-11-27 03:22:25.350310] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:22.783 03:22:25 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:22.783 03:22:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:22.783 03:22:25 -- common/autotest_common.sh@10 -- # set +x 00:27:22.783 03:22:25 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:23.353 Malloc1 00:27:23.353 03:22:25 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:23.353 03:22:25 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:23.613 03:22:26 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:23.869 [2024-11-27 03:22:26.421163] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:23.869 03:22:26 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:24.126 03:22:26 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:24.126 03:22:26 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:24.126 03:22:26 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:24.126 03:22:26 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:24.126 03:22:26 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:24.126 03:22:26 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:24.126 03:22:26 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:24.126 03:22:26 -- common/autotest_common.sh@1330 -- # shift 00:27:24.126 03:22:26 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:24.126 03:22:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:24.126 03:22:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:24.126 03:22:26 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:24.126 03:22:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:24.126 03:22:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:24.126 03:22:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:24.126 03:22:26 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:24.126 03:22:26 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:24.126 03:22:26 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:24.126 03:22:26 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:24.126 03:22:26 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:24.126 03:22:26 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:24.126 03:22:26 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:24.126 03:22:26 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:24.385 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:24.385 fio-3.35 00:27:24.385 Starting 1 thread 00:27:24.385 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.915 00:27:26.915 test: (groupid=0, jobs=1): err= 0: pid=2556941: Wed Nov 27 03:22:29 2024 00:27:26.915 read: IOPS=8373, BW=32.7MiB/s (34.3MB/s)(65.6MiB/2005msec) 00:27:26.915 slat (nsec): min=1914, max=139097, avg=2487.70, stdev=1663.15 00:27:26.915 clat (usec): min=3395, max=14106, avg=8438.12, stdev=663.51 00:27:26.915 lat (usec): min=3416, max=14109, avg=8440.60, stdev=663.45 00:27:26.915 clat percentiles (usec): 00:27:26.915 | 1.00th=[ 7046], 5.00th=[ 7504], 10.00th=[ 7701], 20.00th=[ 7963], 00:27:26.915 | 30.00th=[ 8094], 40.00th=[ 8291], 50.00th=[ 8455], 60.00th=[ 8586], 00:27:26.915 | 70.00th=[ 8717], 80.00th=[ 8979], 90.00th=[ 9241], 95.00th=[ 9503], 00:27:26.915 | 99.00th=[10028], 99.50th=[10159], 99.90th=[13173], 99.95th=[13960], 00:27:26.915 | 99.99th=[14091] 00:27:26.915 bw ( KiB/s): min=32336, max=34064, per=99.75%, avg=33412.00, stdev=746.83, samples=4 00:27:26.915 iops : min= 8084, max= 8516, avg=8353.00, stdev=186.71, samples=4 00:27:26.915 write: IOPS=8368, BW=32.7MiB/s (34.3MB/s)(65.5MiB/2005msec); 0 zone resets 00:27:26.915 slat (nsec): min=2011, max=96809, avg=2625.48, stdev=1348.59 00:27:26.915 clat (usec): min=1649, max=12205, avg=6787.63, stdev=563.26 00:27:26.915 lat (usec): min=1655, max=12207, avg=6790.25, stdev=563.25 00:27:26.915 clat percentiles (usec): 00:27:26.915 | 1.00th=[ 5669], 5.00th=[ 5997], 10.00th=[ 6128], 20.00th=[ 6390], 00:27:26.915 | 30.00th=[ 6521], 40.00th=[ 6652], 50.00th=[ 6783], 60.00th=[ 6915], 00:27:26.915 | 70.00th=[ 7046], 80.00th=[ 7177], 90.00th=[ 7439], 95.00th=[ 7701], 00:27:26.915 | 99.00th=[ 8225], 99.50th=[ 8455], 99.90th=[10290], 99.95th=[11338], 00:27:26.915 | 99.99th=[12125] 00:27:26.915 bw ( KiB/s): min=33144, max=33856, per=99.99%, avg=33470.00, stdev=320.56, samples=4 00:27:26.915 iops : min= 8286, max= 8464, avg=8367.50, stdev=80.14, samples=4 00:27:26.915 lat (msec) : 2=0.02%, 4=0.08%, 10=99.42%, 20=0.49% 00:27:26.915 cpu : usr=63.22%, sys=34.93%, ctx=96, majf=0, minf=41 00:27:26.915 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:26.915 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:26.915 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:26.915 issued rwts: total=16789,16779,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:26.915 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:26.915 00:27:26.915 Run status group 0 (all jobs): 00:27:26.915 READ: bw=32.7MiB/s (34.3MB/s), 32.7MiB/s-32.7MiB/s (34.3MB/s-34.3MB/s), io=65.6MiB (68.8MB), run=2005-2005msec 00:27:26.915 WRITE: bw=32.7MiB/s (34.3MB/s), 32.7MiB/s-32.7MiB/s (34.3MB/s-34.3MB/s), io=65.5MiB (68.7MB), run=2005-2005msec 00:27:26.915 03:22:29 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:26.915 03:22:29 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:26.915 03:22:29 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:26.915 03:22:29 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:26.915 03:22:29 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:26.915 03:22:29 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:26.915 03:22:29 -- common/autotest_common.sh@1330 -- # shift 00:27:26.915 03:22:29 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:26.915 03:22:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:26.915 03:22:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:26.915 03:22:29 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:26.915 03:22:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:26.915 03:22:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:26.915 03:22:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:26.915 03:22:29 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:26.915 03:22:29 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:26.915 03:22:29 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:26.915 03:22:29 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:26.915 03:22:29 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:26.915 03:22:29 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:26.915 03:22:29 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:26.915 03:22:29 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:26.915 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:26.915 fio-3.35 00:27:26.915 Starting 1 thread 00:27:26.915 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.446 00:27:29.446 test: (groupid=0, jobs=1): err= 0: pid=2557406: Wed Nov 27 03:22:31 2024 00:27:29.446 read: IOPS=8497, BW=133MiB/s (139MB/s)(266MiB/2006msec) 00:27:29.446 slat (usec): min=2, max=115, avg= 3.74, stdev= 2.18 00:27:29.446 clat (usec): min=2325, max=15505, avg=8646.35, stdev=2073.15 00:27:29.446 lat (usec): min=2328, max=15509, avg=8650.09, stdev=2073.19 00:27:29.446 clat percentiles (usec): 00:27:29.446 | 1.00th=[ 4490], 5.00th=[ 5407], 10.00th=[ 5997], 20.00th=[ 6849], 00:27:29.446 | 30.00th=[ 7504], 40.00th=[ 8029], 50.00th=[ 8586], 60.00th=[ 9110], 00:27:29.446 | 70.00th=[ 9634], 80.00th=[10290], 90.00th=[11338], 95.00th=[12518], 00:27:29.446 | 99.00th=[13960], 99.50th=[14484], 99.90th=[15008], 99.95th=[15139], 00:27:29.446 | 99.99th=[15270] 00:27:29.446 bw ( KiB/s): min=63872, max=81152, per=52.21%, avg=70984.00, stdev=8514.26, samples=4 00:27:29.446 iops : min= 3992, max= 5072, avg=4436.50, stdev=532.14, samples=4 00:27:29.446 write: IOPS=4997, BW=78.1MiB/s (81.9MB/s)(144MiB/1849msec); 0 zone resets 00:27:29.446 slat (usec): min=30, max=188, avg=34.63, stdev= 6.28 00:27:29.446 clat (usec): min=6448, max=18122, avg=11125.59, stdev=1987.16 00:27:29.446 lat (usec): min=6479, max=18158, avg=11160.22, stdev=1987.43 00:27:29.446 clat percentiles (usec): 00:27:29.446 | 1.00th=[ 7308], 5.00th=[ 8225], 10.00th=[ 8717], 20.00th=[ 9372], 00:27:29.446 | 30.00th=[ 9896], 40.00th=[10421], 50.00th=[10814], 60.00th=[11469], 00:27:29.446 | 70.00th=[12125], 80.00th=[12780], 90.00th=[13960], 95.00th=[14746], 00:27:29.446 | 99.00th=[16057], 99.50th=[16712], 99.90th=[17433], 99.95th=[17957], 00:27:29.446 | 99.99th=[18220] 00:27:29.446 bw ( KiB/s): min=66400, max=83968, per=92.45%, avg=73928.00, stdev=8698.33, samples=4 00:27:29.446 iops : min= 4150, max= 5248, avg=4620.50, stdev=543.65, samples=4 00:27:29.446 lat (msec) : 4=0.28%, 10=60.34%, 20=39.39% 00:27:29.446 cpu : usr=76.77%, sys=21.73%, ctx=40, majf=0, minf=65 00:27:29.446 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:27:29.446 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:29.446 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:29.446 issued rwts: total=17045,9241,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:29.446 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:29.446 00:27:29.446 Run status group 0 (all jobs): 00:27:29.446 READ: bw=133MiB/s (139MB/s), 133MiB/s-133MiB/s (139MB/s-139MB/s), io=266MiB (279MB), run=2006-2006msec 00:27:29.446 WRITE: bw=78.1MiB/s (81.9MB/s), 78.1MiB/s-78.1MiB/s (81.9MB/s-81.9MB/s), io=144MiB (151MB), run=1849-1849msec 00:27:29.446 03:22:31 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:29.446 03:22:32 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:29.446 03:22:32 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:29.446 03:22:32 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:29.446 03:22:32 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:29.446 03:22:32 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:29.446 03:22:32 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:29.446 03:22:32 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:29.446 03:22:32 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:29.707 03:22:32 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:29.707 03:22:32 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:29.707 03:22:32 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:33.005 Nvme0n1 00:27:33.005 03:22:35 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:35.543 03:22:38 -- host/fio.sh@53 -- # ls_guid=5b6d655c-be51-41e7-8338-e5dd30ce1b61 00:27:35.543 03:22:38 -- host/fio.sh@54 -- # get_lvs_free_mb 5b6d655c-be51-41e7-8338-e5dd30ce1b61 00:27:35.543 03:22:38 -- common/autotest_common.sh@1353 -- # local lvs_uuid=5b6d655c-be51-41e7-8338-e5dd30ce1b61 00:27:35.543 03:22:38 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:35.543 03:22:38 -- common/autotest_common.sh@1355 -- # local fc 00:27:35.543 03:22:38 -- common/autotest_common.sh@1356 -- # local cs 00:27:35.543 03:22:38 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:35.801 03:22:38 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:35.801 { 00:27:35.801 "uuid": "5b6d655c-be51-41e7-8338-e5dd30ce1b61", 00:27:35.801 "name": "lvs_0", 00:27:35.801 "base_bdev": "Nvme0n1", 00:27:35.801 "total_data_clusters": 930, 00:27:35.801 "free_clusters": 930, 00:27:35.801 "block_size": 512, 00:27:35.801 "cluster_size": 1073741824 00:27:35.801 } 00:27:35.801 ]' 00:27:35.801 03:22:38 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="5b6d655c-be51-41e7-8338-e5dd30ce1b61") .free_clusters' 00:27:35.801 03:22:38 -- common/autotest_common.sh@1358 -- # fc=930 00:27:35.801 03:22:38 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="5b6d655c-be51-41e7-8338-e5dd30ce1b61") .cluster_size' 00:27:35.801 03:22:38 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:35.801 03:22:38 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:35.801 03:22:38 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:35.801 952320 00:27:35.801 03:22:38 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:36.368 1f124e4a-191a-4b86-ab9f-daf8709ba543 00:27:36.368 03:22:38 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:36.626 03:22:39 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:36.883 03:22:39 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:37.141 03:22:39 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:37.141 03:22:39 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:37.141 03:22:39 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:37.141 03:22:39 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:37.141 03:22:39 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:37.141 03:22:39 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:37.141 03:22:39 -- common/autotest_common.sh@1330 -- # shift 00:27:37.141 03:22:39 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:37.141 03:22:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:37.141 03:22:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:37.141 03:22:39 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:37.141 03:22:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:37.141 03:22:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:37.141 03:22:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:37.141 03:22:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:37.141 03:22:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:37.141 03:22:39 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:37.141 03:22:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:37.141 03:22:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:37.141 03:22:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:37.141 03:22:39 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:37.142 03:22:39 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:37.400 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:37.400 fio-3.35 00:27:37.400 Starting 1 thread 00:27:37.400 EAL: No free 2048 kB hugepages reported on node 1 00:27:39.934 00:27:39.934 test: (groupid=0, jobs=1): err= 0: pid=2558724: Wed Nov 27 03:22:42 2024 00:27:39.934 read: IOPS=5640, BW=22.0MiB/s (23.1MB/s)(44.2MiB/2008msec) 00:27:39.934 slat (nsec): min=1945, max=136571, avg=2577.75, stdev=2092.02 00:27:39.934 clat (usec): min=1216, max=172235, avg=12433.24, stdev=11975.14 00:27:39.934 lat (usec): min=1218, max=172279, avg=12435.82, stdev=11975.40 00:27:39.934 clat percentiles (msec): 00:27:39.934 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 11], 00:27:39.934 | 30.00th=[ 12], 40.00th=[ 12], 50.00th=[ 12], 60.00th=[ 12], 00:27:39.934 | 70.00th=[ 13], 80.00th=[ 13], 90.00th=[ 13], 95.00th=[ 14], 00:27:39.934 | 99.00th=[ 15], 99.50th=[ 157], 99.90th=[ 174], 99.95th=[ 174], 00:27:39.934 | 99.99th=[ 174] 00:27:39.934 bw ( KiB/s): min=15792, max=25064, per=99.83%, avg=22526.00, stdev=4499.93, samples=4 00:27:39.934 iops : min= 3948, max= 6266, avg=5631.50, stdev=1124.98, samples=4 00:27:39.934 write: IOPS=5611, BW=21.9MiB/s (23.0MB/s)(44.0MiB/2008msec); 0 zone resets 00:27:39.934 slat (usec): min=2, max=108, avg= 2.65, stdev= 1.52 00:27:39.934 clat (usec): min=305, max=170033, avg=10138.49, stdev=11257.05 00:27:39.934 lat (usec): min=307, max=170060, avg=10141.15, stdev=11257.28 00:27:39.934 clat percentiles (msec): 00:27:39.934 | 1.00th=[ 8], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 9], 00:27:39.934 | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 10], 60.00th=[ 10], 00:27:39.934 | 70.00th=[ 10], 80.00th=[ 11], 90.00th=[ 11], 95.00th=[ 11], 00:27:39.934 | 99.00th=[ 12], 99.50th=[ 155], 99.90th=[ 169], 99.95th=[ 171], 00:27:39.934 | 99.99th=[ 171] 00:27:39.934 bw ( KiB/s): min=16744, max=24448, per=99.84%, avg=22410.00, stdev=3779.76, samples=4 00:27:39.934 iops : min= 4186, max= 6112, avg=5602.50, stdev=944.94, samples=4 00:27:39.934 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:27:39.934 lat (msec) : 2=0.03%, 4=0.08%, 10=42.51%, 20=56.80%, 250=0.57% 00:27:39.934 cpu : usr=61.73%, sys=36.72%, ctx=118, majf=0, minf=41 00:27:39.934 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:39.934 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:39.934 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:39.934 issued rwts: total=11327,11268,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:39.934 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:39.934 00:27:39.934 Run status group 0 (all jobs): 00:27:39.934 READ: bw=22.0MiB/s (23.1MB/s), 22.0MiB/s-22.0MiB/s (23.1MB/s-23.1MB/s), io=44.2MiB (46.4MB), run=2008-2008msec 00:27:39.934 WRITE: bw=21.9MiB/s (23.0MB/s), 21.9MiB/s-21.9MiB/s (23.0MB/s-23.0MB/s), io=44.0MiB (46.2MB), run=2008-2008msec 00:27:39.934 03:22:42 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:39.934 03:22:42 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:41.392 03:22:43 -- host/fio.sh@64 -- # ls_nested_guid=3b50a73b-c176-467c-8a41-89c423917392 00:27:41.392 03:22:43 -- host/fio.sh@65 -- # get_lvs_free_mb 3b50a73b-c176-467c-8a41-89c423917392 00:27:41.392 03:22:43 -- common/autotest_common.sh@1353 -- # local lvs_uuid=3b50a73b-c176-467c-8a41-89c423917392 00:27:41.392 03:22:43 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:41.392 03:22:43 -- common/autotest_common.sh@1355 -- # local fc 00:27:41.392 03:22:43 -- common/autotest_common.sh@1356 -- # local cs 00:27:41.392 03:22:43 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:41.392 03:22:43 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:41.392 { 00:27:41.392 "uuid": "5b6d655c-be51-41e7-8338-e5dd30ce1b61", 00:27:41.392 "name": "lvs_0", 00:27:41.392 "base_bdev": "Nvme0n1", 00:27:41.393 "total_data_clusters": 930, 00:27:41.393 "free_clusters": 0, 00:27:41.393 "block_size": 512, 00:27:41.393 "cluster_size": 1073741824 00:27:41.393 }, 00:27:41.393 { 00:27:41.393 "uuid": "3b50a73b-c176-467c-8a41-89c423917392", 00:27:41.393 "name": "lvs_n_0", 00:27:41.393 "base_bdev": "1f124e4a-191a-4b86-ab9f-daf8709ba543", 00:27:41.393 "total_data_clusters": 237847, 00:27:41.393 "free_clusters": 237847, 00:27:41.393 "block_size": 512, 00:27:41.393 "cluster_size": 4194304 00:27:41.393 } 00:27:41.393 ]' 00:27:41.393 03:22:43 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="3b50a73b-c176-467c-8a41-89c423917392") .free_clusters' 00:27:41.393 03:22:43 -- common/autotest_common.sh@1358 -- # fc=237847 00:27:41.393 03:22:43 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="3b50a73b-c176-467c-8a41-89c423917392") .cluster_size' 00:27:41.393 03:22:43 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:41.393 03:22:43 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:27:41.393 03:22:43 -- common/autotest_common.sh@1363 -- # echo 951388 00:27:41.393 951388 00:27:41.393 03:22:43 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:41.962 80850be2-303e-452d-9470-c91cad1643a0 00:27:42.222 03:22:44 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:42.480 03:22:44 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:42.738 03:22:45 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:42.996 03:22:45 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:42.996 03:22:45 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:42.996 03:22:45 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:42.996 03:22:45 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:42.996 03:22:45 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:42.996 03:22:45 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:42.996 03:22:45 -- common/autotest_common.sh@1330 -- # shift 00:27:42.996 03:22:45 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:42.996 03:22:45 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:42.996 03:22:45 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:42.996 03:22:45 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:42.996 03:22:45 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:42.996 03:22:45 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:42.996 03:22:45 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:42.996 03:22:45 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:42.996 03:22:45 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:42.996 03:22:45 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:42.996 03:22:45 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:42.996 03:22:45 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:42.996 03:22:45 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:42.996 03:22:45 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:42.996 03:22:45 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:42.996 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:42.996 fio-3.35 00:27:42.996 Starting 1 thread 00:27:42.996 EAL: No free 2048 kB hugepages reported on node 1 00:27:45.525 00:27:45.525 test: (groupid=0, jobs=1): err= 0: pid=2559485: Wed Nov 27 03:22:48 2024 00:27:45.525 read: IOPS=5798, BW=22.6MiB/s (23.7MB/s)(46.4MiB/2050msec) 00:27:45.525 slat (nsec): min=1872, max=147143, avg=2497.45, stdev=2052.37 00:27:45.525 clat (usec): min=4178, max=59831, avg=12070.34, stdev=3203.39 00:27:45.525 lat (usec): min=4191, max=59834, avg=12072.84, stdev=3203.35 00:27:45.525 clat percentiles (usec): 00:27:45.525 | 1.00th=[ 9372], 5.00th=[10159], 10.00th=[10552], 20.00th=[11076], 00:27:45.525 | 30.00th=[11338], 40.00th=[11600], 50.00th=[11863], 60.00th=[12125], 00:27:45.525 | 70.00th=[12387], 80.00th=[12649], 90.00th=[13173], 95.00th=[13435], 00:27:45.525 | 99.00th=[14353], 99.50th=[49546], 99.90th=[57410], 99.95th=[58459], 00:27:45.525 | 99.99th=[60031] 00:27:45.525 bw ( KiB/s): min=22376, max=24320, per=100.00%, avg=23648.00, stdev=868.16, samples=4 00:27:45.525 iops : min= 5594, max= 6080, avg=5912.00, stdev=217.04, samples=4 00:27:45.525 write: IOPS=5796, BW=22.6MiB/s (23.7MB/s)(46.4MiB/2050msec); 0 zone resets 00:27:45.525 slat (nsec): min=1958, max=139385, avg=2623.70, stdev=1776.81 00:27:45.525 clat (usec): min=2038, max=58387, avg=9876.48, stdev=3388.11 00:27:45.525 lat (usec): min=2046, max=58390, avg=9879.11, stdev=3388.09 00:27:45.525 clat percentiles (usec): 00:27:45.525 | 1.00th=[ 7570], 5.00th=[ 8291], 10.00th=[ 8586], 20.00th=[ 8979], 00:27:45.525 | 30.00th=[ 9241], 40.00th=[ 9503], 50.00th=[ 9634], 60.00th=[ 9896], 00:27:45.525 | 70.00th=[10028], 80.00th=[10290], 90.00th=[10683], 95.00th=[10945], 00:27:45.525 | 99.00th=[11731], 99.50th=[50070], 99.90th=[57410], 99.95th=[57934], 00:27:45.525 | 99.99th=[58459] 00:27:45.525 bw ( KiB/s): min=23296, max=24192, per=100.00%, avg=23634.00, stdev=388.88, samples=4 00:27:45.525 iops : min= 5824, max= 6048, avg=5908.50, stdev=97.22, samples=4 00:27:45.525 lat (msec) : 4=0.04%, 10=35.08%, 20=64.35%, 50=0.10%, 100=0.44% 00:27:45.525 cpu : usr=62.96%, sys=35.48%, ctx=102, majf=0, minf=41 00:27:45.525 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:45.525 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:45.525 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:45.525 issued rwts: total=11886,11882,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:45.525 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:45.525 00:27:45.525 Run status group 0 (all jobs): 00:27:45.525 READ: bw=22.6MiB/s (23.7MB/s), 22.6MiB/s-22.6MiB/s (23.7MB/s-23.7MB/s), io=46.4MiB (48.7MB), run=2050-2050msec 00:27:45.525 WRITE: bw=22.6MiB/s (23.7MB/s), 22.6MiB/s-22.6MiB/s (23.7MB/s-23.7MB/s), io=46.4MiB (48.7MB), run=2050-2050msec 00:27:45.525 03:22:48 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:45.782 03:22:48 -- host/fio.sh@74 -- # sync 00:27:45.782 03:22:48 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:50.002 03:22:52 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:50.002 03:22:52 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:27:53.290 03:22:55 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:53.290 03:22:55 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:27:55.193 03:22:57 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:27:55.193 03:22:57 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:27:55.193 03:22:57 -- host/fio.sh@86 -- # nvmftestfini 00:27:55.193 03:22:57 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:55.193 03:22:57 -- nvmf/common.sh@116 -- # sync 00:27:55.193 03:22:57 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:55.193 03:22:57 -- nvmf/common.sh@119 -- # set +e 00:27:55.193 03:22:57 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:55.193 03:22:57 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:55.193 rmmod nvme_tcp 00:27:55.193 rmmod nvme_fabrics 00:27:55.193 rmmod nvme_keyring 00:27:55.193 03:22:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:55.193 03:22:57 -- nvmf/common.sh@123 -- # set -e 00:27:55.193 03:22:57 -- nvmf/common.sh@124 -- # return 0 00:27:55.193 03:22:57 -- nvmf/common.sh@477 -- # '[' -n 2556563 ']' 00:27:55.193 03:22:57 -- nvmf/common.sh@478 -- # killprocess 2556563 00:27:55.193 03:22:57 -- common/autotest_common.sh@936 -- # '[' -z 2556563 ']' 00:27:55.193 03:22:57 -- common/autotest_common.sh@940 -- # kill -0 2556563 00:27:55.193 03:22:57 -- common/autotest_common.sh@941 -- # uname 00:27:55.193 03:22:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:55.193 03:22:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2556563 00:27:55.193 03:22:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:55.193 03:22:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:55.193 03:22:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2556563' 00:27:55.193 killing process with pid 2556563 00:27:55.193 03:22:57 -- common/autotest_common.sh@955 -- # kill 2556563 00:27:55.193 03:22:57 -- common/autotest_common.sh@960 -- # wait 2556563 00:27:55.452 03:22:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:55.452 03:22:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:55.452 03:22:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:55.452 03:22:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:55.452 03:22:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:55.452 03:22:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:55.452 03:22:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:55.452 03:22:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:57.353 03:22:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:57.353 00:27:57.353 real 0m38.204s 00:27:57.353 user 2m26.637s 00:27:57.353 sys 0m7.179s 00:27:57.353 03:22:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:57.353 03:22:59 -- common/autotest_common.sh@10 -- # set +x 00:27:57.353 ************************************ 00:27:57.353 END TEST nvmf_fio_host 00:27:57.353 ************************************ 00:27:57.353 03:22:59 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:57.353 03:22:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:57.353 03:22:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:57.353 03:22:59 -- common/autotest_common.sh@10 -- # set +x 00:27:57.353 ************************************ 00:27:57.353 START TEST nvmf_failover 00:27:57.353 ************************************ 00:27:57.353 03:22:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:57.613 * Looking for test storage... 00:27:57.613 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:57.613 03:23:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:57.613 03:23:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:57.613 03:23:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:57.613 03:23:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:57.613 03:23:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:57.613 03:23:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:57.613 03:23:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:57.613 03:23:00 -- scripts/common.sh@335 -- # IFS=.-: 00:27:57.613 03:23:00 -- scripts/common.sh@335 -- # read -ra ver1 00:27:57.613 03:23:00 -- scripts/common.sh@336 -- # IFS=.-: 00:27:57.613 03:23:00 -- scripts/common.sh@336 -- # read -ra ver2 00:27:57.613 03:23:00 -- scripts/common.sh@337 -- # local 'op=<' 00:27:57.613 03:23:00 -- scripts/common.sh@339 -- # ver1_l=2 00:27:57.613 03:23:00 -- scripts/common.sh@340 -- # ver2_l=1 00:27:57.613 03:23:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:57.613 03:23:00 -- scripts/common.sh@343 -- # case "$op" in 00:27:57.613 03:23:00 -- scripts/common.sh@344 -- # : 1 00:27:57.613 03:23:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:57.613 03:23:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:57.613 03:23:00 -- scripts/common.sh@364 -- # decimal 1 00:27:57.613 03:23:00 -- scripts/common.sh@352 -- # local d=1 00:27:57.613 03:23:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:57.613 03:23:00 -- scripts/common.sh@354 -- # echo 1 00:27:57.613 03:23:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:57.613 03:23:00 -- scripts/common.sh@365 -- # decimal 2 00:27:57.613 03:23:00 -- scripts/common.sh@352 -- # local d=2 00:27:57.613 03:23:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:57.613 03:23:00 -- scripts/common.sh@354 -- # echo 2 00:27:57.613 03:23:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:57.613 03:23:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:57.613 03:23:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:57.613 03:23:00 -- scripts/common.sh@367 -- # return 0 00:27:57.613 03:23:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:57.613 03:23:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:57.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.613 --rc genhtml_branch_coverage=1 00:27:57.613 --rc genhtml_function_coverage=1 00:27:57.613 --rc genhtml_legend=1 00:27:57.613 --rc geninfo_all_blocks=1 00:27:57.613 --rc geninfo_unexecuted_blocks=1 00:27:57.613 00:27:57.613 ' 00:27:57.613 03:23:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:57.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.613 --rc genhtml_branch_coverage=1 00:27:57.613 --rc genhtml_function_coverage=1 00:27:57.613 --rc genhtml_legend=1 00:27:57.613 --rc geninfo_all_blocks=1 00:27:57.613 --rc geninfo_unexecuted_blocks=1 00:27:57.613 00:27:57.613 ' 00:27:57.613 03:23:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:57.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.613 --rc genhtml_branch_coverage=1 00:27:57.613 --rc genhtml_function_coverage=1 00:27:57.613 --rc genhtml_legend=1 00:27:57.613 --rc geninfo_all_blocks=1 00:27:57.613 --rc geninfo_unexecuted_blocks=1 00:27:57.613 00:27:57.613 ' 00:27:57.613 03:23:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:57.613 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:57.613 --rc genhtml_branch_coverage=1 00:27:57.613 --rc genhtml_function_coverage=1 00:27:57.613 --rc genhtml_legend=1 00:27:57.613 --rc geninfo_all_blocks=1 00:27:57.613 --rc geninfo_unexecuted_blocks=1 00:27:57.613 00:27:57.613 ' 00:27:57.613 03:23:00 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:57.613 03:23:00 -- nvmf/common.sh@7 -- # uname -s 00:27:57.613 03:23:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:57.613 03:23:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:57.613 03:23:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:57.613 03:23:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:57.613 03:23:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:57.613 03:23:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:57.613 03:23:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:57.613 03:23:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:57.613 03:23:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:57.613 03:23:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:57.613 03:23:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:57.613 03:23:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:57.613 03:23:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:57.613 03:23:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:57.613 03:23:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:57.613 03:23:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:57.613 03:23:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:57.613 03:23:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:57.613 03:23:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:57.613 03:23:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.613 03:23:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.614 03:23:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.614 03:23:00 -- paths/export.sh@5 -- # export PATH 00:27:57.614 03:23:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:57.614 03:23:00 -- nvmf/common.sh@46 -- # : 0 00:27:57.614 03:23:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:57.614 03:23:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:57.614 03:23:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:57.614 03:23:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:57.614 03:23:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:57.614 03:23:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:57.614 03:23:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:57.614 03:23:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:57.614 03:23:00 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:57.614 03:23:00 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:57.614 03:23:00 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:57.614 03:23:00 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:57.614 03:23:00 -- host/failover.sh@18 -- # nvmftestinit 00:27:57.614 03:23:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:57.614 03:23:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:57.614 03:23:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:57.614 03:23:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:57.614 03:23:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:57.614 03:23:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:57.614 03:23:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:57.614 03:23:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:57.614 03:23:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:57.614 03:23:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:57.614 03:23:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:57.614 03:23:00 -- common/autotest_common.sh@10 -- # set +x 00:28:00.153 03:23:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:00.153 03:23:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:00.153 03:23:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:00.153 03:23:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:00.153 03:23:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:00.153 03:23:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:00.153 03:23:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:00.153 03:23:02 -- nvmf/common.sh@294 -- # net_devs=() 00:28:00.153 03:23:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:00.153 03:23:02 -- nvmf/common.sh@295 -- # e810=() 00:28:00.153 03:23:02 -- nvmf/common.sh@295 -- # local -ga e810 00:28:00.153 03:23:02 -- nvmf/common.sh@296 -- # x722=() 00:28:00.153 03:23:02 -- nvmf/common.sh@296 -- # local -ga x722 00:28:00.153 03:23:02 -- nvmf/common.sh@297 -- # mlx=() 00:28:00.153 03:23:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:00.153 03:23:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:00.153 03:23:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:00.153 03:23:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:00.153 03:23:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:00.153 03:23:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:00.153 03:23:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:00.153 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:00.153 03:23:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:00.153 03:23:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:00.153 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:00.153 03:23:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:00.153 03:23:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:00.153 03:23:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:00.153 03:23:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:00.153 03:23:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:00.153 03:23:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:00.153 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:00.153 03:23:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:00.153 03:23:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:00.153 03:23:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:00.153 03:23:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:00.153 03:23:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:00.153 03:23:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:00.153 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:00.153 03:23:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:00.153 03:23:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:00.153 03:23:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:00.153 03:23:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:00.153 03:23:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:00.153 03:23:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:00.153 03:23:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:00.153 03:23:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:00.153 03:23:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:00.153 03:23:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:00.153 03:23:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:00.153 03:23:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:00.153 03:23:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:00.153 03:23:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:00.153 03:23:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:00.153 03:23:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:00.153 03:23:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:00.153 03:23:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:00.153 03:23:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:00.153 03:23:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:00.153 03:23:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:00.153 03:23:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:00.153 03:23:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:00.153 03:23:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:00.153 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:00.153 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:28:00.153 00:28:00.153 --- 10.0.0.2 ping statistics --- 00:28:00.153 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:00.153 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:28:00.153 03:23:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:00.153 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:00.153 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:28:00.153 00:28:00.153 --- 10.0.0.1 ping statistics --- 00:28:00.153 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:00.153 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:28:00.153 03:23:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:00.153 03:23:02 -- nvmf/common.sh@410 -- # return 0 00:28:00.153 03:23:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:00.153 03:23:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:00.153 03:23:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:00.153 03:23:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:00.153 03:23:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:00.153 03:23:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:00.153 03:23:02 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:00.153 03:23:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:00.153 03:23:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:00.153 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:28:00.153 03:23:02 -- nvmf/common.sh@469 -- # nvmfpid=2562913 00:28:00.153 03:23:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:00.153 03:23:02 -- nvmf/common.sh@470 -- # waitforlisten 2562913 00:28:00.153 03:23:02 -- common/autotest_common.sh@829 -- # '[' -z 2562913 ']' 00:28:00.153 03:23:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:00.153 03:23:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:00.153 03:23:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:00.153 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:00.153 03:23:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:00.153 03:23:02 -- common/autotest_common.sh@10 -- # set +x 00:28:00.153 [2024-11-27 03:23:02.411756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:00.153 [2024-11-27 03:23:02.411828] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:00.153 EAL: No free 2048 kB hugepages reported on node 1 00:28:00.153 [2024-11-27 03:23:02.481241] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:00.153 [2024-11-27 03:23:02.569638] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:00.153 [2024-11-27 03:23:02.569820] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:00.153 [2024-11-27 03:23:02.569840] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:00.154 [2024-11-27 03:23:02.569855] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:00.154 [2024-11-27 03:23:02.569939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:00.154 [2024-11-27 03:23:02.570055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:00.154 [2024-11-27 03:23:02.570058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:01.088 03:23:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:01.088 03:23:03 -- common/autotest_common.sh@862 -- # return 0 00:28:01.088 03:23:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:01.088 03:23:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:01.088 03:23:03 -- common/autotest_common.sh@10 -- # set +x 00:28:01.088 03:23:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:01.088 03:23:03 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:01.088 [2024-11-27 03:23:03.636027] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:01.088 03:23:03 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:01.345 Malloc0 00:28:01.345 03:23:03 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:01.603 03:23:04 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:01.863 03:23:04 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:02.429 [2024-11-27 03:23:04.761198] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:02.429 03:23:04 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:02.686 [2024-11-27 03:23:05.062069] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:02.686 03:23:05 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:02.944 [2024-11-27 03:23:05.359133] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:02.944 03:23:05 -- host/failover.sh@31 -- # bdevperf_pid=2563230 00:28:02.944 03:23:05 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:02.944 03:23:05 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:02.944 03:23:05 -- host/failover.sh@34 -- # waitforlisten 2563230 /var/tmp/bdevperf.sock 00:28:02.944 03:23:05 -- common/autotest_common.sh@829 -- # '[' -z 2563230 ']' 00:28:02.944 03:23:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:02.944 03:23:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:02.944 03:23:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:02.944 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:02.944 03:23:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:02.944 03:23:05 -- common/autotest_common.sh@10 -- # set +x 00:28:03.880 03:23:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:03.880 03:23:06 -- common/autotest_common.sh@862 -- # return 0 00:28:03.880 03:23:06 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:04.449 NVMe0n1 00:28:04.449 03:23:06 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:04.708 00:28:04.708 03:23:07 -- host/failover.sh@39 -- # run_test_pid=2563496 00:28:04.708 03:23:07 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:04.708 03:23:07 -- host/failover.sh@41 -- # sleep 1 00:28:05.644 03:23:08 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:05.904 [2024-11-27 03:23:08.436134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436306] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436330] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436341] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436396] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.904 [2024-11-27 03:23:08.436581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.905 [2024-11-27 03:23:08.436593] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.905 [2024-11-27 03:23:08.436605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.905 [2024-11-27 03:23:08.436617] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c37930 is same with the state(5) to be set 00:28:05.905 03:23:08 -- host/failover.sh@45 -- # sleep 3 00:28:09.187 03:23:11 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:09.446 00:28:09.446 03:23:11 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:09.707 [2024-11-27 03:23:12.235275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235333] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 [2024-11-27 03:23:12.235579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c387c0 is same with the state(5) to be set 00:28:09.707 03:23:12 -- host/failover.sh@50 -- # sleep 3 00:28:12.995 03:23:15 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:12.995 [2024-11-27 03:23:15.550938] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:12.995 03:23:15 -- host/failover.sh@55 -- # sleep 1 00:28:14.374 03:23:16 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:14.374 [2024-11-27 03:23:16.835200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835345] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835438] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835495] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835506] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 [2024-11-27 03:23:16.835517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c39310 is same with the state(5) to be set 00:28:14.374 03:23:16 -- host/failover.sh@59 -- # wait 2563496 00:28:20.947 0 00:28:20.947 03:23:22 -- host/failover.sh@61 -- # killprocess 2563230 00:28:20.947 03:23:22 -- common/autotest_common.sh@936 -- # '[' -z 2563230 ']' 00:28:20.947 03:23:22 -- common/autotest_common.sh@940 -- # kill -0 2563230 00:28:20.947 03:23:22 -- common/autotest_common.sh@941 -- # uname 00:28:20.947 03:23:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:20.947 03:23:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2563230 00:28:20.947 03:23:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:20.947 03:23:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:20.947 03:23:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2563230' 00:28:20.947 killing process with pid 2563230 00:28:20.947 03:23:22 -- common/autotest_common.sh@955 -- # kill 2563230 00:28:20.947 03:23:22 -- common/autotest_common.sh@960 -- # wait 2563230 00:28:20.947 03:23:22 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:20.947 [2024-11-27 03:23:05.419764] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:20.947 [2024-11-27 03:23:05.419866] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2563230 ] 00:28:20.947 EAL: No free 2048 kB hugepages reported on node 1 00:28:20.947 [2024-11-27 03:23:05.485017] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:20.947 [2024-11-27 03:23:05.571251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:20.947 Running I/O for 15 seconds... 00:28:20.947 [2024-11-27 03:23:08.436936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:117520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.436980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:117536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:117544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:117552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:117560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:117568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:117584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:117600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:117608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:117624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:117640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:117656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:117024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:117040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:117072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:117080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:117096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:117112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:117128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:117144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:117672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.947 [2024-11-27 03:23:08.437617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.947 [2024-11-27 03:23:08.437632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:117680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.437646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:117696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.437675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:117704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.437709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:117712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.437739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:117720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.437768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:117728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.437796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:117736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.437825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:117744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.437853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:117752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.437882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:117760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.437910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:117768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.437937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:117776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.437974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.437989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:117784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:117792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:117800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:117808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:117176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:117216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:117224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:117232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:117264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:117272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:117280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:117320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:117336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:117352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:117360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:117368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:117376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:117384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:117392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:117448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:117816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.438582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:117824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.438610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:117832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.438637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:117840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.948 [2024-11-27 03:23:08.438665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:117848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.438692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:117856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.438720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.948 [2024-11-27 03:23:08.438734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:117864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.948 [2024-11-27 03:23:08.438747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.438762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:117872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.438775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.438794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:117880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.438807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.438822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:117888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.438835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.438849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:117896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.438863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.438877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:117904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.438891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.438905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:117912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.438918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.438933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:117920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.438946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.438960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:117928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.438973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.438988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:117936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:117944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:117952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:117960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:117968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:117976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:117984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:117992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:118000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:118008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:118016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:118024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:118032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:118040 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:118048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:118056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:118064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:118072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:118080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:118088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:118096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:118104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:118112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:118120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:118128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:118136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:118144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:118152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:118160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:118168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.949 [2024-11-27 03:23:08.439842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:118176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.949 [2024-11-27 03:23:08.439870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.949 [2024-11-27 03:23:08.439888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:118184 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.950 [2024-11-27 03:23:08.439902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.439917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:118192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.950 [2024-11-27 03:23:08.439930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.439945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:118200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.950 [2024-11-27 03:23:08.439959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.439974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:118208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.439987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:118216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.950 [2024-11-27 03:23:08.440016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:118224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:118232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:118240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.950 [2024-11-27 03:23:08.440101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:118248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.950 [2024-11-27 03:23:08.440129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:118256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.950 [2024-11-27 03:23:08.440157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:118264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.950 [2024-11-27 03:23:08.440190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:118272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.950 [2024-11-27 03:23:08.440218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:118280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:117456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:117464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:117472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:117480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:117488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:117496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:117504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:117512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:117528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:117576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:117592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:117616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:117632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:117648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:117664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:08.440685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18f6c60 is same with the state(5) to be set 00:28:20.950 [2024-11-27 03:23:08.440716] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:20.950 [2024-11-27 03:23:08.440727] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:20.950 [2024-11-27 03:23:08.440738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:117688 len:8 PRP1 0x0 PRP2 0x0 00:28:20.950 [2024-11-27 03:23:08.440752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440814] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x18f6c60 was disconnected and freed. reset controller. 00:28:20.950 [2024-11-27 03:23:08.440839] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:20.950 [2024-11-27 03:23:08.440874] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.950 [2024-11-27 03:23:08.440893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440907] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.950 [2024-11-27 03:23:08.440920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440934] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.950 [2024-11-27 03:23:08.440946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440959] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.950 [2024-11-27 03:23:08.440972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:08.440985] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:20.950 [2024-11-27 03:23:08.443301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:20.950 [2024-11-27 03:23:08.443338] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d8000 (9): Bad file descriptor 00:28:20.950 [2024-11-27 03:23:08.479167] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:20.950 [2024-11-27 03:23:12.235700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:124088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.950 [2024-11-27 03:23:12.235745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.950 [2024-11-27 03:23:12.235779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:124096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.235796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.235812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:124112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.235826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.235848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:124120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.235861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.235876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:124128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.235889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.235911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:124136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.235925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.235955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:123592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.235969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.235983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:123600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.235996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:123616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:123640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:123648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:123656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:123672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:123680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:124152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:124160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:124176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:124192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:124208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:124232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.951 [2024-11-27 03:23:12.236326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:124240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.951 [2024-11-27 03:23:12.236352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:124248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:124256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:124264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:124272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.951 [2024-11-27 03:23:12.236461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:124280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:124288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.951 [2024-11-27 03:23:12.236519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:123688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:123712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:123728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:123736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:123752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.951 [2024-11-27 03:23:12.236684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:123760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.951 [2024-11-27 03:23:12.236698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:123784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.236724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:123792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.236752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:124296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.236779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:124304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.236805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:124312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.236841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:124320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.236871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:124328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.236899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:124336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.236926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:124344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.236952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:124352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.236979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.236994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:124360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:124368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.237033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:124376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:124384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:123800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:123816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:123840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:123856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:123864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:123872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:123888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:123920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:124392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.237333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:124400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:124408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.237386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:124416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:124424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:124432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:124440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.237496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:124448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.237548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:124456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:124464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:124472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.237646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:124480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:124488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:124496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.952 [2024-11-27 03:23:12.237731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:123928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:123936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:123944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.952 [2024-11-27 03:23:12.237815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.952 [2024-11-27 03:23:12.237846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:123952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.237859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.237874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:124032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.237887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.237911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:124040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.237924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.237939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:124048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.237951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.237966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:124056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.237982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.237997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:124504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:124512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:124520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:124528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:124536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:124544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:124552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:124560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:124568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:124576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:124584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:124592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:124600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:124608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:124616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:124624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:124632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:124640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:124648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:124656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:124664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:124672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:124680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:124688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:124696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:124704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:124712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:124720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:124728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:124736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:124744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:124752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.238918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:124760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.238957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:124768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.953 [2024-11-27 03:23:12.238986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.239001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:124776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.953 [2024-11-27 03:23:12.239013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.953 [2024-11-27 03:23:12.239027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:124784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.954 [2024-11-27 03:23:12.239041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:124792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.954 [2024-11-27 03:23:12.239069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:124800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.954 [2024-11-27 03:23:12.239101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:124808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.954 [2024-11-27 03:23:12.239129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:124816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:12.239156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:124824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.954 [2024-11-27 03:23:12.239184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:124832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.954 [2024-11-27 03:23:12.239211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:124840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:12.239239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:124080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:12.239267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:124104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:12.239295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:124144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:12.239323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:124168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:12.239351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:124184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:12.239379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:124200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:12.239407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:124216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:12.239435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18e44b0 is same with the state(5) to be set 00:28:20.954 [2024-11-27 03:23:12.239469] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:20.954 [2024-11-27 03:23:12.239480] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:20.954 [2024-11-27 03:23:12.239492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:124224 len:8 PRP1 0x0 PRP2 0x0 00:28:20.954 [2024-11-27 03:23:12.239505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239571] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x18e44b0 was disconnected and freed. reset controller. 00:28:20.954 [2024-11-27 03:23:12.239599] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:20.954 [2024-11-27 03:23:12.239632] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.954 [2024-11-27 03:23:12.239650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239665] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.954 [2024-11-27 03:23:12.239678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239691] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.954 [2024-11-27 03:23:12.239704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239717] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.954 [2024-11-27 03:23:12.239730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:12.239743] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:20.954 [2024-11-27 03:23:12.241845] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:20.954 [2024-11-27 03:23:12.241883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d8000 (9): Bad file descriptor 00:28:20.954 [2024-11-27 03:23:12.314421] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:20.954 [2024-11-27 03:23:16.835639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:65344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:65360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:65368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:65376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:65384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:65400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:65456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:65464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:65480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:65488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.835983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:65504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.835996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.836011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:65512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.836023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.836037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:65544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.836050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.836065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:65560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.836078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.836092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:65568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.836104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.836119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:65576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.954 [2024-11-27 03:23:16.836132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.954 [2024-11-27 03:23:16.836146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:65584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.954 [2024-11-27 03:23:16.836168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:65592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:65600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:65608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.955 [2024-11-27 03:23:16.836258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:65616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:65624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:64928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:64944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:64952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:64976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:64984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:65000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:65008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:65016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:65024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:65056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:65064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:65088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:65096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:65104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:65112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:65120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:65128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:65136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:65144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:65168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:65200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:65208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.836978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.836992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:65224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.837005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:65232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.837031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:65632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.837057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:65640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.837084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:65648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.955 [2024-11-27 03:23:16.837111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:65656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.837138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:65664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.837164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:65672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.837190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:65680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.955 [2024-11-27 03:23:16.837217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:65688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.955 [2024-11-27 03:23:16.837243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:65696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.955 [2024-11-27 03:23:16.837276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:65704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.955 [2024-11-27 03:23:16.837303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.955 [2024-11-27 03:23:16.837318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:65712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.955 [2024-11-27 03:23:16.837330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:65720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:65728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:65736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:65744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:65752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:65760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:65768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:65776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:65784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:65792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:65800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:65808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:65816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:65824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:65832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:65840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:65848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:65856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:65864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:65872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:65880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.956 [2024-11-27 03:23:16.837972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.837987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:65888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.837999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:65896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:65904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:65912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:65920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:65928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:65936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:65240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:65248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:65256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:65272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:65280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:65288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.956 [2024-11-27 03:23:16.838346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:65296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.956 [2024-11-27 03:23:16.838360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:65304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:65944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:65952 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:65960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:65968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:65976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:65984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:65992 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:66000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:66008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:66016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:66024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:66032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:66040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:66048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:66056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:66064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.838886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:66072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:66080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:66088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:20.957 [2024-11-27 03:23:16.838983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.838997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:65328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:65336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:65352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:65392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:65408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:65416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:65424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:65432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:65440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:65448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:65472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:65496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:65520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:65528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:65536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:20.957 [2024-11-27 03:23:16.839402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839416] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18fa4b0 is same with the state(5) to be set 00:28:20.957 [2024-11-27 03:23:16.839431] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:20.957 [2024-11-27 03:23:16.839443] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:20.957 [2024-11-27 03:23:16.839454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:65552 len:8 PRP1 0x0 PRP2 0x0 00:28:20.957 [2024-11-27 03:23:16.839467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839542] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x18fa4b0 was disconnected and freed. reset controller. 00:28:20.957 [2024-11-27 03:23:16.839561] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:20.957 [2024-11-27 03:23:16.839597] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.957 [2024-11-27 03:23:16.839616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.957 [2024-11-27 03:23:16.839630] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.958 [2024-11-27 03:23:16.839643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.958 [2024-11-27 03:23:16.839658] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.958 [2024-11-27 03:23:16.839680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.958 [2024-11-27 03:23:16.839701] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:20.958 [2024-11-27 03:23:16.839714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:20.958 [2024-11-27 03:23:16.839727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:20.958 [2024-11-27 03:23:16.841879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:20.958 [2024-11-27 03:23:16.841917] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18d8000 (9): Bad file descriptor 00:28:20.958 [2024-11-27 03:23:16.878113] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:20.958 00:28:20.958 Latency(us) 00:28:20.958 [2024-11-27T02:23:23.577Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:20.958 [2024-11-27T02:23:23.577Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:20.958 Verification LBA range: start 0x0 length 0x4000 00:28:20.958 NVMe0n1 : 15.01 12486.78 48.78 546.19 0.00 9804.23 634.12 16311.18 00:28:20.958 [2024-11-27T02:23:23.577Z] =================================================================================================================== 00:28:20.958 [2024-11-27T02:23:23.577Z] Total : 12486.78 48.78 546.19 0.00 9804.23 634.12 16311.18 00:28:20.958 Received shutdown signal, test time was about 15.000000 seconds 00:28:20.958 00:28:20.958 Latency(us) 00:28:20.958 [2024-11-27T02:23:23.577Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:20.958 [2024-11-27T02:23:23.577Z] =================================================================================================================== 00:28:20.958 [2024-11-27T02:23:23.577Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:20.958 03:23:22 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:20.958 03:23:22 -- host/failover.sh@65 -- # count=3 00:28:20.958 03:23:22 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:20.958 03:23:22 -- host/failover.sh@73 -- # bdevperf_pid=2565390 00:28:20.958 03:23:22 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:20.958 03:23:22 -- host/failover.sh@75 -- # waitforlisten 2565390 /var/tmp/bdevperf.sock 00:28:20.958 03:23:22 -- common/autotest_common.sh@829 -- # '[' -z 2565390 ']' 00:28:20.958 03:23:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:20.958 03:23:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:20.958 03:23:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:20.958 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:20.958 03:23:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:20.958 03:23:22 -- common/autotest_common.sh@10 -- # set +x 00:28:21.216 03:23:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:21.216 03:23:23 -- common/autotest_common.sh@862 -- # return 0 00:28:21.217 03:23:23 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:21.475 [2024-11-27 03:23:23.906408] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:21.475 03:23:23 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:21.733 [2024-11-27 03:23:24.151132] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:21.733 03:23:24 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:21.991 NVMe0n1 00:28:21.991 03:23:24 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:22.249 00:28:22.249 03:23:24 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:22.817 00:28:22.817 03:23:25 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:22.817 03:23:25 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:23.075 03:23:25 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:23.362 03:23:25 -- host/failover.sh@87 -- # sleep 3 00:28:26.683 03:23:28 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:26.683 03:23:28 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:26.684 03:23:28 -- host/failover.sh@90 -- # run_test_pid=2566103 00:28:26.684 03:23:28 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:26.684 03:23:28 -- host/failover.sh@92 -- # wait 2566103 00:28:27.624 0 00:28:27.624 03:23:30 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:27.624 [2024-11-27 03:23:22.660628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:27.624 [2024-11-27 03:23:22.660718] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2565390 ] 00:28:27.624 EAL: No free 2048 kB hugepages reported on node 1 00:28:27.624 [2024-11-27 03:23:22.720168] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:27.624 [2024-11-27 03:23:22.801434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:27.624 [2024-11-27 03:23:25.676004] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:27.624 [2024-11-27 03:23:25.676086] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:27.624 [2024-11-27 03:23:25.676110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:27.624 [2024-11-27 03:23:25.676134] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:27.624 [2024-11-27 03:23:25.676148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:27.624 [2024-11-27 03:23:25.676162] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:27.624 [2024-11-27 03:23:25.676176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:27.624 [2024-11-27 03:23:25.676189] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:27.624 [2024-11-27 03:23:25.676210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:27.624 [2024-11-27 03:23:25.676223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:27.624 [2024-11-27 03:23:25.676260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:27.624 [2024-11-27 03:23:25.676289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd37000 (9): Bad file descriptor 00:28:27.624 [2024-11-27 03:23:25.680053] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:27.624 Running I/O for 1 seconds... 00:28:27.624 00:28:27.624 Latency(us) 00:28:27.624 [2024-11-27T02:23:30.243Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:27.624 [2024-11-27T02:23:30.243Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:27.624 Verification LBA range: start 0x0 length 0x4000 00:28:27.624 NVMe0n1 : 1.01 12687.21 49.56 0.00 0.00 10041.02 1152.95 12136.30 00:28:27.624 [2024-11-27T02:23:30.243Z] =================================================================================================================== 00:28:27.624 [2024-11-27T02:23:30.243Z] Total : 12687.21 49.56 0.00 0.00 10041.02 1152.95 12136.30 00:28:27.624 03:23:30 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:27.624 03:23:30 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:27.883 03:23:30 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:28.141 03:23:30 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:28.141 03:23:30 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:28.400 03:23:30 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:28.658 03:23:31 -- host/failover.sh@101 -- # sleep 3 00:28:31.950 03:23:34 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:31.950 03:23:34 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:31.950 03:23:34 -- host/failover.sh@108 -- # killprocess 2565390 00:28:31.950 03:23:34 -- common/autotest_common.sh@936 -- # '[' -z 2565390 ']' 00:28:31.950 03:23:34 -- common/autotest_common.sh@940 -- # kill -0 2565390 00:28:31.950 03:23:34 -- common/autotest_common.sh@941 -- # uname 00:28:31.950 03:23:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:31.950 03:23:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2565390 00:28:31.950 03:23:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:31.950 03:23:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:31.950 03:23:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2565390' 00:28:31.950 killing process with pid 2565390 00:28:31.950 03:23:34 -- common/autotest_common.sh@955 -- # kill 2565390 00:28:31.950 03:23:34 -- common/autotest_common.sh@960 -- # wait 2565390 00:28:32.208 03:23:34 -- host/failover.sh@110 -- # sync 00:28:32.208 03:23:34 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:32.466 03:23:34 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:32.466 03:23:34 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:32.466 03:23:34 -- host/failover.sh@116 -- # nvmftestfini 00:28:32.466 03:23:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:32.466 03:23:34 -- nvmf/common.sh@116 -- # sync 00:28:32.466 03:23:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:32.466 03:23:34 -- nvmf/common.sh@119 -- # set +e 00:28:32.466 03:23:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:32.466 03:23:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:32.466 rmmod nvme_tcp 00:28:32.466 rmmod nvme_fabrics 00:28:32.466 rmmod nvme_keyring 00:28:32.466 03:23:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:32.466 03:23:35 -- nvmf/common.sh@123 -- # set -e 00:28:32.466 03:23:35 -- nvmf/common.sh@124 -- # return 0 00:28:32.466 03:23:35 -- nvmf/common.sh@477 -- # '[' -n 2562913 ']' 00:28:32.466 03:23:35 -- nvmf/common.sh@478 -- # killprocess 2562913 00:28:32.466 03:23:35 -- common/autotest_common.sh@936 -- # '[' -z 2562913 ']' 00:28:32.466 03:23:35 -- common/autotest_common.sh@940 -- # kill -0 2562913 00:28:32.466 03:23:35 -- common/autotest_common.sh@941 -- # uname 00:28:32.466 03:23:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:32.466 03:23:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2562913 00:28:32.466 03:23:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:32.466 03:23:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:32.466 03:23:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2562913' 00:28:32.466 killing process with pid 2562913 00:28:32.466 03:23:35 -- common/autotest_common.sh@955 -- # kill 2562913 00:28:32.466 03:23:35 -- common/autotest_common.sh@960 -- # wait 2562913 00:28:32.726 03:23:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:32.726 03:23:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:32.726 03:23:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:32.726 03:23:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:32.726 03:23:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:32.726 03:23:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:32.726 03:23:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:32.726 03:23:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:35.271 03:23:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:35.271 00:28:35.271 real 0m37.382s 00:28:35.271 user 2m11.630s 00:28:35.271 sys 0m6.401s 00:28:35.271 03:23:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:35.271 03:23:37 -- common/autotest_common.sh@10 -- # set +x 00:28:35.271 ************************************ 00:28:35.271 END TEST nvmf_failover 00:28:35.271 ************************************ 00:28:35.271 03:23:37 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:35.271 03:23:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:35.271 03:23:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:35.271 03:23:37 -- common/autotest_common.sh@10 -- # set +x 00:28:35.271 ************************************ 00:28:35.271 START TEST nvmf_discovery 00:28:35.271 ************************************ 00:28:35.271 03:23:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:35.271 * Looking for test storage... 00:28:35.271 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:35.271 03:23:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:35.271 03:23:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:35.271 03:23:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:35.271 03:23:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:35.271 03:23:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:35.271 03:23:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:35.272 03:23:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:35.272 03:23:37 -- scripts/common.sh@335 -- # IFS=.-: 00:28:35.272 03:23:37 -- scripts/common.sh@335 -- # read -ra ver1 00:28:35.272 03:23:37 -- scripts/common.sh@336 -- # IFS=.-: 00:28:35.272 03:23:37 -- scripts/common.sh@336 -- # read -ra ver2 00:28:35.272 03:23:37 -- scripts/common.sh@337 -- # local 'op=<' 00:28:35.272 03:23:37 -- scripts/common.sh@339 -- # ver1_l=2 00:28:35.272 03:23:37 -- scripts/common.sh@340 -- # ver2_l=1 00:28:35.272 03:23:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:35.272 03:23:37 -- scripts/common.sh@343 -- # case "$op" in 00:28:35.272 03:23:37 -- scripts/common.sh@344 -- # : 1 00:28:35.272 03:23:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:35.272 03:23:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:35.272 03:23:37 -- scripts/common.sh@364 -- # decimal 1 00:28:35.272 03:23:37 -- scripts/common.sh@352 -- # local d=1 00:28:35.272 03:23:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:35.272 03:23:37 -- scripts/common.sh@354 -- # echo 1 00:28:35.272 03:23:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:35.272 03:23:37 -- scripts/common.sh@365 -- # decimal 2 00:28:35.272 03:23:37 -- scripts/common.sh@352 -- # local d=2 00:28:35.272 03:23:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:35.272 03:23:37 -- scripts/common.sh@354 -- # echo 2 00:28:35.272 03:23:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:35.272 03:23:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:35.272 03:23:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:35.272 03:23:37 -- scripts/common.sh@367 -- # return 0 00:28:35.272 03:23:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:35.272 03:23:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:35.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:35.272 --rc genhtml_branch_coverage=1 00:28:35.272 --rc genhtml_function_coverage=1 00:28:35.272 --rc genhtml_legend=1 00:28:35.272 --rc geninfo_all_blocks=1 00:28:35.272 --rc geninfo_unexecuted_blocks=1 00:28:35.272 00:28:35.272 ' 00:28:35.272 03:23:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:35.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:35.272 --rc genhtml_branch_coverage=1 00:28:35.272 --rc genhtml_function_coverage=1 00:28:35.272 --rc genhtml_legend=1 00:28:35.272 --rc geninfo_all_blocks=1 00:28:35.272 --rc geninfo_unexecuted_blocks=1 00:28:35.272 00:28:35.272 ' 00:28:35.272 03:23:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:35.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:35.272 --rc genhtml_branch_coverage=1 00:28:35.272 --rc genhtml_function_coverage=1 00:28:35.272 --rc genhtml_legend=1 00:28:35.272 --rc geninfo_all_blocks=1 00:28:35.272 --rc geninfo_unexecuted_blocks=1 00:28:35.272 00:28:35.272 ' 00:28:35.272 03:23:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:35.272 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:35.272 --rc genhtml_branch_coverage=1 00:28:35.272 --rc genhtml_function_coverage=1 00:28:35.272 --rc genhtml_legend=1 00:28:35.272 --rc geninfo_all_blocks=1 00:28:35.272 --rc geninfo_unexecuted_blocks=1 00:28:35.272 00:28:35.272 ' 00:28:35.272 03:23:37 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:35.272 03:23:37 -- nvmf/common.sh@7 -- # uname -s 00:28:35.272 03:23:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:35.272 03:23:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:35.272 03:23:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:35.272 03:23:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:35.272 03:23:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:35.272 03:23:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:35.272 03:23:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:35.272 03:23:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:35.272 03:23:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:35.272 03:23:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:35.272 03:23:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:35.272 03:23:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:35.272 03:23:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:35.272 03:23:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:35.272 03:23:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:35.272 03:23:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:35.272 03:23:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:35.272 03:23:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:35.272 03:23:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:35.272 03:23:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:35.272 03:23:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:35.272 03:23:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:35.272 03:23:37 -- paths/export.sh@5 -- # export PATH 00:28:35.272 03:23:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:35.272 03:23:37 -- nvmf/common.sh@46 -- # : 0 00:28:35.272 03:23:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:35.272 03:23:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:35.272 03:23:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:35.272 03:23:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:35.272 03:23:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:35.272 03:23:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:35.272 03:23:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:35.272 03:23:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:35.272 03:23:37 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:35.272 03:23:37 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:35.272 03:23:37 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:35.272 03:23:37 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:35.272 03:23:37 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:35.272 03:23:37 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:35.272 03:23:37 -- host/discovery.sh@25 -- # nvmftestinit 00:28:35.272 03:23:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:35.272 03:23:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:35.272 03:23:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:35.272 03:23:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:35.272 03:23:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:35.272 03:23:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:35.272 03:23:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:35.272 03:23:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:35.272 03:23:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:35.272 03:23:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:35.272 03:23:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:35.272 03:23:37 -- common/autotest_common.sh@10 -- # set +x 00:28:37.182 03:23:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:37.183 03:23:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:37.183 03:23:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:37.183 03:23:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:37.183 03:23:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:37.183 03:23:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:37.183 03:23:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:37.183 03:23:39 -- nvmf/common.sh@294 -- # net_devs=() 00:28:37.183 03:23:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:37.183 03:23:39 -- nvmf/common.sh@295 -- # e810=() 00:28:37.183 03:23:39 -- nvmf/common.sh@295 -- # local -ga e810 00:28:37.183 03:23:39 -- nvmf/common.sh@296 -- # x722=() 00:28:37.183 03:23:39 -- nvmf/common.sh@296 -- # local -ga x722 00:28:37.183 03:23:39 -- nvmf/common.sh@297 -- # mlx=() 00:28:37.183 03:23:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:37.183 03:23:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:37.183 03:23:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:37.183 03:23:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:37.183 03:23:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:37.183 03:23:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:37.183 03:23:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:37.183 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:37.183 03:23:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:37.183 03:23:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:37.183 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:37.183 03:23:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:37.183 03:23:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:37.183 03:23:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:37.183 03:23:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:37.183 03:23:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:37.183 03:23:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:37.183 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:37.183 03:23:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:37.183 03:23:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:37.183 03:23:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:37.183 03:23:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:37.183 03:23:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:37.183 03:23:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:37.183 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:37.183 03:23:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:37.183 03:23:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:37.183 03:23:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:37.183 03:23:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:37.183 03:23:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:37.183 03:23:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:37.183 03:23:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:37.183 03:23:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:37.183 03:23:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:37.183 03:23:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:37.183 03:23:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:37.183 03:23:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:37.183 03:23:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:37.183 03:23:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:37.183 03:23:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:37.183 03:23:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:37.183 03:23:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:37.183 03:23:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:37.183 03:23:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:37.183 03:23:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:37.183 03:23:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:37.183 03:23:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:37.183 03:23:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:37.183 03:23:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:37.183 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:37.183 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:28:37.183 00:28:37.183 --- 10.0.0.2 ping statistics --- 00:28:37.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:37.183 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:28:37.183 03:23:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:37.183 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:37.183 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:28:37.183 00:28:37.183 --- 10.0.0.1 ping statistics --- 00:28:37.183 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:37.183 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:28:37.183 03:23:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:37.183 03:23:39 -- nvmf/common.sh@410 -- # return 0 00:28:37.183 03:23:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:37.183 03:23:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:37.183 03:23:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:37.183 03:23:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:37.183 03:23:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:37.183 03:23:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:37.183 03:23:39 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:37.183 03:23:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:37.183 03:23:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:37.183 03:23:39 -- common/autotest_common.sh@10 -- # set +x 00:28:37.183 03:23:39 -- nvmf/common.sh@469 -- # nvmfpid=2568864 00:28:37.183 03:23:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:37.183 03:23:39 -- nvmf/common.sh@470 -- # waitforlisten 2568864 00:28:37.183 03:23:39 -- common/autotest_common.sh@829 -- # '[' -z 2568864 ']' 00:28:37.183 03:23:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:37.183 03:23:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:37.183 03:23:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:37.183 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:37.183 03:23:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:37.183 03:23:39 -- common/autotest_common.sh@10 -- # set +x 00:28:37.183 [2024-11-27 03:23:39.717619] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:37.183 [2024-11-27 03:23:39.717693] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:37.183 EAL: No free 2048 kB hugepages reported on node 1 00:28:37.183 [2024-11-27 03:23:39.781727] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:37.443 [2024-11-27 03:23:39.869567] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:37.443 [2024-11-27 03:23:39.869744] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:37.443 [2024-11-27 03:23:39.869762] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:37.443 [2024-11-27 03:23:39.869775] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:37.443 [2024-11-27 03:23:39.869804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:38.379 03:23:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:38.379 03:23:40 -- common/autotest_common.sh@862 -- # return 0 00:28:38.379 03:23:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:38.379 03:23:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:38.379 03:23:40 -- common/autotest_common.sh@10 -- # set +x 00:28:38.379 03:23:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:38.379 03:23:40 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:38.379 03:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.379 03:23:40 -- common/autotest_common.sh@10 -- # set +x 00:28:38.379 [2024-11-27 03:23:40.715233] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:38.379 03:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.379 03:23:40 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:38.379 03:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.380 03:23:40 -- common/autotest_common.sh@10 -- # set +x 00:28:38.380 [2024-11-27 03:23:40.723415] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:38.380 03:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.380 03:23:40 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:38.380 03:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.380 03:23:40 -- common/autotest_common.sh@10 -- # set +x 00:28:38.380 null0 00:28:38.380 03:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.380 03:23:40 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:38.380 03:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.380 03:23:40 -- common/autotest_common.sh@10 -- # set +x 00:28:38.380 null1 00:28:38.380 03:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.380 03:23:40 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:38.380 03:23:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:38.380 03:23:40 -- common/autotest_common.sh@10 -- # set +x 00:28:38.380 03:23:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:38.380 03:23:40 -- host/discovery.sh@45 -- # hostpid=2569021 00:28:38.380 03:23:40 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:38.380 03:23:40 -- host/discovery.sh@46 -- # waitforlisten 2569021 /tmp/host.sock 00:28:38.380 03:23:40 -- common/autotest_common.sh@829 -- # '[' -z 2569021 ']' 00:28:38.380 03:23:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:38.380 03:23:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:38.380 03:23:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:38.380 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:38.380 03:23:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:38.380 03:23:40 -- common/autotest_common.sh@10 -- # set +x 00:28:38.380 [2024-11-27 03:23:40.793872] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:38.380 [2024-11-27 03:23:40.793950] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2569021 ] 00:28:38.380 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.380 [2024-11-27 03:23:40.857172] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:38.380 [2024-11-27 03:23:40.945518] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:38.380 [2024-11-27 03:23:40.945715] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:39.318 03:23:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:39.318 03:23:41 -- common/autotest_common.sh@862 -- # return 0 00:28:39.318 03:23:41 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:39.318 03:23:41 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:39.318 03:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.318 03:23:41 -- common/autotest_common.sh@10 -- # set +x 00:28:39.318 03:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.318 03:23:41 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:39.318 03:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.318 03:23:41 -- common/autotest_common.sh@10 -- # set +x 00:28:39.318 03:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.318 03:23:41 -- host/discovery.sh@72 -- # notify_id=0 00:28:39.318 03:23:41 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:39.318 03:23:41 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:39.318 03:23:41 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:39.318 03:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.318 03:23:41 -- common/autotest_common.sh@10 -- # set +x 00:28:39.318 03:23:41 -- host/discovery.sh@59 -- # sort 00:28:39.318 03:23:41 -- host/discovery.sh@59 -- # xargs 00:28:39.318 03:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.318 03:23:41 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:39.318 03:23:41 -- host/discovery.sh@79 -- # get_bdev_list 00:28:39.318 03:23:41 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:39.318 03:23:41 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:39.318 03:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.318 03:23:41 -- host/discovery.sh@55 -- # sort 00:28:39.318 03:23:41 -- common/autotest_common.sh@10 -- # set +x 00:28:39.318 03:23:41 -- host/discovery.sh@55 -- # xargs 00:28:39.318 03:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.318 03:23:41 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:39.318 03:23:41 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:39.318 03:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.318 03:23:41 -- common/autotest_common.sh@10 -- # set +x 00:28:39.318 03:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.318 03:23:41 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:39.318 03:23:41 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:39.318 03:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.318 03:23:41 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:39.318 03:23:41 -- common/autotest_common.sh@10 -- # set +x 00:28:39.318 03:23:41 -- host/discovery.sh@59 -- # sort 00:28:39.318 03:23:41 -- host/discovery.sh@59 -- # xargs 00:28:39.318 03:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.318 03:23:41 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:39.318 03:23:41 -- host/discovery.sh@83 -- # get_bdev_list 00:28:39.318 03:23:41 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:39.318 03:23:41 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:39.318 03:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.318 03:23:41 -- host/discovery.sh@55 -- # sort 00:28:39.319 03:23:41 -- common/autotest_common.sh@10 -- # set +x 00:28:39.319 03:23:41 -- host/discovery.sh@55 -- # xargs 00:28:39.319 03:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:41 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:39.579 03:23:41 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:39.579 03:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.579 03:23:41 -- common/autotest_common.sh@10 -- # set +x 00:28:39.579 03:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:41 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:39.579 03:23:41 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:39.579 03:23:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.579 03:23:41 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:39.579 03:23:41 -- common/autotest_common.sh@10 -- # set +x 00:28:39.579 03:23:41 -- host/discovery.sh@59 -- # sort 00:28:39.579 03:23:41 -- host/discovery.sh@59 -- # xargs 00:28:39.579 03:23:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:42 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:39.579 03:23:42 -- host/discovery.sh@87 -- # get_bdev_list 00:28:39.579 03:23:42 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:39.579 03:23:42 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:39.579 03:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.579 03:23:42 -- common/autotest_common.sh@10 -- # set +x 00:28:39.579 03:23:42 -- host/discovery.sh@55 -- # sort 00:28:39.579 03:23:42 -- host/discovery.sh@55 -- # xargs 00:28:39.579 03:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:42 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:39.579 03:23:42 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:39.579 03:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.579 03:23:42 -- common/autotest_common.sh@10 -- # set +x 00:28:39.579 [2024-11-27 03:23:42.051115] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:39.579 03:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:42 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:39.579 03:23:42 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:39.579 03:23:42 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:39.579 03:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.579 03:23:42 -- common/autotest_common.sh@10 -- # set +x 00:28:39.579 03:23:42 -- host/discovery.sh@59 -- # sort 00:28:39.579 03:23:42 -- host/discovery.sh@59 -- # xargs 00:28:39.579 03:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:42 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:39.579 03:23:42 -- host/discovery.sh@93 -- # get_bdev_list 00:28:39.579 03:23:42 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:39.579 03:23:42 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:39.579 03:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.579 03:23:42 -- host/discovery.sh@55 -- # sort 00:28:39.579 03:23:42 -- common/autotest_common.sh@10 -- # set +x 00:28:39.579 03:23:42 -- host/discovery.sh@55 -- # xargs 00:28:39.579 03:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:42 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:39.579 03:23:42 -- host/discovery.sh@94 -- # get_notification_count 00:28:39.579 03:23:42 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:39.579 03:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.579 03:23:42 -- host/discovery.sh@74 -- # jq '. | length' 00:28:39.579 03:23:42 -- common/autotest_common.sh@10 -- # set +x 00:28:39.579 03:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:42 -- host/discovery.sh@74 -- # notification_count=0 00:28:39.579 03:23:42 -- host/discovery.sh@75 -- # notify_id=0 00:28:39.579 03:23:42 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:42 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:39.579 03:23:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:39.579 03:23:42 -- common/autotest_common.sh@10 -- # set +x 00:28:39.579 03:23:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.579 03:23:42 -- host/discovery.sh@100 -- # sleep 1 00:28:40.518 [2024-11-27 03:23:42.836186] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:40.518 [2024-11-27 03:23:42.836233] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:40.518 [2024-11-27 03:23:42.836259] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:40.518 [2024-11-27 03:23:42.963691] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:40.518 [2024-11-27 03:23:43.025322] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:40.518 [2024-11-27 03:23:43.025349] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:40.778 03:23:43 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:40.778 03:23:43 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:40.778 03:23:43 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:40.778 03:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.778 03:23:43 -- common/autotest_common.sh@10 -- # set +x 00:28:40.778 03:23:43 -- host/discovery.sh@59 -- # sort 00:28:40.778 03:23:43 -- host/discovery.sh@59 -- # xargs 00:28:40.778 03:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.778 03:23:43 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:40.778 03:23:43 -- host/discovery.sh@102 -- # get_bdev_list 00:28:40.778 03:23:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:40.778 03:23:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:40.778 03:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.778 03:23:43 -- common/autotest_common.sh@10 -- # set +x 00:28:40.778 03:23:43 -- host/discovery.sh@55 -- # sort 00:28:40.778 03:23:43 -- host/discovery.sh@55 -- # xargs 00:28:40.778 03:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.778 03:23:43 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:40.778 03:23:43 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:40.778 03:23:43 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:40.778 03:23:43 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:40.778 03:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.778 03:23:43 -- common/autotest_common.sh@10 -- # set +x 00:28:40.778 03:23:43 -- host/discovery.sh@63 -- # sort -n 00:28:40.778 03:23:43 -- host/discovery.sh@63 -- # xargs 00:28:40.778 03:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.778 03:23:43 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:40.778 03:23:43 -- host/discovery.sh@104 -- # get_notification_count 00:28:40.778 03:23:43 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:40.778 03:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.778 03:23:43 -- host/discovery.sh@74 -- # jq '. | length' 00:28:40.778 03:23:43 -- common/autotest_common.sh@10 -- # set +x 00:28:40.778 03:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.778 03:23:43 -- host/discovery.sh@74 -- # notification_count=1 00:28:40.778 03:23:43 -- host/discovery.sh@75 -- # notify_id=1 00:28:40.778 03:23:43 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:40.778 03:23:43 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:40.778 03:23:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.778 03:23:43 -- common/autotest_common.sh@10 -- # set +x 00:28:40.778 03:23:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.778 03:23:43 -- host/discovery.sh@109 -- # sleep 1 00:28:42.157 03:23:44 -- host/discovery.sh@110 -- # get_bdev_list 00:28:42.157 03:23:44 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:42.157 03:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.157 03:23:44 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:42.157 03:23:44 -- common/autotest_common.sh@10 -- # set +x 00:28:42.157 03:23:44 -- host/discovery.sh@55 -- # sort 00:28:42.157 03:23:44 -- host/discovery.sh@55 -- # xargs 00:28:42.157 03:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.157 03:23:44 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:42.157 03:23:44 -- host/discovery.sh@111 -- # get_notification_count 00:28:42.157 03:23:44 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:42.157 03:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.157 03:23:44 -- host/discovery.sh@74 -- # jq '. | length' 00:28:42.157 03:23:44 -- common/autotest_common.sh@10 -- # set +x 00:28:42.157 03:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.157 03:23:44 -- host/discovery.sh@74 -- # notification_count=1 00:28:42.157 03:23:44 -- host/discovery.sh@75 -- # notify_id=2 00:28:42.157 03:23:44 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:42.157 03:23:44 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:42.157 03:23:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:42.157 03:23:44 -- common/autotest_common.sh@10 -- # set +x 00:28:42.157 [2024-11-27 03:23:44.454134] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:42.157 [2024-11-27 03:23:44.455196] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:42.157 [2024-11-27 03:23:44.455232] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:42.157 03:23:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:42.157 03:23:44 -- host/discovery.sh@117 -- # sleep 1 00:28:42.157 [2024-11-27 03:23:44.584655] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:42.157 [2024-11-27 03:23:44.642136] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:42.157 [2024-11-27 03:23:44.642161] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:42.157 [2024-11-27 03:23:44.642171] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:43.093 03:23:45 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:43.093 03:23:45 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:43.093 03:23:45 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:43.093 03:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.093 03:23:45 -- common/autotest_common.sh@10 -- # set +x 00:28:43.093 03:23:45 -- host/discovery.sh@59 -- # sort 00:28:43.093 03:23:45 -- host/discovery.sh@59 -- # xargs 00:28:43.093 03:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.093 03:23:45 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:43.093 03:23:45 -- host/discovery.sh@119 -- # get_bdev_list 00:28:43.093 03:23:45 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:43.093 03:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.093 03:23:45 -- common/autotest_common.sh@10 -- # set +x 00:28:43.093 03:23:45 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:43.093 03:23:45 -- host/discovery.sh@55 -- # sort 00:28:43.093 03:23:45 -- host/discovery.sh@55 -- # xargs 00:28:43.093 03:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.093 03:23:45 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:43.093 03:23:45 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:43.093 03:23:45 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:43.093 03:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.093 03:23:45 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:43.093 03:23:45 -- common/autotest_common.sh@10 -- # set +x 00:28:43.093 03:23:45 -- host/discovery.sh@63 -- # sort -n 00:28:43.093 03:23:45 -- host/discovery.sh@63 -- # xargs 00:28:43.093 03:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.093 03:23:45 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:43.093 03:23:45 -- host/discovery.sh@121 -- # get_notification_count 00:28:43.093 03:23:45 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:43.093 03:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.093 03:23:45 -- host/discovery.sh@74 -- # jq '. | length' 00:28:43.093 03:23:45 -- common/autotest_common.sh@10 -- # set +x 00:28:43.093 03:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.093 03:23:45 -- host/discovery.sh@74 -- # notification_count=0 00:28:43.093 03:23:45 -- host/discovery.sh@75 -- # notify_id=2 00:28:43.093 03:23:45 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:43.093 03:23:45 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:43.093 03:23:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:43.093 03:23:45 -- common/autotest_common.sh@10 -- # set +x 00:28:43.093 [2024-11-27 03:23:45.626386] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:43.093 [2024-11-27 03:23:45.626419] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:43.093 [2024-11-27 03:23:45.627112] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.093 [2024-11-27 03:23:45.627142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.093 [2024-11-27 03:23:45.627160] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.093 [2024-11-27 03:23:45.627175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.093 [2024-11-27 03:23:45.627190] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.093 [2024-11-27 03:23:45.627204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.093 [2024-11-27 03:23:45.627219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:43.093 [2024-11-27 03:23:45.627234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:43.093 [2024-11-27 03:23:45.627247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x190f410 is same with the state(5) to be set 00:28:43.093 03:23:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:43.093 03:23:45 -- host/discovery.sh@127 -- # sleep 1 00:28:43.093 [2024-11-27 03:23:45.637121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f410 (9): Bad file descriptor 00:28:43.093 [2024-11-27 03:23:45.647162] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:43.093 [2024-11-27 03:23:45.647331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.647433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.647461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x190f410 with addr=10.0.0.2, port=4420 00:28:43.093 [2024-11-27 03:23:45.647479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x190f410 is same with the state(5) to be set 00:28:43.093 [2024-11-27 03:23:45.647510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f410 (9): Bad file descriptor 00:28:43.093 [2024-11-27 03:23:45.647559] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:43.093 [2024-11-27 03:23:45.647579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:43.093 [2024-11-27 03:23:45.647611] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:43.093 [2024-11-27 03:23:45.647631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:43.093 [2024-11-27 03:23:45.657241] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:43.093 [2024-11-27 03:23:45.657406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.657565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.657592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x190f410 with addr=10.0.0.2, port=4420 00:28:43.093 [2024-11-27 03:23:45.657608] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x190f410 is same with the state(5) to be set 00:28:43.093 [2024-11-27 03:23:45.657630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f410 (9): Bad file descriptor 00:28:43.093 [2024-11-27 03:23:45.657675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:43.093 [2024-11-27 03:23:45.657693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:43.093 [2024-11-27 03:23:45.657706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:43.093 [2024-11-27 03:23:45.657725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:43.093 [2024-11-27 03:23:45.667316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:43.093 [2024-11-27 03:23:45.667479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.667626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.667652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x190f410 with addr=10.0.0.2, port=4420 00:28:43.093 [2024-11-27 03:23:45.667668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x190f410 is same with the state(5) to be set 00:28:43.093 [2024-11-27 03:23:45.667689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f410 (9): Bad file descriptor 00:28:43.093 [2024-11-27 03:23:45.667722] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:43.093 [2024-11-27 03:23:45.667739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:43.093 [2024-11-27 03:23:45.667752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:43.093 [2024-11-27 03:23:45.667770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:43.093 [2024-11-27 03:23:45.677393] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:43.093 [2024-11-27 03:23:45.677590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.677708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.677733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x190f410 with addr=10.0.0.2, port=4420 00:28:43.093 [2024-11-27 03:23:45.677749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x190f410 is same with the state(5) to be set 00:28:43.093 [2024-11-27 03:23:45.677771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f410 (9): Bad file descriptor 00:28:43.093 [2024-11-27 03:23:45.677820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:43.093 [2024-11-27 03:23:45.677839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:43.093 [2024-11-27 03:23:45.677852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:43.093 [2024-11-27 03:23:45.677871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:43.093 [2024-11-27 03:23:45.687471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:43.093 [2024-11-27 03:23:45.687689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.687836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.093 [2024-11-27 03:23:45.687861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x190f410 with addr=10.0.0.2, port=4420 00:28:43.093 [2024-11-27 03:23:45.687876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x190f410 is same with the state(5) to be set 00:28:43.094 [2024-11-27 03:23:45.687898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f410 (9): Bad file descriptor 00:28:43.094 [2024-11-27 03:23:45.687931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:43.094 [2024-11-27 03:23:45.687947] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:43.094 [2024-11-27 03:23:45.687960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:43.094 [2024-11-27 03:23:45.687979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:43.094 [2024-11-27 03:23:45.697546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:43.094 [2024-11-27 03:23:45.697762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.094 [2024-11-27 03:23:45.697925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.094 [2024-11-27 03:23:45.697949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x190f410 with addr=10.0.0.2, port=4420 00:28:43.094 [2024-11-27 03:23:45.697964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x190f410 is same with the state(5) to be set 00:28:43.094 [2024-11-27 03:23:45.697986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f410 (9): Bad file descriptor 00:28:43.094 [2024-11-27 03:23:45.698028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:43.094 [2024-11-27 03:23:45.698047] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:43.094 [2024-11-27 03:23:45.698060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:43.094 [2024-11-27 03:23:45.698079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:43.094 [2024-11-27 03:23:45.707644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:43.094 [2024-11-27 03:23:45.707872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.094 [2024-11-27 03:23:45.708022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:43.094 [2024-11-27 03:23:45.708047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x190f410 with addr=10.0.0.2, port=4420 00:28:43.094 [2024-11-27 03:23:45.708062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x190f410 is same with the state(5) to be set 00:28:43.094 [2024-11-27 03:23:45.708083] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x190f410 (9): Bad file descriptor 00:28:43.094 [2024-11-27 03:23:45.708116] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:43.094 [2024-11-27 03:23:45.708138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:43.094 [2024-11-27 03:23:45.708151] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:43.094 [2024-11-27 03:23:45.708170] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:43.351 [2024-11-27 03:23:45.713123] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:43.351 [2024-11-27 03:23:45.713154] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:44.290 03:23:46 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:44.290 03:23:46 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:44.290 03:23:46 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:44.290 03:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.290 03:23:46 -- host/discovery.sh@59 -- # sort 00:28:44.290 03:23:46 -- common/autotest_common.sh@10 -- # set +x 00:28:44.290 03:23:46 -- host/discovery.sh@59 -- # xargs 00:28:44.290 03:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.290 03:23:46 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:44.290 03:23:46 -- host/discovery.sh@129 -- # get_bdev_list 00:28:44.290 03:23:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:44.290 03:23:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:44.290 03:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.290 03:23:46 -- common/autotest_common.sh@10 -- # set +x 00:28:44.290 03:23:46 -- host/discovery.sh@55 -- # sort 00:28:44.290 03:23:46 -- host/discovery.sh@55 -- # xargs 00:28:44.290 03:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.290 03:23:46 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:44.290 03:23:46 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:44.290 03:23:46 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:44.290 03:23:46 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:44.290 03:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.290 03:23:46 -- host/discovery.sh@63 -- # sort -n 00:28:44.290 03:23:46 -- common/autotest_common.sh@10 -- # set +x 00:28:44.290 03:23:46 -- host/discovery.sh@63 -- # xargs 00:28:44.290 03:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.290 03:23:46 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:44.290 03:23:46 -- host/discovery.sh@131 -- # get_notification_count 00:28:44.290 03:23:46 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:44.290 03:23:46 -- host/discovery.sh@74 -- # jq '. | length' 00:28:44.290 03:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.290 03:23:46 -- common/autotest_common.sh@10 -- # set +x 00:28:44.290 03:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.290 03:23:46 -- host/discovery.sh@74 -- # notification_count=0 00:28:44.290 03:23:46 -- host/discovery.sh@75 -- # notify_id=2 00:28:44.290 03:23:46 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:44.290 03:23:46 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:44.290 03:23:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.290 03:23:46 -- common/autotest_common.sh@10 -- # set +x 00:28:44.290 03:23:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.290 03:23:46 -- host/discovery.sh@135 -- # sleep 1 00:28:45.230 03:23:47 -- host/discovery.sh@136 -- # get_subsystem_names 00:28:45.230 03:23:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:45.230 03:23:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:45.230 03:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.230 03:23:47 -- common/autotest_common.sh@10 -- # set +x 00:28:45.230 03:23:47 -- host/discovery.sh@59 -- # sort 00:28:45.230 03:23:47 -- host/discovery.sh@59 -- # xargs 00:28:45.230 03:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.490 03:23:47 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:28:45.490 03:23:47 -- host/discovery.sh@137 -- # get_bdev_list 00:28:45.490 03:23:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:45.490 03:23:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:45.490 03:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.490 03:23:47 -- common/autotest_common.sh@10 -- # set +x 00:28:45.490 03:23:47 -- host/discovery.sh@55 -- # sort 00:28:45.490 03:23:47 -- host/discovery.sh@55 -- # xargs 00:28:45.490 03:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.490 03:23:47 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:28:45.490 03:23:47 -- host/discovery.sh@138 -- # get_notification_count 00:28:45.490 03:23:47 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:45.490 03:23:47 -- host/discovery.sh@74 -- # jq '. | length' 00:28:45.490 03:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.490 03:23:47 -- common/autotest_common.sh@10 -- # set +x 00:28:45.490 03:23:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:45.490 03:23:47 -- host/discovery.sh@74 -- # notification_count=2 00:28:45.490 03:23:47 -- host/discovery.sh@75 -- # notify_id=4 00:28:45.490 03:23:47 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:28:45.490 03:23:47 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:45.490 03:23:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:45.490 03:23:47 -- common/autotest_common.sh@10 -- # set +x 00:28:46.430 [2024-11-27 03:23:48.990674] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:46.430 [2024-11-27 03:23:48.990707] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:46.430 [2024-11-27 03:23:48.990728] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:46.695 [2024-11-27 03:23:49.077004] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:28:46.695 [2024-11-27 03:23:49.177230] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:46.695 [2024-11-27 03:23:49.177277] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:46.695 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.695 03:23:49 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.695 03:23:49 -- common/autotest_common.sh@650 -- # local es=0 00:28:46.695 03:23:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.695 03:23:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:46.695 03:23:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:46.695 03:23:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:46.695 03:23:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:46.695 03:23:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.695 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.695 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:28:46.695 request: 00:28:46.695 { 00:28:46.695 "name": "nvme", 00:28:46.695 "trtype": "tcp", 00:28:46.695 "traddr": "10.0.0.2", 00:28:46.695 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:46.696 "adrfam": "ipv4", 00:28:46.696 "trsvcid": "8009", 00:28:46.696 "wait_for_attach": true, 00:28:46.696 "method": "bdev_nvme_start_discovery", 00:28:46.696 "req_id": 1 00:28:46.696 } 00:28:46.696 Got JSON-RPC error response 00:28:46.696 response: 00:28:46.696 { 00:28:46.696 "code": -17, 00:28:46.696 "message": "File exists" 00:28:46.696 } 00:28:46.696 03:23:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:46.696 03:23:49 -- common/autotest_common.sh@653 -- # es=1 00:28:46.696 03:23:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:46.696 03:23:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:46.696 03:23:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:46.696 03:23:49 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:28:46.696 03:23:49 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:46.696 03:23:49 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:46.696 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.696 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:28:46.696 03:23:49 -- host/discovery.sh@67 -- # sort 00:28:46.696 03:23:49 -- host/discovery.sh@67 -- # xargs 00:28:46.696 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.696 03:23:49 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:28:46.696 03:23:49 -- host/discovery.sh@147 -- # get_bdev_list 00:28:46.696 03:23:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:46.696 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.696 03:23:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:46.696 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:28:46.696 03:23:49 -- host/discovery.sh@55 -- # sort 00:28:46.696 03:23:49 -- host/discovery.sh@55 -- # xargs 00:28:46.696 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.696 03:23:49 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:46.696 03:23:49 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.696 03:23:49 -- common/autotest_common.sh@650 -- # local es=0 00:28:46.696 03:23:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.697 03:23:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:46.697 03:23:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:46.697 03:23:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:46.697 03:23:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:46.697 03:23:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:46.697 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.697 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:28:46.697 request: 00:28:46.697 { 00:28:46.697 "name": "nvme_second", 00:28:46.697 "trtype": "tcp", 00:28:46.697 "traddr": "10.0.0.2", 00:28:46.697 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:46.697 "adrfam": "ipv4", 00:28:46.697 "trsvcid": "8009", 00:28:46.697 "wait_for_attach": true, 00:28:46.697 "method": "bdev_nvme_start_discovery", 00:28:46.697 "req_id": 1 00:28:46.697 } 00:28:46.697 Got JSON-RPC error response 00:28:46.697 response: 00:28:46.697 { 00:28:46.697 "code": -17, 00:28:46.697 "message": "File exists" 00:28:46.697 } 00:28:46.697 03:23:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:46.697 03:23:49 -- common/autotest_common.sh@653 -- # es=1 00:28:46.697 03:23:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:46.697 03:23:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:46.697 03:23:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:46.697 03:23:49 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:28:46.697 03:23:49 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:46.697 03:23:49 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:46.697 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.697 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:28:46.697 03:23:49 -- host/discovery.sh@67 -- # sort 00:28:46.697 03:23:49 -- host/discovery.sh@67 -- # xargs 00:28:46.697 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.963 03:23:49 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:28:46.963 03:23:49 -- host/discovery.sh@153 -- # get_bdev_list 00:28:46.963 03:23:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:46.963 03:23:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:46.963 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.963 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:28:46.963 03:23:49 -- host/discovery.sh@55 -- # sort 00:28:46.963 03:23:49 -- host/discovery.sh@55 -- # xargs 00:28:46.963 03:23:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:46.963 03:23:49 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:46.963 03:23:49 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:46.963 03:23:49 -- common/autotest_common.sh@650 -- # local es=0 00:28:46.963 03:23:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:46.963 03:23:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:46.963 03:23:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:46.963 03:23:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:46.963 03:23:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:46.963 03:23:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:46.963 03:23:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:46.963 03:23:49 -- common/autotest_common.sh@10 -- # set +x 00:28:47.904 [2024-11-27 03:23:50.365706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.904 [2024-11-27 03:23:50.365880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:47.904 [2024-11-27 03:23:50.365908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18862e0 with addr=10.0.0.2, port=8010 00:28:47.904 [2024-11-27 03:23:50.365937] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:47.904 [2024-11-27 03:23:50.365951] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:47.904 [2024-11-27 03:23:50.365978] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:48.843 [2024-11-27 03:23:51.368090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.843 [2024-11-27 03:23:51.368214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:48.843 [2024-11-27 03:23:51.368243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18862e0 with addr=10.0.0.2, port=8010 00:28:48.843 [2024-11-27 03:23:51.368264] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:48.843 [2024-11-27 03:23:51.368278] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:48.843 [2024-11-27 03:23:51.368291] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:49.780 [2024-11-27 03:23:52.370363] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:28:49.780 request: 00:28:49.780 { 00:28:49.780 "name": "nvme_second", 00:28:49.780 "trtype": "tcp", 00:28:49.780 "traddr": "10.0.0.2", 00:28:49.780 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:49.780 "adrfam": "ipv4", 00:28:49.780 "trsvcid": "8010", 00:28:49.780 "attach_timeout_ms": 3000, 00:28:49.780 "method": "bdev_nvme_start_discovery", 00:28:49.780 "req_id": 1 00:28:49.780 } 00:28:49.780 Got JSON-RPC error response 00:28:49.780 response: 00:28:49.780 { 00:28:49.780 "code": -110, 00:28:49.780 "message": "Connection timed out" 00:28:49.780 } 00:28:49.780 03:23:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:49.780 03:23:52 -- common/autotest_common.sh@653 -- # es=1 00:28:49.780 03:23:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:49.780 03:23:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:49.780 03:23:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:49.780 03:23:52 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:28:49.780 03:23:52 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:49.780 03:23:52 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:49.780 03:23:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:49.780 03:23:52 -- host/discovery.sh@67 -- # sort 00:28:49.780 03:23:52 -- common/autotest_common.sh@10 -- # set +x 00:28:49.780 03:23:52 -- host/discovery.sh@67 -- # xargs 00:28:49.780 03:23:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.041 03:23:52 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:28:50.041 03:23:52 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:28:50.041 03:23:52 -- host/discovery.sh@162 -- # kill 2569021 00:28:50.041 03:23:52 -- host/discovery.sh@163 -- # nvmftestfini 00:28:50.041 03:23:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:50.041 03:23:52 -- nvmf/common.sh@116 -- # sync 00:28:50.041 03:23:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:50.041 03:23:52 -- nvmf/common.sh@119 -- # set +e 00:28:50.041 03:23:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:50.041 03:23:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:50.041 rmmod nvme_tcp 00:28:50.041 rmmod nvme_fabrics 00:28:50.041 rmmod nvme_keyring 00:28:50.041 03:23:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:50.041 03:23:52 -- nvmf/common.sh@123 -- # set -e 00:28:50.041 03:23:52 -- nvmf/common.sh@124 -- # return 0 00:28:50.041 03:23:52 -- nvmf/common.sh@477 -- # '[' -n 2568864 ']' 00:28:50.041 03:23:52 -- nvmf/common.sh@478 -- # killprocess 2568864 00:28:50.041 03:23:52 -- common/autotest_common.sh@936 -- # '[' -z 2568864 ']' 00:28:50.041 03:23:52 -- common/autotest_common.sh@940 -- # kill -0 2568864 00:28:50.041 03:23:52 -- common/autotest_common.sh@941 -- # uname 00:28:50.041 03:23:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:50.041 03:23:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2568864 00:28:50.041 03:23:52 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:50.041 03:23:52 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:50.041 03:23:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2568864' 00:28:50.041 killing process with pid 2568864 00:28:50.041 03:23:52 -- common/autotest_common.sh@955 -- # kill 2568864 00:28:50.041 03:23:52 -- common/autotest_common.sh@960 -- # wait 2568864 00:28:50.300 03:23:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:50.300 03:23:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:50.300 03:23:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:50.300 03:23:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:50.300 03:23:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:50.300 03:23:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:50.300 03:23:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:50.300 03:23:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:52.210 03:23:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:52.210 00:28:52.210 real 0m17.443s 00:28:52.210 user 0m27.018s 00:28:52.210 sys 0m2.898s 00:28:52.210 03:23:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:52.210 03:23:54 -- common/autotest_common.sh@10 -- # set +x 00:28:52.210 ************************************ 00:28:52.210 END TEST nvmf_discovery 00:28:52.210 ************************************ 00:28:52.469 03:23:54 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:52.470 03:23:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:52.470 03:23:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:52.470 03:23:54 -- common/autotest_common.sh@10 -- # set +x 00:28:52.470 ************************************ 00:28:52.470 START TEST nvmf_discovery_remove_ifc 00:28:52.470 ************************************ 00:28:52.470 03:23:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:52.470 * Looking for test storage... 00:28:52.470 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:52.470 03:23:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:52.470 03:23:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:52.470 03:23:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:52.470 03:23:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:52.470 03:23:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:52.470 03:23:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:52.470 03:23:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:52.470 03:23:54 -- scripts/common.sh@335 -- # IFS=.-: 00:28:52.470 03:23:54 -- scripts/common.sh@335 -- # read -ra ver1 00:28:52.470 03:23:54 -- scripts/common.sh@336 -- # IFS=.-: 00:28:52.470 03:23:54 -- scripts/common.sh@336 -- # read -ra ver2 00:28:52.470 03:23:54 -- scripts/common.sh@337 -- # local 'op=<' 00:28:52.470 03:23:54 -- scripts/common.sh@339 -- # ver1_l=2 00:28:52.470 03:23:54 -- scripts/common.sh@340 -- # ver2_l=1 00:28:52.470 03:23:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:52.470 03:23:54 -- scripts/common.sh@343 -- # case "$op" in 00:28:52.470 03:23:54 -- scripts/common.sh@344 -- # : 1 00:28:52.470 03:23:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:52.470 03:23:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:52.470 03:23:54 -- scripts/common.sh@364 -- # decimal 1 00:28:52.470 03:23:54 -- scripts/common.sh@352 -- # local d=1 00:28:52.470 03:23:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:52.470 03:23:54 -- scripts/common.sh@354 -- # echo 1 00:28:52.470 03:23:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:52.470 03:23:54 -- scripts/common.sh@365 -- # decimal 2 00:28:52.470 03:23:54 -- scripts/common.sh@352 -- # local d=2 00:28:52.470 03:23:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:52.470 03:23:54 -- scripts/common.sh@354 -- # echo 2 00:28:52.470 03:23:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:52.470 03:23:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:52.470 03:23:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:52.470 03:23:54 -- scripts/common.sh@367 -- # return 0 00:28:52.470 03:23:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:52.470 03:23:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:52.470 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:52.470 --rc genhtml_branch_coverage=1 00:28:52.470 --rc genhtml_function_coverage=1 00:28:52.470 --rc genhtml_legend=1 00:28:52.470 --rc geninfo_all_blocks=1 00:28:52.470 --rc geninfo_unexecuted_blocks=1 00:28:52.470 00:28:52.470 ' 00:28:52.470 03:23:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:52.470 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:52.470 --rc genhtml_branch_coverage=1 00:28:52.470 --rc genhtml_function_coverage=1 00:28:52.470 --rc genhtml_legend=1 00:28:52.470 --rc geninfo_all_blocks=1 00:28:52.470 --rc geninfo_unexecuted_blocks=1 00:28:52.470 00:28:52.470 ' 00:28:52.470 03:23:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:52.470 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:52.470 --rc genhtml_branch_coverage=1 00:28:52.470 --rc genhtml_function_coverage=1 00:28:52.470 --rc genhtml_legend=1 00:28:52.470 --rc geninfo_all_blocks=1 00:28:52.470 --rc geninfo_unexecuted_blocks=1 00:28:52.470 00:28:52.470 ' 00:28:52.470 03:23:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:52.470 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:52.470 --rc genhtml_branch_coverage=1 00:28:52.470 --rc genhtml_function_coverage=1 00:28:52.470 --rc genhtml_legend=1 00:28:52.470 --rc geninfo_all_blocks=1 00:28:52.470 --rc geninfo_unexecuted_blocks=1 00:28:52.470 00:28:52.470 ' 00:28:52.470 03:23:54 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:52.470 03:23:54 -- nvmf/common.sh@7 -- # uname -s 00:28:52.470 03:23:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:52.470 03:23:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:52.470 03:23:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:52.470 03:23:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:52.470 03:23:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:52.470 03:23:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:52.470 03:23:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:52.470 03:23:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:52.470 03:23:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:52.470 03:23:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:52.470 03:23:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:52.470 03:23:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:52.470 03:23:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:52.470 03:23:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:52.470 03:23:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:52.470 03:23:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:52.470 03:23:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:52.470 03:23:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:52.470 03:23:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:52.470 03:23:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.470 03:23:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.470 03:23:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.470 03:23:54 -- paths/export.sh@5 -- # export PATH 00:28:52.470 03:23:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.470 03:23:54 -- nvmf/common.sh@46 -- # : 0 00:28:52.470 03:23:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:52.470 03:23:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:52.470 03:23:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:52.470 03:23:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:52.470 03:23:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:52.470 03:23:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:52.470 03:23:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:52.470 03:23:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:52.470 03:23:54 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:28:52.470 03:23:54 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:28:52.470 03:23:54 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:28:52.470 03:23:54 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:28:52.470 03:23:54 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:28:52.470 03:23:54 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:28:52.470 03:23:54 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:28:52.470 03:23:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:52.470 03:23:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:52.470 03:23:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:52.470 03:23:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:52.470 03:23:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:52.470 03:23:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:52.470 03:23:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:52.470 03:23:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:52.470 03:23:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:52.470 03:23:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:52.470 03:23:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:52.470 03:23:54 -- common/autotest_common.sh@10 -- # set +x 00:28:54.377 03:23:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:54.377 03:23:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:54.377 03:23:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:54.377 03:23:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:54.377 03:23:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:54.377 03:23:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:54.377 03:23:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:54.377 03:23:56 -- nvmf/common.sh@294 -- # net_devs=() 00:28:54.377 03:23:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:54.377 03:23:56 -- nvmf/common.sh@295 -- # e810=() 00:28:54.377 03:23:56 -- nvmf/common.sh@295 -- # local -ga e810 00:28:54.377 03:23:56 -- nvmf/common.sh@296 -- # x722=() 00:28:54.377 03:23:56 -- nvmf/common.sh@296 -- # local -ga x722 00:28:54.377 03:23:56 -- nvmf/common.sh@297 -- # mlx=() 00:28:54.377 03:23:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:54.377 03:23:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:54.377 03:23:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:54.377 03:23:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:54.377 03:23:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:54.377 03:23:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:54.377 03:23:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:54.377 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:54.377 03:23:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:54.377 03:23:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:54.377 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:54.377 03:23:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:54.377 03:23:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:54.377 03:23:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:54.377 03:23:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:54.377 03:23:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:54.377 03:23:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:54.377 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:54.377 03:23:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:54.377 03:23:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:54.377 03:23:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:54.377 03:23:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:54.377 03:23:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:54.377 03:23:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:54.377 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:54.377 03:23:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:54.377 03:23:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:54.377 03:23:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:54.377 03:23:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:54.377 03:23:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:54.377 03:23:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:54.377 03:23:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:54.377 03:23:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:54.377 03:23:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:54.377 03:23:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:54.377 03:23:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:54.377 03:23:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:54.377 03:23:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:54.377 03:23:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:54.377 03:23:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:54.377 03:23:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:54.377 03:23:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:54.377 03:23:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:54.636 03:23:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:54.636 03:23:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:54.636 03:23:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:54.636 03:23:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:54.636 03:23:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:54.636 03:23:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:54.636 03:23:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:54.636 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:54.636 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.355 ms 00:28:54.636 00:28:54.636 --- 10.0.0.2 ping statistics --- 00:28:54.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:54.636 rtt min/avg/max/mdev = 0.355/0.355/0.355/0.000 ms 00:28:54.636 03:23:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:54.636 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:54.636 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:28:54.636 00:28:54.636 --- 10.0.0.1 ping statistics --- 00:28:54.636 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:54.636 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:28:54.636 03:23:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:54.636 03:23:57 -- nvmf/common.sh@410 -- # return 0 00:28:54.636 03:23:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:54.636 03:23:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:54.636 03:23:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:54.636 03:23:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:54.636 03:23:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:54.636 03:23:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:54.636 03:23:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:54.636 03:23:57 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:28:54.636 03:23:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:54.636 03:23:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:54.636 03:23:57 -- common/autotest_common.sh@10 -- # set +x 00:28:54.636 03:23:57 -- nvmf/common.sh@469 -- # nvmfpid=2572495 00:28:54.636 03:23:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:54.636 03:23:57 -- nvmf/common.sh@470 -- # waitforlisten 2572495 00:28:54.636 03:23:57 -- common/autotest_common.sh@829 -- # '[' -z 2572495 ']' 00:28:54.636 03:23:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:54.636 03:23:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:54.636 03:23:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:54.636 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:54.636 03:23:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:54.636 03:23:57 -- common/autotest_common.sh@10 -- # set +x 00:28:54.636 [2024-11-27 03:23:57.156633] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:54.636 [2024-11-27 03:23:57.156711] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:54.636 EAL: No free 2048 kB hugepages reported on node 1 00:28:54.636 [2024-11-27 03:23:57.230392] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:54.896 [2024-11-27 03:23:57.318342] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:54.896 [2024-11-27 03:23:57.318502] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:54.896 [2024-11-27 03:23:57.318521] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:54.896 [2024-11-27 03:23:57.318547] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:54.896 [2024-11-27 03:23:57.318593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:55.831 03:23:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:55.831 03:23:58 -- common/autotest_common.sh@862 -- # return 0 00:28:55.831 03:23:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:55.831 03:23:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:55.831 03:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.831 03:23:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:55.831 03:23:58 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:28:55.831 03:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:55.831 03:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.831 [2024-11-27 03:23:58.151356] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:55.831 [2024-11-27 03:23:58.159544] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:55.831 null0 00:28:55.831 [2024-11-27 03:23:58.191493] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:55.831 03:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:55.831 03:23:58 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2572650 00:28:55.831 03:23:58 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:28:55.831 03:23:58 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2572650 /tmp/host.sock 00:28:55.831 03:23:58 -- common/autotest_common.sh@829 -- # '[' -z 2572650 ']' 00:28:55.831 03:23:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:55.831 03:23:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:55.831 03:23:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:55.831 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:55.831 03:23:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:55.831 03:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:55.831 [2024-11-27 03:23:58.253939] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:55.831 [2024-11-27 03:23:58.254004] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2572650 ] 00:28:55.831 EAL: No free 2048 kB hugepages reported on node 1 00:28:55.831 [2024-11-27 03:23:58.316634] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:55.831 [2024-11-27 03:23:58.407004] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:55.831 [2024-11-27 03:23:58.407172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:56.092 03:23:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:56.092 03:23:58 -- common/autotest_common.sh@862 -- # return 0 00:28:56.092 03:23:58 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:56.092 03:23:58 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:28:56.092 03:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.092 03:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:56.092 03:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.092 03:23:58 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:28:56.092 03:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.092 03:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:56.092 03:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.092 03:23:58 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:28:56.092 03:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.092 03:23:58 -- common/autotest_common.sh@10 -- # set +x 00:28:57.031 [2024-11-27 03:23:59.618743] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:57.031 [2024-11-27 03:23:59.618790] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:57.031 [2024-11-27 03:23:59.618812] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:57.291 [2024-11-27 03:23:59.746242] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:57.551 [2024-11-27 03:23:59.930334] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:57.551 [2024-11-27 03:23:59.930392] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:57.551 [2024-11-27 03:23:59.930435] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:57.551 [2024-11-27 03:23:59.930466] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:57.551 [2024-11-27 03:23:59.930504] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:57.551 03:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.551 03:23:59 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:28:57.551 03:23:59 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:57.551 03:23:59 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.551 03:23:59 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:57.551 03:23:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.551 03:23:59 -- common/autotest_common.sh@10 -- # set +x 00:28:57.551 03:23:59 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:57.551 03:23:59 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:57.551 [2024-11-27 03:23:59.938033] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x616c50 was disconnected and freed. delete nvme_qpair. 00:28:57.551 03:23:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.551 03:23:59 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:28:57.551 03:23:59 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:28:57.551 03:23:59 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:28:57.551 03:24:00 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:28:57.551 03:24:00 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:57.551 03:24:00 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.551 03:24:00 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:57.551 03:24:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.551 03:24:00 -- common/autotest_common.sh@10 -- # set +x 00:28:57.551 03:24:00 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:57.551 03:24:00 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:57.551 03:24:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.551 03:24:00 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:57.551 03:24:00 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:58.488 03:24:01 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:58.488 03:24:01 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:58.488 03:24:01 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:58.488 03:24:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.488 03:24:01 -- common/autotest_common.sh@10 -- # set +x 00:28:58.488 03:24:01 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:58.488 03:24:01 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:58.488 03:24:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.759 03:24:01 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:58.759 03:24:01 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:59.725 03:24:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:59.725 03:24:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.725 03:24:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:59.725 03:24:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.725 03:24:02 -- common/autotest_common.sh@10 -- # set +x 00:28:59.725 03:24:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:59.725 03:24:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:59.725 03:24:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.725 03:24:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:59.725 03:24:02 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:00.661 03:24:03 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:00.661 03:24:03 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:00.661 03:24:03 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:00.661 03:24:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.661 03:24:03 -- common/autotest_common.sh@10 -- # set +x 00:29:00.661 03:24:03 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:00.661 03:24:03 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:00.661 03:24:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.661 03:24:03 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:00.661 03:24:03 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:01.600 03:24:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:01.600 03:24:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:01.600 03:24:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:01.600 03:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.600 03:24:04 -- common/autotest_common.sh@10 -- # set +x 00:29:01.600 03:24:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:01.600 03:24:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:01.600 03:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.858 03:24:04 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:01.858 03:24:04 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:02.796 03:24:05 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:02.796 03:24:05 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:02.796 03:24:05 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:02.796 03:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.796 03:24:05 -- common/autotest_common.sh@10 -- # set +x 00:29:02.796 03:24:05 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:02.796 03:24:05 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:02.796 03:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:02.796 03:24:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:02.796 03:24:05 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:02.796 [2024-11-27 03:24:05.371218] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:02.796 [2024-11-27 03:24:05.371278] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.796 [2024-11-27 03:24:05.371302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.796 [2024-11-27 03:24:05.371335] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.796 [2024-11-27 03:24:05.371349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.796 [2024-11-27 03:24:05.371362] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.796 [2024-11-27 03:24:05.371374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.796 [2024-11-27 03:24:05.371388] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.796 [2024-11-27 03:24:05.371400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.796 [2024-11-27 03:24:05.371422] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:02.796 [2024-11-27 03:24:05.371435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:02.796 [2024-11-27 03:24:05.371447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5dd0b0 is same with the state(5) to be set 00:29:02.796 [2024-11-27 03:24:05.381238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5dd0b0 (9): Bad file descriptor 00:29:02.796 [2024-11-27 03:24:05.391292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:03.735 03:24:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:03.735 03:24:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.735 03:24:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.735 03:24:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:03.735 03:24:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:03.735 03:24:06 -- common/autotest_common.sh@10 -- # set +x 00:29:03.735 03:24:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:03.993 [2024-11-27 03:24:06.420601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:04.934 [2024-11-27 03:24:07.444630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:04.934 [2024-11-27 03:24:07.444691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x5dd0b0 with addr=10.0.0.2, port=4420 00:29:04.934 [2024-11-27 03:24:07.444716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x5dd0b0 is same with the state(5) to be set 00:29:04.934 [2024-11-27 03:24:07.444749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:04.934 [2024-11-27 03:24:07.444765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:04.934 [2024-11-27 03:24:07.444777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:04.934 [2024-11-27 03:24:07.444792] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:04.934 [2024-11-27 03:24:07.445244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5dd0b0 (9): Bad file descriptor 00:29:04.934 [2024-11-27 03:24:07.445282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:04.934 [2024-11-27 03:24:07.445316] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:04.934 [2024-11-27 03:24:07.445365] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.934 [2024-11-27 03:24:07.445388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.934 [2024-11-27 03:24:07.445406] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.934 [2024-11-27 03:24:07.445419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.934 [2024-11-27 03:24:07.445432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.934 [2024-11-27 03:24:07.445444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.935 [2024-11-27 03:24:07.445457] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.935 [2024-11-27 03:24:07.445470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.935 [2024-11-27 03:24:07.445484] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:04.935 [2024-11-27 03:24:07.445496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:04.935 [2024-11-27 03:24:07.445541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:04.935 [2024-11-27 03:24:07.445749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x5dd4c0 (9): Bad file descriptor 00:29:04.935 [2024-11-27 03:24:07.446765] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:04.935 [2024-11-27 03:24:07.446788] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:04.935 03:24:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.935 03:24:07 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:04.935 03:24:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:05.873 03:24:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:05.873 03:24:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:05.873 03:24:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:05.873 03:24:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.873 03:24:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:05.873 03:24:08 -- common/autotest_common.sh@10 -- # set +x 00:29:05.873 03:24:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:05.873 03:24:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.132 03:24:08 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:06.132 03:24:08 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:06.132 03:24:08 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:06.132 03:24:08 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:06.132 03:24:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:06.132 03:24:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:06.132 03:24:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:06.132 03:24:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.132 03:24:08 -- common/autotest_common.sh@10 -- # set +x 00:29:06.133 03:24:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:06.133 03:24:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:06.133 03:24:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.133 03:24:08 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:06.133 03:24:08 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:07.068 [2024-11-27 03:24:09.506687] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:07.068 [2024-11-27 03:24:09.506715] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:07.068 [2024-11-27 03:24:09.506736] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:07.068 03:24:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:07.068 03:24:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:07.068 03:24:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.068 03:24:09 -- common/autotest_common.sh@10 -- # set +x 00:29:07.068 03:24:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:07.068 03:24:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:07.068 03:24:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:07.068 03:24:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.068 [2024-11-27 03:24:09.593086] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:07.068 03:24:09 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:07.068 03:24:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:07.068 [2024-11-27 03:24:09.654951] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:07.068 [2024-11-27 03:24:09.655000] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:07.068 [2024-11-27 03:24:09.655035] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:07.068 [2024-11-27 03:24:09.655059] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:07.068 [2024-11-27 03:24:09.655073] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:07.068 [2024-11-27 03:24:09.663744] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x5ebac0 was disconnected and freed. delete nvme_qpair. 00:29:08.449 03:24:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:08.449 03:24:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:08.449 03:24:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:08.449 03:24:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:08.449 03:24:10 -- common/autotest_common.sh@10 -- # set +x 00:29:08.449 03:24:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:08.449 03:24:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:08.449 03:24:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:08.449 03:24:10 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:08.449 03:24:10 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:08.449 03:24:10 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2572650 00:29:08.449 03:24:10 -- common/autotest_common.sh@936 -- # '[' -z 2572650 ']' 00:29:08.449 03:24:10 -- common/autotest_common.sh@940 -- # kill -0 2572650 00:29:08.449 03:24:10 -- common/autotest_common.sh@941 -- # uname 00:29:08.449 03:24:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:08.449 03:24:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2572650 00:29:08.449 03:24:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:08.449 03:24:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:08.449 03:24:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2572650' 00:29:08.449 killing process with pid 2572650 00:29:08.449 03:24:10 -- common/autotest_common.sh@955 -- # kill 2572650 00:29:08.449 03:24:10 -- common/autotest_common.sh@960 -- # wait 2572650 00:29:08.449 03:24:10 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:08.449 03:24:10 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:08.449 03:24:10 -- nvmf/common.sh@116 -- # sync 00:29:08.449 03:24:10 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:08.449 03:24:10 -- nvmf/common.sh@119 -- # set +e 00:29:08.449 03:24:10 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:08.449 03:24:10 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:08.449 rmmod nvme_tcp 00:29:08.449 rmmod nvme_fabrics 00:29:08.449 rmmod nvme_keyring 00:29:08.449 03:24:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:08.449 03:24:10 -- nvmf/common.sh@123 -- # set -e 00:29:08.449 03:24:10 -- nvmf/common.sh@124 -- # return 0 00:29:08.449 03:24:10 -- nvmf/common.sh@477 -- # '[' -n 2572495 ']' 00:29:08.449 03:24:10 -- nvmf/common.sh@478 -- # killprocess 2572495 00:29:08.449 03:24:10 -- common/autotest_common.sh@936 -- # '[' -z 2572495 ']' 00:29:08.449 03:24:10 -- common/autotest_common.sh@940 -- # kill -0 2572495 00:29:08.449 03:24:10 -- common/autotest_common.sh@941 -- # uname 00:29:08.449 03:24:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:08.449 03:24:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2572495 00:29:08.449 03:24:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:08.449 03:24:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:08.449 03:24:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2572495' 00:29:08.449 killing process with pid 2572495 00:29:08.449 03:24:11 -- common/autotest_common.sh@955 -- # kill 2572495 00:29:08.449 03:24:11 -- common/autotest_common.sh@960 -- # wait 2572495 00:29:08.709 03:24:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:08.709 03:24:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:08.709 03:24:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:08.709 03:24:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:08.709 03:24:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:08.709 03:24:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:08.709 03:24:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:08.709 03:24:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:11.253 03:24:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:11.253 00:29:11.253 real 0m18.458s 00:29:11.253 user 0m25.733s 00:29:11.253 sys 0m2.928s 00:29:11.253 03:24:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:11.253 03:24:13 -- common/autotest_common.sh@10 -- # set +x 00:29:11.253 ************************************ 00:29:11.253 END TEST nvmf_discovery_remove_ifc 00:29:11.253 ************************************ 00:29:11.253 03:24:13 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:11.253 03:24:13 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:11.253 03:24:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:11.254 03:24:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:11.254 03:24:13 -- common/autotest_common.sh@10 -- # set +x 00:29:11.254 ************************************ 00:29:11.254 START TEST nvmf_digest 00:29:11.254 ************************************ 00:29:11.254 03:24:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:11.254 * Looking for test storage... 00:29:11.254 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:11.254 03:24:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:11.254 03:24:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:11.254 03:24:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:11.254 03:24:13 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:11.254 03:24:13 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:11.254 03:24:13 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:11.254 03:24:13 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:11.254 03:24:13 -- scripts/common.sh@335 -- # IFS=.-: 00:29:11.254 03:24:13 -- scripts/common.sh@335 -- # read -ra ver1 00:29:11.254 03:24:13 -- scripts/common.sh@336 -- # IFS=.-: 00:29:11.254 03:24:13 -- scripts/common.sh@336 -- # read -ra ver2 00:29:11.254 03:24:13 -- scripts/common.sh@337 -- # local 'op=<' 00:29:11.254 03:24:13 -- scripts/common.sh@339 -- # ver1_l=2 00:29:11.254 03:24:13 -- scripts/common.sh@340 -- # ver2_l=1 00:29:11.254 03:24:13 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:11.254 03:24:13 -- scripts/common.sh@343 -- # case "$op" in 00:29:11.254 03:24:13 -- scripts/common.sh@344 -- # : 1 00:29:11.254 03:24:13 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:11.254 03:24:13 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:11.254 03:24:13 -- scripts/common.sh@364 -- # decimal 1 00:29:11.254 03:24:13 -- scripts/common.sh@352 -- # local d=1 00:29:11.254 03:24:13 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:11.254 03:24:13 -- scripts/common.sh@354 -- # echo 1 00:29:11.254 03:24:13 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:11.254 03:24:13 -- scripts/common.sh@365 -- # decimal 2 00:29:11.254 03:24:13 -- scripts/common.sh@352 -- # local d=2 00:29:11.254 03:24:13 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:11.254 03:24:13 -- scripts/common.sh@354 -- # echo 2 00:29:11.254 03:24:13 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:11.254 03:24:13 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:11.254 03:24:13 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:11.254 03:24:13 -- scripts/common.sh@367 -- # return 0 00:29:11.254 03:24:13 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:11.254 03:24:13 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:11.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:11.254 --rc genhtml_branch_coverage=1 00:29:11.254 --rc genhtml_function_coverage=1 00:29:11.254 --rc genhtml_legend=1 00:29:11.254 --rc geninfo_all_blocks=1 00:29:11.254 --rc geninfo_unexecuted_blocks=1 00:29:11.254 00:29:11.254 ' 00:29:11.254 03:24:13 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:11.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:11.254 --rc genhtml_branch_coverage=1 00:29:11.254 --rc genhtml_function_coverage=1 00:29:11.254 --rc genhtml_legend=1 00:29:11.254 --rc geninfo_all_blocks=1 00:29:11.254 --rc geninfo_unexecuted_blocks=1 00:29:11.254 00:29:11.254 ' 00:29:11.254 03:24:13 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:11.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:11.254 --rc genhtml_branch_coverage=1 00:29:11.254 --rc genhtml_function_coverage=1 00:29:11.254 --rc genhtml_legend=1 00:29:11.254 --rc geninfo_all_blocks=1 00:29:11.254 --rc geninfo_unexecuted_blocks=1 00:29:11.254 00:29:11.254 ' 00:29:11.254 03:24:13 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:11.254 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:11.254 --rc genhtml_branch_coverage=1 00:29:11.254 --rc genhtml_function_coverage=1 00:29:11.254 --rc genhtml_legend=1 00:29:11.254 --rc geninfo_all_blocks=1 00:29:11.254 --rc geninfo_unexecuted_blocks=1 00:29:11.254 00:29:11.254 ' 00:29:11.254 03:24:13 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:11.254 03:24:13 -- nvmf/common.sh@7 -- # uname -s 00:29:11.254 03:24:13 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:11.254 03:24:13 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:11.254 03:24:13 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:11.254 03:24:13 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:11.254 03:24:13 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:11.254 03:24:13 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:11.254 03:24:13 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:11.254 03:24:13 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:11.254 03:24:13 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:11.254 03:24:13 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:11.254 03:24:13 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:11.254 03:24:13 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:11.254 03:24:13 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:11.254 03:24:13 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:11.254 03:24:13 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:11.254 03:24:13 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:11.254 03:24:13 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:11.254 03:24:13 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:11.254 03:24:13 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:11.254 03:24:13 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:11.254 03:24:13 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:11.254 03:24:13 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:11.254 03:24:13 -- paths/export.sh@5 -- # export PATH 00:29:11.254 03:24:13 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:11.254 03:24:13 -- nvmf/common.sh@46 -- # : 0 00:29:11.254 03:24:13 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:11.254 03:24:13 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:11.254 03:24:13 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:11.254 03:24:13 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:11.255 03:24:13 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:11.255 03:24:13 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:11.255 03:24:13 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:11.255 03:24:13 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:11.255 03:24:13 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:11.255 03:24:13 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:11.255 03:24:13 -- host/digest.sh@16 -- # runtime=2 00:29:11.255 03:24:13 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:11.255 03:24:13 -- host/digest.sh@132 -- # nvmftestinit 00:29:11.255 03:24:13 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:11.255 03:24:13 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:11.255 03:24:13 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:11.255 03:24:13 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:11.255 03:24:13 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:11.255 03:24:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:11.255 03:24:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:11.255 03:24:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:11.255 03:24:13 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:11.255 03:24:13 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:11.255 03:24:13 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:11.255 03:24:13 -- common/autotest_common.sh@10 -- # set +x 00:29:13.158 03:24:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:13.158 03:24:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:13.158 03:24:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:13.158 03:24:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:13.158 03:24:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:13.158 03:24:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:13.158 03:24:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:13.158 03:24:15 -- nvmf/common.sh@294 -- # net_devs=() 00:29:13.158 03:24:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:13.158 03:24:15 -- nvmf/common.sh@295 -- # e810=() 00:29:13.158 03:24:15 -- nvmf/common.sh@295 -- # local -ga e810 00:29:13.158 03:24:15 -- nvmf/common.sh@296 -- # x722=() 00:29:13.158 03:24:15 -- nvmf/common.sh@296 -- # local -ga x722 00:29:13.158 03:24:15 -- nvmf/common.sh@297 -- # mlx=() 00:29:13.158 03:24:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:13.158 03:24:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:13.158 03:24:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:13.158 03:24:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:13.158 03:24:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:13.158 03:24:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:13.158 03:24:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:13.158 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:13.158 03:24:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:13.158 03:24:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:13.158 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:13.158 03:24:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:13.158 03:24:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:13.159 03:24:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:13.159 03:24:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:13.159 03:24:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:13.159 03:24:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:13.159 03:24:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:13.159 03:24:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:13.159 03:24:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:13.159 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:13.159 03:24:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:13.159 03:24:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:13.159 03:24:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:13.159 03:24:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:13.159 03:24:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:13.159 03:24:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:13.159 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:13.159 03:24:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:13.159 03:24:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:13.159 03:24:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:13.159 03:24:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:13.159 03:24:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:13.159 03:24:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:13.159 03:24:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:13.159 03:24:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:13.159 03:24:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:13.159 03:24:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:13.159 03:24:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:13.159 03:24:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:13.159 03:24:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:13.159 03:24:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:13.159 03:24:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:13.159 03:24:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:13.159 03:24:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:13.159 03:24:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:13.159 03:24:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:13.159 03:24:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:13.159 03:24:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:13.159 03:24:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:13.159 03:24:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:13.159 03:24:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:13.159 03:24:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:13.159 03:24:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:13.159 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:13.159 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.312 ms 00:29:13.159 00:29:13.159 --- 10.0.0.2 ping statistics --- 00:29:13.159 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:13.159 rtt min/avg/max/mdev = 0.312/0.312/0.312/0.000 ms 00:29:13.159 03:24:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:13.159 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:13.159 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:29:13.159 00:29:13.159 --- 10.0.0.1 ping statistics --- 00:29:13.159 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:13.159 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:29:13.159 03:24:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:13.159 03:24:15 -- nvmf/common.sh@410 -- # return 0 00:29:13.159 03:24:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:13.159 03:24:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:13.159 03:24:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:13.159 03:24:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:13.159 03:24:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:13.159 03:24:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:13.159 03:24:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:13.159 03:24:15 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:13.159 03:24:15 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:13.159 03:24:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:13.159 03:24:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:13.159 03:24:15 -- common/autotest_common.sh@10 -- # set +x 00:29:13.159 ************************************ 00:29:13.159 START TEST nvmf_digest_clean 00:29:13.159 ************************************ 00:29:13.159 03:24:15 -- common/autotest_common.sh@1114 -- # run_digest 00:29:13.159 03:24:15 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:13.159 03:24:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:13.159 03:24:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:13.159 03:24:15 -- common/autotest_common.sh@10 -- # set +x 00:29:13.159 03:24:15 -- nvmf/common.sh@469 -- # nvmfpid=2576913 00:29:13.159 03:24:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:13.159 03:24:15 -- nvmf/common.sh@470 -- # waitforlisten 2576913 00:29:13.159 03:24:15 -- common/autotest_common.sh@829 -- # '[' -z 2576913 ']' 00:29:13.159 03:24:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:13.159 03:24:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:13.159 03:24:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:13.159 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:13.159 03:24:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:13.159 03:24:15 -- common/autotest_common.sh@10 -- # set +x 00:29:13.417 [2024-11-27 03:24:15.787230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:13.417 [2024-11-27 03:24:15.787300] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:13.417 EAL: No free 2048 kB hugepages reported on node 1 00:29:13.417 [2024-11-27 03:24:15.854814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:13.417 [2024-11-27 03:24:15.944919] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:13.417 [2024-11-27 03:24:15.945092] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:13.417 [2024-11-27 03:24:15.945110] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:13.417 [2024-11-27 03:24:15.945122] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:13.417 [2024-11-27 03:24:15.945149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:13.674 03:24:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:13.674 03:24:16 -- common/autotest_common.sh@862 -- # return 0 00:29:13.674 03:24:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:13.674 03:24:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:13.674 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.674 03:24:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:13.674 03:24:16 -- host/digest.sh@120 -- # common_target_config 00:29:13.674 03:24:16 -- host/digest.sh@43 -- # rpc_cmd 00:29:13.674 03:24:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.674 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.674 null0 00:29:13.674 [2024-11-27 03:24:16.172439] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:13.674 [2024-11-27 03:24:16.196663] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:13.674 03:24:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.674 03:24:16 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:13.674 03:24:16 -- host/digest.sh@77 -- # local rw bs qd 00:29:13.674 03:24:16 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:13.674 03:24:16 -- host/digest.sh@80 -- # rw=randread 00:29:13.674 03:24:16 -- host/digest.sh@80 -- # bs=4096 00:29:13.674 03:24:16 -- host/digest.sh@80 -- # qd=128 00:29:13.674 03:24:16 -- host/digest.sh@82 -- # bperfpid=2576940 00:29:13.674 03:24:16 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:13.674 03:24:16 -- host/digest.sh@83 -- # waitforlisten 2576940 /var/tmp/bperf.sock 00:29:13.674 03:24:16 -- common/autotest_common.sh@829 -- # '[' -z 2576940 ']' 00:29:13.674 03:24:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:13.674 03:24:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:13.674 03:24:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:13.674 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:13.674 03:24:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:13.674 03:24:16 -- common/autotest_common.sh@10 -- # set +x 00:29:13.675 [2024-11-27 03:24:16.237981] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:13.675 [2024-11-27 03:24:16.238054] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2576940 ] 00:29:13.675 EAL: No free 2048 kB hugepages reported on node 1 00:29:13.932 [2024-11-27 03:24:16.297561] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:13.932 [2024-11-27 03:24:16.381488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:13.932 03:24:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:13.932 03:24:16 -- common/autotest_common.sh@862 -- # return 0 00:29:13.932 03:24:16 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:13.932 03:24:16 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:13.932 03:24:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:14.502 03:24:16 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:14.502 03:24:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:14.758 nvme0n1 00:29:14.758 03:24:17 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:14.758 03:24:17 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:15.017 Running I/O for 2 seconds... 00:29:16.920 00:29:16.920 Latency(us) 00:29:16.920 [2024-11-27T02:24:19.539Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:16.920 [2024-11-27T02:24:19.539Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:16.920 nvme0n1 : 2.00 16037.23 62.65 0.00 0.00 7975.64 3519.53 18252.99 00:29:16.920 [2024-11-27T02:24:19.539Z] =================================================================================================================== 00:29:16.920 [2024-11-27T02:24:19.539Z] Total : 16037.23 62.65 0.00 0.00 7975.64 3519.53 18252.99 00:29:16.920 0 00:29:16.920 03:24:19 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:16.920 03:24:19 -- host/digest.sh@92 -- # get_accel_stats 00:29:16.920 03:24:19 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:16.920 03:24:19 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:16.920 03:24:19 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:16.920 | select(.opcode=="crc32c") 00:29:16.920 | "\(.module_name) \(.executed)"' 00:29:17.178 03:24:19 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:17.178 03:24:19 -- host/digest.sh@93 -- # exp_module=software 00:29:17.178 03:24:19 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:17.178 03:24:19 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:17.178 03:24:19 -- host/digest.sh@97 -- # killprocess 2576940 00:29:17.178 03:24:19 -- common/autotest_common.sh@936 -- # '[' -z 2576940 ']' 00:29:17.178 03:24:19 -- common/autotest_common.sh@940 -- # kill -0 2576940 00:29:17.178 03:24:19 -- common/autotest_common.sh@941 -- # uname 00:29:17.178 03:24:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:17.178 03:24:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2576940 00:29:17.178 03:24:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:17.178 03:24:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:17.178 03:24:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2576940' 00:29:17.178 killing process with pid 2576940 00:29:17.178 03:24:19 -- common/autotest_common.sh@955 -- # kill 2576940 00:29:17.178 Received shutdown signal, test time was about 2.000000 seconds 00:29:17.178 00:29:17.178 Latency(us) 00:29:17.178 [2024-11-27T02:24:19.797Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:17.178 [2024-11-27T02:24:19.797Z] =================================================================================================================== 00:29:17.178 [2024-11-27T02:24:19.797Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:17.178 03:24:19 -- common/autotest_common.sh@960 -- # wait 2576940 00:29:17.435 03:24:19 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:17.435 03:24:19 -- host/digest.sh@77 -- # local rw bs qd 00:29:17.435 03:24:19 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:17.435 03:24:19 -- host/digest.sh@80 -- # rw=randread 00:29:17.435 03:24:19 -- host/digest.sh@80 -- # bs=131072 00:29:17.435 03:24:19 -- host/digest.sh@80 -- # qd=16 00:29:17.435 03:24:19 -- host/digest.sh@82 -- # bperfpid=2577356 00:29:17.435 03:24:19 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:17.435 03:24:19 -- host/digest.sh@83 -- # waitforlisten 2577356 /var/tmp/bperf.sock 00:29:17.435 03:24:19 -- common/autotest_common.sh@829 -- # '[' -z 2577356 ']' 00:29:17.435 03:24:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:17.435 03:24:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:17.435 03:24:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:17.435 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:17.435 03:24:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:17.435 03:24:19 -- common/autotest_common.sh@10 -- # set +x 00:29:17.435 [2024-11-27 03:24:19.999453] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:17.435 [2024-11-27 03:24:19.999538] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2577356 ] 00:29:17.435 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:17.435 Zero copy mechanism will not be used. 00:29:17.435 EAL: No free 2048 kB hugepages reported on node 1 00:29:17.693 [2024-11-27 03:24:20.065604] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:17.693 [2024-11-27 03:24:20.156385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:17.693 03:24:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:17.693 03:24:20 -- common/autotest_common.sh@862 -- # return 0 00:29:17.693 03:24:20 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:17.693 03:24:20 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:17.693 03:24:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:18.261 03:24:20 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:18.261 03:24:20 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:18.520 nvme0n1 00:29:18.520 03:24:21 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:18.520 03:24:21 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:18.520 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:18.520 Zero copy mechanism will not be used. 00:29:18.520 Running I/O for 2 seconds... 00:29:21.049 00:29:21.049 Latency(us) 00:29:21.049 [2024-11-27T02:24:23.668Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:21.049 [2024-11-27T02:24:23.668Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:21.049 nvme0n1 : 2.00 6226.69 778.34 0.00 0.00 2565.61 649.29 11311.03 00:29:21.049 [2024-11-27T02:24:23.668Z] =================================================================================================================== 00:29:21.049 [2024-11-27T02:24:23.668Z] Total : 6226.69 778.34 0.00 0.00 2565.61 649.29 11311.03 00:29:21.049 0 00:29:21.049 03:24:23 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:21.049 03:24:23 -- host/digest.sh@92 -- # get_accel_stats 00:29:21.049 03:24:23 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:21.049 03:24:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:21.049 03:24:23 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:21.049 | select(.opcode=="crc32c") 00:29:21.049 | "\(.module_name) \(.executed)"' 00:29:21.049 03:24:23 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:21.049 03:24:23 -- host/digest.sh@93 -- # exp_module=software 00:29:21.049 03:24:23 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:21.049 03:24:23 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:21.049 03:24:23 -- host/digest.sh@97 -- # killprocess 2577356 00:29:21.049 03:24:23 -- common/autotest_common.sh@936 -- # '[' -z 2577356 ']' 00:29:21.049 03:24:23 -- common/autotest_common.sh@940 -- # kill -0 2577356 00:29:21.049 03:24:23 -- common/autotest_common.sh@941 -- # uname 00:29:21.049 03:24:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:21.049 03:24:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2577356 00:29:21.049 03:24:23 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:21.049 03:24:23 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:21.049 03:24:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2577356' 00:29:21.049 killing process with pid 2577356 00:29:21.049 03:24:23 -- common/autotest_common.sh@955 -- # kill 2577356 00:29:21.049 Received shutdown signal, test time was about 2.000000 seconds 00:29:21.049 00:29:21.049 Latency(us) 00:29:21.049 [2024-11-27T02:24:23.668Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:21.049 [2024-11-27T02:24:23.668Z] =================================================================================================================== 00:29:21.049 [2024-11-27T02:24:23.668Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:21.049 03:24:23 -- common/autotest_common.sh@960 -- # wait 2577356 00:29:21.049 03:24:23 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:21.049 03:24:23 -- host/digest.sh@77 -- # local rw bs qd 00:29:21.049 03:24:23 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:21.049 03:24:23 -- host/digest.sh@80 -- # rw=randwrite 00:29:21.049 03:24:23 -- host/digest.sh@80 -- # bs=4096 00:29:21.049 03:24:23 -- host/digest.sh@80 -- # qd=128 00:29:21.049 03:24:23 -- host/digest.sh@82 -- # bperfpid=2577902 00:29:21.049 03:24:23 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:21.049 03:24:23 -- host/digest.sh@83 -- # waitforlisten 2577902 /var/tmp/bperf.sock 00:29:21.049 03:24:23 -- common/autotest_common.sh@829 -- # '[' -z 2577902 ']' 00:29:21.049 03:24:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:21.049 03:24:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:21.049 03:24:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:21.049 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:21.049 03:24:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:21.049 03:24:23 -- common/autotest_common.sh@10 -- # set +x 00:29:21.309 [2024-11-27 03:24:23.687039] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:21.309 [2024-11-27 03:24:23.687113] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2577902 ] 00:29:21.309 EAL: No free 2048 kB hugepages reported on node 1 00:29:21.309 [2024-11-27 03:24:23.747198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:21.309 [2024-11-27 03:24:23.831158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:21.309 03:24:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:21.309 03:24:23 -- common/autotest_common.sh@862 -- # return 0 00:29:21.309 03:24:23 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:21.309 03:24:23 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:21.569 03:24:23 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:21.828 03:24:24 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:21.828 03:24:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:22.086 nvme0n1 00:29:22.086 03:24:24 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:22.086 03:24:24 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:22.343 Running I/O for 2 seconds... 00:29:24.243 00:29:24.243 Latency(us) 00:29:24.243 [2024-11-27T02:24:26.862Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:24.243 [2024-11-27T02:24:26.862Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:24.243 nvme0n1 : 2.01 21016.71 82.10 0.00 0.00 6077.98 2585.03 12621.75 00:29:24.243 [2024-11-27T02:24:26.862Z] =================================================================================================================== 00:29:24.243 [2024-11-27T02:24:26.862Z] Total : 21016.71 82.10 0.00 0.00 6077.98 2585.03 12621.75 00:29:24.243 0 00:29:24.243 03:24:26 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:24.243 03:24:26 -- host/digest.sh@92 -- # get_accel_stats 00:29:24.243 03:24:26 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:24.243 03:24:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:24.243 03:24:26 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:24.243 | select(.opcode=="crc32c") 00:29:24.243 | "\(.module_name) \(.executed)"' 00:29:24.501 03:24:27 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:24.501 03:24:27 -- host/digest.sh@93 -- # exp_module=software 00:29:24.501 03:24:27 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:24.501 03:24:27 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:24.501 03:24:27 -- host/digest.sh@97 -- # killprocess 2577902 00:29:24.501 03:24:27 -- common/autotest_common.sh@936 -- # '[' -z 2577902 ']' 00:29:24.501 03:24:27 -- common/autotest_common.sh@940 -- # kill -0 2577902 00:29:24.501 03:24:27 -- common/autotest_common.sh@941 -- # uname 00:29:24.501 03:24:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:24.501 03:24:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2577902 00:29:24.501 03:24:27 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:24.501 03:24:27 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:24.501 03:24:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2577902' 00:29:24.501 killing process with pid 2577902 00:29:24.501 03:24:27 -- common/autotest_common.sh@955 -- # kill 2577902 00:29:24.501 Received shutdown signal, test time was about 2.000000 seconds 00:29:24.501 00:29:24.501 Latency(us) 00:29:24.501 [2024-11-27T02:24:27.120Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:24.501 [2024-11-27T02:24:27.120Z] =================================================================================================================== 00:29:24.501 [2024-11-27T02:24:27.120Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:24.501 03:24:27 -- common/autotest_common.sh@960 -- # wait 2577902 00:29:24.759 03:24:27 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:24.759 03:24:27 -- host/digest.sh@77 -- # local rw bs qd 00:29:24.759 03:24:27 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:24.759 03:24:27 -- host/digest.sh@80 -- # rw=randwrite 00:29:24.759 03:24:27 -- host/digest.sh@80 -- # bs=131072 00:29:24.759 03:24:27 -- host/digest.sh@80 -- # qd=16 00:29:24.759 03:24:27 -- host/digest.sh@82 -- # bperfpid=2578324 00:29:24.759 03:24:27 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:24.759 03:24:27 -- host/digest.sh@83 -- # waitforlisten 2578324 /var/tmp/bperf.sock 00:29:24.759 03:24:27 -- common/autotest_common.sh@829 -- # '[' -z 2578324 ']' 00:29:24.759 03:24:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:24.759 03:24:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:24.759 03:24:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:24.759 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:24.759 03:24:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:24.759 03:24:27 -- common/autotest_common.sh@10 -- # set +x 00:29:24.759 [2024-11-27 03:24:27.321600] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:24.759 [2024-11-27 03:24:27.321687] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2578324 ] 00:29:24.759 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:24.759 Zero copy mechanism will not be used. 00:29:24.759 EAL: No free 2048 kB hugepages reported on node 1 00:29:25.018 [2024-11-27 03:24:27.384183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:25.018 [2024-11-27 03:24:27.472308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:25.018 03:24:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:25.018 03:24:27 -- common/autotest_common.sh@862 -- # return 0 00:29:25.018 03:24:27 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:25.018 03:24:27 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:25.018 03:24:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:25.275 03:24:27 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:25.275 03:24:27 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:25.843 nvme0n1 00:29:25.843 03:24:28 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:25.843 03:24:28 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:25.843 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:25.843 Zero copy mechanism will not be used. 00:29:25.843 Running I/O for 2 seconds... 00:29:27.745 00:29:27.745 Latency(us) 00:29:27.745 [2024-11-27T02:24:30.364Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:27.745 [2024-11-27T02:24:30.364Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:27.745 nvme0n1 : 2.00 6598.17 824.77 0.00 0.00 2418.48 1735.49 8689.59 00:29:27.745 [2024-11-27T02:24:30.364Z] =================================================================================================================== 00:29:27.745 [2024-11-27T02:24:30.364Z] Total : 6598.17 824.77 0.00 0.00 2418.48 1735.49 8689.59 00:29:27.745 0 00:29:27.745 03:24:30 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:27.745 03:24:30 -- host/digest.sh@92 -- # get_accel_stats 00:29:27.745 03:24:30 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:27.745 03:24:30 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:27.745 | select(.opcode=="crc32c") 00:29:27.745 | "\(.module_name) \(.executed)"' 00:29:27.745 03:24:30 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:28.005 03:24:30 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:28.005 03:24:30 -- host/digest.sh@93 -- # exp_module=software 00:29:28.005 03:24:30 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:28.005 03:24:30 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:28.005 03:24:30 -- host/digest.sh@97 -- # killprocess 2578324 00:29:28.005 03:24:30 -- common/autotest_common.sh@936 -- # '[' -z 2578324 ']' 00:29:28.005 03:24:30 -- common/autotest_common.sh@940 -- # kill -0 2578324 00:29:28.005 03:24:30 -- common/autotest_common.sh@941 -- # uname 00:29:28.005 03:24:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:28.005 03:24:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2578324 00:29:28.263 03:24:30 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:28.263 03:24:30 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:28.263 03:24:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2578324' 00:29:28.263 killing process with pid 2578324 00:29:28.263 03:24:30 -- common/autotest_common.sh@955 -- # kill 2578324 00:29:28.263 Received shutdown signal, test time was about 2.000000 seconds 00:29:28.263 00:29:28.263 Latency(us) 00:29:28.263 [2024-11-27T02:24:30.882Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:28.263 [2024-11-27T02:24:30.882Z] =================================================================================================================== 00:29:28.263 [2024-11-27T02:24:30.882Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:28.263 03:24:30 -- common/autotest_common.sh@960 -- # wait 2578324 00:29:28.263 03:24:30 -- host/digest.sh@126 -- # killprocess 2576913 00:29:28.263 03:24:30 -- common/autotest_common.sh@936 -- # '[' -z 2576913 ']' 00:29:28.263 03:24:30 -- common/autotest_common.sh@940 -- # kill -0 2576913 00:29:28.263 03:24:30 -- common/autotest_common.sh@941 -- # uname 00:29:28.263 03:24:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:28.263 03:24:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2576913 00:29:28.263 03:24:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:28.263 03:24:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:28.263 03:24:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2576913' 00:29:28.263 killing process with pid 2576913 00:29:28.263 03:24:30 -- common/autotest_common.sh@955 -- # kill 2576913 00:29:28.263 03:24:30 -- common/autotest_common.sh@960 -- # wait 2576913 00:29:28.521 00:29:28.521 real 0m15.343s 00:29:28.521 user 0m30.195s 00:29:28.521 sys 0m4.389s 00:29:28.521 03:24:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:28.521 03:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:28.521 ************************************ 00:29:28.521 END TEST nvmf_digest_clean 00:29:28.521 ************************************ 00:29:28.521 03:24:31 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:28.521 03:24:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:28.521 03:24:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:28.521 03:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:28.521 ************************************ 00:29:28.521 START TEST nvmf_digest_error 00:29:28.521 ************************************ 00:29:28.521 03:24:31 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:28.521 03:24:31 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:28.521 03:24:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:28.521 03:24:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:28.521 03:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:28.521 03:24:31 -- nvmf/common.sh@469 -- # nvmfpid=2578765 00:29:28.521 03:24:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:28.521 03:24:31 -- nvmf/common.sh@470 -- # waitforlisten 2578765 00:29:28.521 03:24:31 -- common/autotest_common.sh@829 -- # '[' -z 2578765 ']' 00:29:28.521 03:24:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:28.521 03:24:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:28.521 03:24:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:28.521 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:28.521 03:24:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:28.521 03:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:28.780 [2024-11-27 03:24:31.165705] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:28.780 [2024-11-27 03:24:31.165781] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:28.780 EAL: No free 2048 kB hugepages reported on node 1 00:29:28.780 [2024-11-27 03:24:31.233476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:28.780 [2024-11-27 03:24:31.320856] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:28.780 [2024-11-27 03:24:31.321024] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:28.780 [2024-11-27 03:24:31.321042] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:28.780 [2024-11-27 03:24:31.321054] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:28.780 [2024-11-27 03:24:31.321094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:28.780 03:24:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:28.780 03:24:31 -- common/autotest_common.sh@862 -- # return 0 00:29:28.780 03:24:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:28.780 03:24:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:28.780 03:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:29.039 03:24:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:29.039 03:24:31 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:29.039 03:24:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.039 03:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:29.039 [2024-11-27 03:24:31.405730] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:29.039 03:24:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.039 03:24:31 -- host/digest.sh@104 -- # common_target_config 00:29:29.039 03:24:31 -- host/digest.sh@43 -- # rpc_cmd 00:29:29.039 03:24:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:29.039 03:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:29.039 null0 00:29:29.039 [2024-11-27 03:24:31.521589] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:29.039 [2024-11-27 03:24:31.545778] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:29.039 03:24:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:29.039 03:24:31 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:29.039 03:24:31 -- host/digest.sh@54 -- # local rw bs qd 00:29:29.039 03:24:31 -- host/digest.sh@56 -- # rw=randread 00:29:29.039 03:24:31 -- host/digest.sh@56 -- # bs=4096 00:29:29.039 03:24:31 -- host/digest.sh@56 -- # qd=128 00:29:29.039 03:24:31 -- host/digest.sh@58 -- # bperfpid=2578913 00:29:29.039 03:24:31 -- host/digest.sh@60 -- # waitforlisten 2578913 /var/tmp/bperf.sock 00:29:29.039 03:24:31 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:29.039 03:24:31 -- common/autotest_common.sh@829 -- # '[' -z 2578913 ']' 00:29:29.039 03:24:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:29.039 03:24:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:29.039 03:24:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:29.039 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:29.039 03:24:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:29.039 03:24:31 -- common/autotest_common.sh@10 -- # set +x 00:29:29.039 [2024-11-27 03:24:31.590310] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:29.039 [2024-11-27 03:24:31.590382] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2578913 ] 00:29:29.039 EAL: No free 2048 kB hugepages reported on node 1 00:29:29.039 [2024-11-27 03:24:31.654437] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:29.299 [2024-11-27 03:24:31.743175] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:30.237 03:24:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:30.237 03:24:32 -- common/autotest_common.sh@862 -- # return 0 00:29:30.237 03:24:32 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:30.237 03:24:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:30.497 03:24:32 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:30.497 03:24:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.497 03:24:32 -- common/autotest_common.sh@10 -- # set +x 00:29:30.497 03:24:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.497 03:24:32 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.497 03:24:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:30.757 nvme0n1 00:29:30.757 03:24:33 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:30.757 03:24:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.757 03:24:33 -- common/autotest_common.sh@10 -- # set +x 00:29:30.757 03:24:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.757 03:24:33 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:30.757 03:24:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:30.757 Running I/O for 2 seconds... 00:29:30.757 [2024-11-27 03:24:33.375103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:30.757 [2024-11-27 03:24:33.375162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:10363 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:30.757 [2024-11-27 03:24:33.375184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.390078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.390112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:21482 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.390145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.401750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.401782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:5918 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.401799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.412922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.412958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:11287 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.412977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.428263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.428291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:16653 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.428324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.444819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.444854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:2096 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.444873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.461480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.461508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:7525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.461547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.477326] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.477354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:12519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.477384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.492243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.492273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:16541 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.492306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.503734] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.503763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:13576 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.503795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.519739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.519767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:9660 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.519798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.536403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.536437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:1059 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.536455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.553432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.553463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:24202 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.553481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.570388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.570422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:19520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.570442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.017 [2024-11-27 03:24:33.585915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.017 [2024-11-27 03:24:33.585945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:15036 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.017 [2024-11-27 03:24:33.585962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.018 [2024-11-27 03:24:33.597749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.018 [2024-11-27 03:24:33.597776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:5775 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.018 [2024-11-27 03:24:33.597807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.018 [2024-11-27 03:24:33.615739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.018 [2024-11-27 03:24:33.615768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:4647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.018 [2024-11-27 03:24:33.615800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.018 [2024-11-27 03:24:33.626571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.018 [2024-11-27 03:24:33.626605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:8983 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.018 [2024-11-27 03:24:33.626630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.277 [2024-11-27 03:24:33.639878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.277 [2024-11-27 03:24:33.639909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:6638 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.277 [2024-11-27 03:24:33.639926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.277 [2024-11-27 03:24:33.658047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.277 [2024-11-27 03:24:33.658082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:13155 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.277 [2024-11-27 03:24:33.658101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.277 [2024-11-27 03:24:33.674943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.277 [2024-11-27 03:24:33.674978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:1205 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.277 [2024-11-27 03:24:33.674997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.277 [2024-11-27 03:24:33.691015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.277 [2024-11-27 03:24:33.691067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:13368 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.277 [2024-11-27 03:24:33.691083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.277 [2024-11-27 03:24:33.709109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.277 [2024-11-27 03:24:33.709148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:11725 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.277 [2024-11-27 03:24:33.709167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.277 [2024-11-27 03:24:33.724341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.277 [2024-11-27 03:24:33.724372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:17986 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.277 [2024-11-27 03:24:33.724390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.277 [2024-11-27 03:24:33.742825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.277 [2024-11-27 03:24:33.742854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:20326 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.277 [2024-11-27 03:24:33.742886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.277 [2024-11-27 03:24:33.753702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.277 [2024-11-27 03:24:33.753731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:19906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.277 [2024-11-27 03:24:33.753762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.277 [2024-11-27 03:24:33.770239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.277 [2024-11-27 03:24:33.770280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:9154 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.278 [2024-11-27 03:24:33.770301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.278 [2024-11-27 03:24:33.787295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.278 [2024-11-27 03:24:33.787330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:19778 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.278 [2024-11-27 03:24:33.787349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.278 [2024-11-27 03:24:33.804105] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.278 [2024-11-27 03:24:33.804139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:1372 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.278 [2024-11-27 03:24:33.804157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.278 [2024-11-27 03:24:33.821100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.278 [2024-11-27 03:24:33.821134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:18242 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.278 [2024-11-27 03:24:33.821154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.278 [2024-11-27 03:24:33.837713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.278 [2024-11-27 03:24:33.837741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:6693 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.278 [2024-11-27 03:24:33.837772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.278 [2024-11-27 03:24:33.854611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.278 [2024-11-27 03:24:33.854640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:15082 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.278 [2024-11-27 03:24:33.854670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.278 [2024-11-27 03:24:33.870344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.278 [2024-11-27 03:24:33.870374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:9640 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.278 [2024-11-27 03:24:33.870407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.278 [2024-11-27 03:24:33.881656] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.278 [2024-11-27 03:24:33.881684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8119 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.278 [2024-11-27 03:24:33.881715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.536 [2024-11-27 03:24:33.899139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.536 [2024-11-27 03:24:33.899187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:8769 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.536 [2024-11-27 03:24:33.899206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.536 [2024-11-27 03:24:33.914969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.536 [2024-11-27 03:24:33.915003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22574 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.536 [2024-11-27 03:24:33.915022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.536 [2024-11-27 03:24:33.925520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.536 [2024-11-27 03:24:33.925562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:1355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.536 [2024-11-27 03:24:33.925581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.536 [2024-11-27 03:24:33.941492] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.536 [2024-11-27 03:24:33.941534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:20364 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.536 [2024-11-27 03:24:33.941556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.536 [2024-11-27 03:24:33.958394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.536 [2024-11-27 03:24:33.958428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:15950 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.536 [2024-11-27 03:24:33.958447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:115 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.536 [2024-11-27 03:24:33.975234] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.536 [2024-11-27 03:24:33.975268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:10868 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.536 [2024-11-27 03:24:33.975286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.536 [2024-11-27 03:24:33.991480] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.536 [2024-11-27 03:24:33.991515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:12598 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:33.991543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.008553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.008598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.008614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.025127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.025161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10105 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.025180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.041938] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.041967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:18833 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.041988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.057110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.057141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:21580 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.057159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.068988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.069015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:2624 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.069047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.084973] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.085007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:10199 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.085027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.101625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.101652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:25035 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.101683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.118502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.118558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:11614 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.118576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.133632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.133664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:4906 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.133681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.537 [2024-11-27 03:24:34.152165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.537 [2024-11-27 03:24:34.152199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:15477 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.537 [2024-11-27 03:24:34.152219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.168996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.169031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.169050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.180096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.180143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:11566 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.180162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.195585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.195618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:2955 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.195638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.210075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.210110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:22346 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.210128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.226379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.226414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:222 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.226433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.243627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.243656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22636 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.243688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.260198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.260227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:21762 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.260261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.276847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.276875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:8513 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.276905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:53 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.293423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.293457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:14448 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.293476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.309932] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.309962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:21946 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.310005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.326515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.326556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18074 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.326575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.337692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.337719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:12340 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.337750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.353258] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.353291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:662 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.353309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.369996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.370030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:6058 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.370049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.386807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.386853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:5842 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.386869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:31.796 [2024-11-27 03:24:34.403533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:31.796 [2024-11-27 03:24:34.403580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:21739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:31.796 [2024-11-27 03:24:34.403595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.053 [2024-11-27 03:24:34.420186] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.053 [2024-11-27 03:24:34.420220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18371 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.053 [2024-11-27 03:24:34.420239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.053 [2024-11-27 03:24:34.436911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.436945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:3774 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.436964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.453652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.453685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6551 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.453717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.470300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.470334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19743 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.470353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.487174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.487208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:11487 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.487227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.504086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.504121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20326 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.504140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.520405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.520434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:17991 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.520464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.536537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.536564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:5500 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.536595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.553184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.553213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18750 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.553229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.570026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.570061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:17413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.570080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.580310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.580343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:6574 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.580363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.595330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.595368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:16282 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.595387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.611392] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.611422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19622 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.611438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.628320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.628355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:19180 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.628374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.644491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.644532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:14348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.644553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.054 [2024-11-27 03:24:34.660945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.054 [2024-11-27 03:24:34.660978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:9218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.054 [2024-11-27 03:24:34.660997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.313 [2024-11-27 03:24:34.676040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.313 [2024-11-27 03:24:34.676071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:333 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.313 [2024-11-27 03:24:34.676104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.313 [2024-11-27 03:24:34.687263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.313 [2024-11-27 03:24:34.687307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:9309 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.313 [2024-11-27 03:24:34.687323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.313 [2024-11-27 03:24:34.703688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.313 [2024-11-27 03:24:34.703716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3854 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.313 [2024-11-27 03:24:34.703747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.313 [2024-11-27 03:24:34.719867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.313 [2024-11-27 03:24:34.719900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:2095 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.313 [2024-11-27 03:24:34.719926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.313 [2024-11-27 03:24:34.736317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.313 [2024-11-27 03:24:34.736351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:4568 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.313 [2024-11-27 03:24:34.736370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.313 [2024-11-27 03:24:34.752280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.313 [2024-11-27 03:24:34.752307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:1160 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.313 [2024-11-27 03:24:34.752338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.313 [2024-11-27 03:24:34.768055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.313 [2024-11-27 03:24:34.768082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:15311 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.313 [2024-11-27 03:24:34.768113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.313 [2024-11-27 03:24:34.784001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.313 [2024-11-27 03:24:34.784036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:14472 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.313 [2024-11-27 03:24:34.784055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.313 [2024-11-27 03:24:34.800171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.313 [2024-11-27 03:24:34.800206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:16221 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.800230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.314 [2024-11-27 03:24:34.816457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.314 [2024-11-27 03:24:34.816492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3471 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.816510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.314 [2024-11-27 03:24:34.832025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.314 [2024-11-27 03:24:34.832053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:7391 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.832084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.314 [2024-11-27 03:24:34.848221] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.314 [2024-11-27 03:24:34.848256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13929 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.848274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.314 [2024-11-27 03:24:34.863729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.314 [2024-11-27 03:24:34.863765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:8032 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.863797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.314 [2024-11-27 03:24:34.875027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.314 [2024-11-27 03:24:34.875056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:10628 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.875087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.314 [2024-11-27 03:24:34.889247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.314 [2024-11-27 03:24:34.889282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:14396 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.889301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.314 [2024-11-27 03:24:34.904548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.314 [2024-11-27 03:24:34.904578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:7707 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.904596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.314 [2024-11-27 03:24:34.915245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.314 [2024-11-27 03:24:34.915272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:4568 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.915303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.314 [2024-11-27 03:24:34.928948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.314 [2024-11-27 03:24:34.928990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:5225 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.314 [2024-11-27 03:24:34.929006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:34.944752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:34.944783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:17745 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:34.944800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:34.960128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:34.960158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:17623 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:34.960191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:34.971941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:34.971978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:13098 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:34.972009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:34.989210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:34.989244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2606 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:34.989262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.005207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.005236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:13052 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.005268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.017273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.017303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:18118 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.017335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.034276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.034310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:12842 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.034329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.050861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.050891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:3254 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.050923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.066621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.066650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:13708 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.066681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.077109] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.077142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:11524 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.077162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.092093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.092128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:17953 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.092146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.108212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.108246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:2514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.108276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.125375] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.125409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:9406 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.125428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.141721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.141749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23446 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.141780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.157856] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.157883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:18625 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.157914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.174689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.174717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:21827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.174748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.577 [2024-11-27 03:24:35.190936] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.577 [2024-11-27 03:24:35.190968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:11711 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.577 [2024-11-27 03:24:35.190985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.203660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.203691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:15226 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.203708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.220132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.220165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:21554 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.220184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.236942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.236976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:18107 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.236995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.254011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.254045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:7469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.254064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.270691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.270718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:2198 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.270748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.287478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.287512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:21768 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.287539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.304019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.304048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:25563 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.304080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.321070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.321104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22805 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.321123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.338057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.338086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:7111 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.338116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 [2024-11-27 03:24:35.354993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x80b300) 00:29:32.867 [2024-11-27 03:24:35.355027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13386 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:32.867 [2024-11-27 03:24:35.355046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:32.867 00:29:32.867 Latency(us) 00:29:32.867 [2024-11-27T02:24:35.486Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:32.867 [2024-11-27T02:24:35.486Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:32.867 nvme0n1 : 2.00 16415.05 64.12 0.00 0.00 7791.19 3495.25 25631.86 00:29:32.867 [2024-11-27T02:24:35.486Z] =================================================================================================================== 00:29:32.867 [2024-11-27T02:24:35.486Z] Total : 16415.05 64.12 0.00 0.00 7791.19 3495.25 25631.86 00:29:32.867 0 00:29:32.867 03:24:35 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:32.867 03:24:35 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:32.867 03:24:35 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:32.867 | .driver_specific 00:29:32.867 | .nvme_error 00:29:32.867 | .status_code 00:29:32.867 | .command_transient_transport_error' 00:29:32.867 03:24:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:33.150 03:24:35 -- host/digest.sh@71 -- # (( 128 > 0 )) 00:29:33.150 03:24:35 -- host/digest.sh@73 -- # killprocess 2578913 00:29:33.150 03:24:35 -- common/autotest_common.sh@936 -- # '[' -z 2578913 ']' 00:29:33.150 03:24:35 -- common/autotest_common.sh@940 -- # kill -0 2578913 00:29:33.150 03:24:35 -- common/autotest_common.sh@941 -- # uname 00:29:33.150 03:24:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:33.150 03:24:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2578913 00:29:33.150 03:24:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:33.150 03:24:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:33.150 03:24:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2578913' 00:29:33.150 killing process with pid 2578913 00:29:33.150 03:24:35 -- common/autotest_common.sh@955 -- # kill 2578913 00:29:33.150 Received shutdown signal, test time was about 2.000000 seconds 00:29:33.150 00:29:33.150 Latency(us) 00:29:33.150 [2024-11-27T02:24:35.769Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:33.150 [2024-11-27T02:24:35.769Z] =================================================================================================================== 00:29:33.150 [2024-11-27T02:24:35.769Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:33.150 03:24:35 -- common/autotest_common.sh@960 -- # wait 2578913 00:29:33.409 03:24:35 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:33.409 03:24:35 -- host/digest.sh@54 -- # local rw bs qd 00:29:33.409 03:24:35 -- host/digest.sh@56 -- # rw=randread 00:29:33.409 03:24:35 -- host/digest.sh@56 -- # bs=131072 00:29:33.409 03:24:35 -- host/digest.sh@56 -- # qd=16 00:29:33.409 03:24:35 -- host/digest.sh@58 -- # bperfpid=2579350 00:29:33.409 03:24:35 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:33.409 03:24:35 -- host/digest.sh@60 -- # waitforlisten 2579350 /var/tmp/bperf.sock 00:29:33.409 03:24:35 -- common/autotest_common.sh@829 -- # '[' -z 2579350 ']' 00:29:33.409 03:24:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:33.409 03:24:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:33.409 03:24:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:33.409 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:33.409 03:24:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:33.409 03:24:35 -- common/autotest_common.sh@10 -- # set +x 00:29:33.409 [2024-11-27 03:24:35.953336] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:33.409 [2024-11-27 03:24:35.953429] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2579350 ] 00:29:33.409 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:33.410 Zero copy mechanism will not be used. 00:29:33.410 EAL: No free 2048 kB hugepages reported on node 1 00:29:33.410 [2024-11-27 03:24:36.020751] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:33.668 [2024-11-27 03:24:36.114609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:34.604 03:24:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:34.604 03:24:36 -- common/autotest_common.sh@862 -- # return 0 00:29:34.604 03:24:36 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:34.604 03:24:36 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:34.864 03:24:37 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:34.864 03:24:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.864 03:24:37 -- common/autotest_common.sh@10 -- # set +x 00:29:34.864 03:24:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.864 03:24:37 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:34.864 03:24:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:35.120 nvme0n1 00:29:35.120 03:24:37 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:35.120 03:24:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:35.120 03:24:37 -- common/autotest_common.sh@10 -- # set +x 00:29:35.120 03:24:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:35.120 03:24:37 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:35.120 03:24:37 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:35.379 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:35.379 Zero copy mechanism will not be used. 00:29:35.379 Running I/O for 2 seconds... 00:29:35.379 [2024-11-27 03:24:37.860483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.860545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.860571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.867845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.867893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.867915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.873333] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.873380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.873400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.878021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.878056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.878075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.883152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.883186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.883206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.887678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.887709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.887726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.892447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.892491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.892511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.898722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.898753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.898771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.906013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.906048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.906067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.912689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.912734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.912752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.919897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.919931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.919950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.927067] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.927103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.927122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.933966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.934001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.934020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.939024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.939057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.939076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.943485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.943518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.943547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.947765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.947795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.947812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.951915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.951949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.951968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.955816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.955863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.955882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.959828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.959875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.959894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.964897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.964932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.964951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.969672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.969703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.969720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.974941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.974975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.974994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.980619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.980650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.980667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.986865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.986901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.986926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.379 [2024-11-27 03:24:37.992256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.379 [2024-11-27 03:24:37.992290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.379 [2024-11-27 03:24:37.992309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:37.998249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:37.998285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:37.998304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.004176] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.004210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.004230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.010207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.010240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.010259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.016053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.016087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.016106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.021616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.021647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.021663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.028639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.028671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.028688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.035275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.035309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.035328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.039159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.039199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.039219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.045719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.045750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.045768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.050497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.050540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.050576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.055481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.055515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.055543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.060014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.060047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.060066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.064190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.640 [2024-11-27 03:24:38.064224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.640 [2024-11-27 03:24:38.064243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.640 [2024-11-27 03:24:38.068076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.068109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.068127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.072039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.072071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.072089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.075874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.075903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.075934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.079791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.079820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.079836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.083751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.083781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.083797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.087783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.087811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.087826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.091693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.091722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.091738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.095651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.095679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.095695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.099440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.099473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.099491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.103370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.103402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.103420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.107349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.107381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.107399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.111566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.111610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.111632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.115501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.115542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.115578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.119296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.119328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.119346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.123104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.123137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.123155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.126822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.126869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.126887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.130782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.130812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.130828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.135094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.135127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.135146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.140709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.140739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.140771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.145538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.145588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.145606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.150565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.150596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.150627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.155639] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.155669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.155686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.160699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.160729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.160745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.641 [2024-11-27 03:24:38.165722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.641 [2024-11-27 03:24:38.165755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.641 [2024-11-27 03:24:38.165772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.171087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.171121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.171139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.176095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.176129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.176147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.181089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.181122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.181141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.186199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.186241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.186259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.191458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.191491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.191517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.196585] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.196614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.196630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.201640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.201669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.201685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.205667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.205696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.205712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.209652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.209681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.209697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.213496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.213543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.213563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.217358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.217390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.217408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.221435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.221467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.221485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.225402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.225435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.225453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.229505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.229561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.229581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.233433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.233466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.233484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.237472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.237505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.237537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.241400] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.241431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.241449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.245433] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.245469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.245487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.249416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.249447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.249465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.642 [2024-11-27 03:24:38.253482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.642 [2024-11-27 03:24:38.253514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.642 [2024-11-27 03:24:38.253564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.902 [2024-11-27 03:24:38.257675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.902 [2024-11-27 03:24:38.257704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.902 [2024-11-27 03:24:38.257721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.902 [2024-11-27 03:24:38.261589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.902 [2024-11-27 03:24:38.261618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.902 [2024-11-27 03:24:38.261635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.902 [2024-11-27 03:24:38.265961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.902 [2024-11-27 03:24:38.265996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.902 [2024-11-27 03:24:38.266015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.902 [2024-11-27 03:24:38.270500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.902 [2024-11-27 03:24:38.270548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.902 [2024-11-27 03:24:38.270568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.902 [2024-11-27 03:24:38.274977] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.902 [2024-11-27 03:24:38.275009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.902 [2024-11-27 03:24:38.275028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.902 [2024-11-27 03:24:38.279974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.902 [2024-11-27 03:24:38.280007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.902 [2024-11-27 03:24:38.280026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.902 [2024-11-27 03:24:38.284547] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.284593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.284609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.288847] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.288886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.288904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.292929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.292961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.292979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.296726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.296755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.296771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.300611] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.300640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.300663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.304661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.304690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.304706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.308765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.308797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.308814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.312857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.312889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.312907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.316817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.316864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.316883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.320742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.320770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.320786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.324663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.324692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.324708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.328614] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.328643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.328659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.332471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.332502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.332520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.336407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.336439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.336457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.340338] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.340369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.340388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.344366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.344397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.344415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.348368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.348400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.348419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.352622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.352650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.352666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.356941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.356974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.356992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.361368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.361400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.361418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.366403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.366436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.366455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.371247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.371279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.371304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.376184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.376217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.903 [2024-11-27 03:24:38.376236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.903 [2024-11-27 03:24:38.381092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.903 [2024-11-27 03:24:38.381125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.381143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.386303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.386335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.386354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.391232] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.391264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.391281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.396792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.396821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.396837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.402623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.402654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.402671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.408130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.408164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.408183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.413937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.413972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.413991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.419179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.419222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.419243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.424811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.424859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.424879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.431387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.431421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.431440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.438931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.438966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.438986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.445342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.445376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.445397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.451082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.451116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.451135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.456737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.456768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.456786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.462255] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.462290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.462308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.468645] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.468676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.468694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.475331] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.475365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.475384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.481354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.481388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.481408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.487272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.487306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.487324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.491712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.491743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.491760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.496441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.496474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.496494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.501129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.501162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.501180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.506424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.506458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.506476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:35.904 [2024-11-27 03:24:38.512079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.904 [2024-11-27 03:24:38.512113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.904 [2024-11-27 03:24:38.512131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:35.905 [2024-11-27 03:24:38.517662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:35.905 [2024-11-27 03:24:38.517693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:35.905 [2024-11-27 03:24:38.517715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.523809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.523856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.523876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.530340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.530374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.530392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.536294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.536328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.536348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.541956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.541990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.542010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.547980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.548015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.548034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.553943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.553978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.553998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.559744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.559775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.559792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.565066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.565100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.565120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.570086] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.570126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.570145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.574937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.574971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.574989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.579127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.166 [2024-11-27 03:24:38.579159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.166 [2024-11-27 03:24:38.579177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.166 [2024-11-27 03:24:38.582380] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.582413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.582431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.587509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.587552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.587585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.593907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.593941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.593960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.599317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.599351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.599369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.604381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.604413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.604431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.609001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.609032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.609051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.613842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.613874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.613891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.618713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.618742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.618759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.623696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.623725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.623741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.628588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.628617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.628633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.633417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.633450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.633467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.638403] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.638435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.638453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.643345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.643376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.643394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.648662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.648691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.648707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.653836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.653889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.653909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.658971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.659004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.659023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.664038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.664070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.664088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.669046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.669079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.669098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.673833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.673866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.673884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.678770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.678799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.678830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.683881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.683914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.683932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.688833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.688881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.688899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.693865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.693898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.693917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.167 [2024-11-27 03:24:38.698830] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.167 [2024-11-27 03:24:38.698876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.167 [2024-11-27 03:24:38.698895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.704419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.704454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.704473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.709620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.709650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.709667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.714404] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.714437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.714456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.719668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.719712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.719729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.725208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.725241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.725260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.730998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.731034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.731054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.736798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.736846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.736866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.742163] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.742197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.742223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.747714] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.747744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.747777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.752716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.752746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.752763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.757542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.757575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.757608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.762489] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.762522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.762549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.768467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.768500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.768518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.773369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.773401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.773419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.168 [2024-11-27 03:24:38.778303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.168 [2024-11-27 03:24:38.778336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.168 [2024-11-27 03:24:38.778354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.783766] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.783797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.783814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.789509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.789557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.789592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.796307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.796341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.796360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.801786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.801816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.801848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.807712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.807741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.807773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.813245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.813279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.813297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.818569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.818620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.818638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.823697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.823728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.823744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.829057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.829092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.829111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.834922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.834957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.834976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.839765] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.839812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.839832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.845410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.845443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.845462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.853307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.853342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.853360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.859379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.430 [2024-11-27 03:24:38.859413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.430 [2024-11-27 03:24:38.859432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.430 [2024-11-27 03:24:38.865545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.865592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.865609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.872130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.872164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.872183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.879576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.879607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.879624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.887094] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.887128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.887148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.894514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.894572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.894596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.901946] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.901981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.902000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.909533] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.909566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.909586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.917065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.917098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.917118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.924626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.924656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.924673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.932219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.932253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.932272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.939691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.939722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.939739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.947268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.947301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.947320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.954236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.954270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.954288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.959939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.959973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.959992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.965852] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.965886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.965905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.972113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.972147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.972166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.978251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.978286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.978304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.984671] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.984702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.984719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.990005] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.990041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.990060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:38.995859] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:38.995894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:38.995913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:39.001728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:39.001760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:39.001777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:39.007884] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:39.007918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.431 [2024-11-27 03:24:39.007943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.431 [2024-11-27 03:24:39.013469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.431 [2024-11-27 03:24:39.013505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.432 [2024-11-27 03:24:39.013530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.432 [2024-11-27 03:24:39.018675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.432 [2024-11-27 03:24:39.018706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.432 [2024-11-27 03:24:39.018723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.432 [2024-11-27 03:24:39.023781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.432 [2024-11-27 03:24:39.023811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.432 [2024-11-27 03:24:39.023827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.432 [2024-11-27 03:24:39.029353] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.432 [2024-11-27 03:24:39.029387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.432 [2024-11-27 03:24:39.029406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.432 [2024-11-27 03:24:39.034619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.432 [2024-11-27 03:24:39.034650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.432 [2024-11-27 03:24:39.034667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.432 [2024-11-27 03:24:39.039621] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.432 [2024-11-27 03:24:39.039651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.432 [2024-11-27 03:24:39.039683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.432 [2024-11-27 03:24:39.044472] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.432 [2024-11-27 03:24:39.044505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.432 [2024-11-27 03:24:39.044523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.049349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.049382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.049401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.054195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.054235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.054255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.059161] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.059194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.059213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.063761] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.063790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.063807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.068034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.068066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.068084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.071077] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.071109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.071127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.075858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.075903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.075922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.080824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.080870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.080889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.085676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.085705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.085721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.090594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.090622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.090653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.095419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.095451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.095468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.100228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.692 [2024-11-27 03:24:39.100260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.692 [2024-11-27 03:24:39.100278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.692 [2024-11-27 03:24:39.105063] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.105096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.105114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.110093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.110126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.110144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.115025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.115056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.115074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.119238] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.119270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.119287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.123184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.123218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.123236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.127589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.127620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.127637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.131498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.131538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.131570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.135508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.135551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.135584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.139300] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.139331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.139349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.143730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.143758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.143774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.147709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.147738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.147754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.151691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.151719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.151735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.155683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.155711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.155726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.159597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.159625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.159641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.163549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.163580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.163612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.167537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.167574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.167607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.171435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.171466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.171483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.175437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.175469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.175487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.179512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.179553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.179586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.184519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.184575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.184594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.190612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.190643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.190659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.195768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.195798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.195815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.200588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.693 [2024-11-27 03:24:39.200620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.693 [2024-11-27 03:24:39.200637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.693 [2024-11-27 03:24:39.205355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.205388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.205406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.210129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.210162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.210181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.214920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.214953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.214971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.219726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.219756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.219772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.224060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.224092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.224110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.228015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.228046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.228064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.232103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.232135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.232153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.236623] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.236654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.236671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.241488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.241523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.241554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.245960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.245993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.246019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.250945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.250979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.250997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.255709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.255739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.255756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.260485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.260519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.260547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.265076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.265110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.265131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.270308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.270342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.270360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.276763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.276795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.276813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.281715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.281746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.281763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.288280] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.288315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.288334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.293198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.293242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.293261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.298833] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.298864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.298898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.694 [2024-11-27 03:24:39.304792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.694 [2024-11-27 03:24:39.304824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.694 [2024-11-27 03:24:39.304858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.310783] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.310839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.310855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.316660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.316691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.316708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.322443] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.322487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.322506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.328410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.328445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.328463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.334045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.334085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.334104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.340016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.340049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.340074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.345888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.345923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.345943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.351557] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.351603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.351619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.356642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.356673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.356691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.361718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.361749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.361766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.366051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.366094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.366113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.955 [2024-11-27 03:24:39.370118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.955 [2024-11-27 03:24:39.370151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.955 [2024-11-27 03:24:39.370169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.373888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.373921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.373939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.377771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.377800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.377817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.381975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.382019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.382039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.385502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.385543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.385563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.389515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.389576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.389593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.394081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.394115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.394133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.398323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.398356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.398375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.402431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.402463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.402482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.406626] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.406654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.406671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.410691] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.410720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.410736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.414967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.414999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.415017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.419359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.419391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.419410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.423449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.423480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.423497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.427432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.427464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.427482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.431512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.431568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.431586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.435736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.435765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.435781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.440144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.440175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.440193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.445043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.445075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.445094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.449885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.449917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.449935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.454803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.454832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.454853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.459670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.459712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.459728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.464743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.464771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.464800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.469706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.469735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.956 [2024-11-27 03:24:39.469751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.956 [2024-11-27 03:24:39.475285] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.956 [2024-11-27 03:24:39.475319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.475338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.480728] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.480773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.480789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.485804] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.485831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.485863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.490947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.490978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.490996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.496001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.496042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.496061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.501092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.501130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.501150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.506008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.506041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.506059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.510997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.511030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.511049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.516035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.516067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.516086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.521055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.521088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.521107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.525749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.525779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.525797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.530756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.530785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.530802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.535667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.535696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.535728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.540662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.540692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.540708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.545564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.545608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.545624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.550368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.550399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.550417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.555319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.555351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.555369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.560101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.560134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.560153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.565004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.565036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.565054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:36.957 [2024-11-27 03:24:39.569960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:36.957 [2024-11-27 03:24:39.569992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.957 [2024-11-27 03:24:39.570011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.217 [2024-11-27 03:24:39.574990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.217 [2024-11-27 03:24:39.575023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.217 [2024-11-27 03:24:39.575042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.217 [2024-11-27 03:24:39.579590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.217 [2024-11-27 03:24:39.579620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.217 [2024-11-27 03:24:39.579637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.217 [2024-11-27 03:24:39.584367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.217 [2024-11-27 03:24:39.584399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.217 [2024-11-27 03:24:39.584424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.217 [2024-11-27 03:24:39.589324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.217 [2024-11-27 03:24:39.589356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.217 [2024-11-27 03:24:39.589374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.217 [2024-11-27 03:24:39.594147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.217 [2024-11-27 03:24:39.594180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.217 [2024-11-27 03:24:39.594197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.217 [2024-11-27 03:24:39.599030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.217 [2024-11-27 03:24:39.599062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.217 [2024-11-27 03:24:39.599080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.217 [2024-11-27 03:24:39.603882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.217 [2024-11-27 03:24:39.603914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.217 [2024-11-27 03:24:39.603933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.217 [2024-11-27 03:24:39.608684] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.217 [2024-11-27 03:24:39.608713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.217 [2024-11-27 03:24:39.608729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.217 [2024-11-27 03:24:39.613447] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.217 [2024-11-27 03:24:39.613478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.613497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.618276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.618307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.618325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.623117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.623148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.623167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.627889] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.627922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.627940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.632638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.632669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.632685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.637469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.637501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.637519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.642413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.642444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.642462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.647259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.647290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.647309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.652066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.652097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.652115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.656928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.656961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.656979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.661713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.661741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.661757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.666553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.666602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.666625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.671481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.671512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.671538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.676321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.676352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.676370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.681155] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.681188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.681206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.686064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.686096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.686114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.691027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.691059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.691077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.695793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.695822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.695838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.700753] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.700782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.700798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.705663] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.705706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.705723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.710515] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.710560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.710580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.715337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.715369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.715387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.720272] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.720304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.720323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.725190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.218 [2024-11-27 03:24:39.725223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.218 [2024-11-27 03:24:39.725241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.218 [2024-11-27 03:24:39.730034] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.730066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.730084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.734913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.734945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.734963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.739881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.739914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.739932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.744779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.744824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.744843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.749760] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.749805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.749821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.754516] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.754556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.754575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.759469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.759501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.759519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.764337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.764368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.764386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.769384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.769416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.769434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.774372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.774404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.774422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.779292] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.779323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.779342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.784199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.784230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.784249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.789089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.789121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.789139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.794006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.794038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.794063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.799236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.799269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.799287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.804192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.804224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.804243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.810388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.810420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.810438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.816402] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.816436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.816455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.821093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.821125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.821144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.825601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.825631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.825648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.219 [2024-11-27 03:24:39.830955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.219 [2024-11-27 03:24:39.830989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.219 [2024-11-27 03:24:39.831008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.478 [2024-11-27 03:24:39.836892] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.478 [2024-11-27 03:24:39.836925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.478 [2024-11-27 03:24:39.836944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:37.478 [2024-11-27 03:24:39.842216] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.478 [2024-11-27 03:24:39.842255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.478 [2024-11-27 03:24:39.842275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:37.478 [2024-11-27 03:24:39.848264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.478 [2024-11-27 03:24:39.848297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.478 [2024-11-27 03:24:39.848316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:37.478 [2024-11-27 03:24:39.853101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1cac190) 00:29:37.478 [2024-11-27 03:24:39.853134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:37.478 [2024-11-27 03:24:39.853152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:37.478 00:29:37.478 Latency(us) 00:29:37.478 [2024-11-27T02:24:40.097Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:37.478 [2024-11-27T02:24:40.097Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:37.478 nvme0n1 : 2.00 6160.25 770.03 0.00 0.00 2593.07 667.50 8446.86 00:29:37.478 [2024-11-27T02:24:40.097Z] =================================================================================================================== 00:29:37.478 [2024-11-27T02:24:40.097Z] Total : 6160.25 770.03 0.00 0.00 2593.07 667.50 8446.86 00:29:37.478 0 00:29:37.478 03:24:39 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:37.478 03:24:39 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:37.478 03:24:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:37.478 03:24:39 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:37.478 | .driver_specific 00:29:37.478 | .nvme_error 00:29:37.478 | .status_code 00:29:37.478 | .command_transient_transport_error' 00:29:37.737 03:24:40 -- host/digest.sh@71 -- # (( 397 > 0 )) 00:29:37.737 03:24:40 -- host/digest.sh@73 -- # killprocess 2579350 00:29:37.737 03:24:40 -- common/autotest_common.sh@936 -- # '[' -z 2579350 ']' 00:29:37.737 03:24:40 -- common/autotest_common.sh@940 -- # kill -0 2579350 00:29:37.737 03:24:40 -- common/autotest_common.sh@941 -- # uname 00:29:37.737 03:24:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:37.737 03:24:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2579350 00:29:37.737 03:24:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:37.737 03:24:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:37.737 03:24:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2579350' 00:29:37.737 killing process with pid 2579350 00:29:37.737 03:24:40 -- common/autotest_common.sh@955 -- # kill 2579350 00:29:37.737 Received shutdown signal, test time was about 2.000000 seconds 00:29:37.737 00:29:37.737 Latency(us) 00:29:37.737 [2024-11-27T02:24:40.356Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:37.737 [2024-11-27T02:24:40.356Z] =================================================================================================================== 00:29:37.737 [2024-11-27T02:24:40.356Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:37.737 03:24:40 -- common/autotest_common.sh@960 -- # wait 2579350 00:29:37.994 03:24:40 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:37.994 03:24:40 -- host/digest.sh@54 -- # local rw bs qd 00:29:37.994 03:24:40 -- host/digest.sh@56 -- # rw=randwrite 00:29:37.994 03:24:40 -- host/digest.sh@56 -- # bs=4096 00:29:37.994 03:24:40 -- host/digest.sh@56 -- # qd=128 00:29:37.994 03:24:40 -- host/digest.sh@58 -- # bperfpid=2579904 00:29:37.994 03:24:40 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:37.994 03:24:40 -- host/digest.sh@60 -- # waitforlisten 2579904 /var/tmp/bperf.sock 00:29:37.994 03:24:40 -- common/autotest_common.sh@829 -- # '[' -z 2579904 ']' 00:29:37.994 03:24:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:37.994 03:24:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:37.994 03:24:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:37.994 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:37.994 03:24:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:37.994 03:24:40 -- common/autotest_common.sh@10 -- # set +x 00:29:37.995 [2024-11-27 03:24:40.419481] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:37.995 [2024-11-27 03:24:40.419597] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2579904 ] 00:29:37.995 EAL: No free 2048 kB hugepages reported on node 1 00:29:37.995 [2024-11-27 03:24:40.488270] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:37.995 [2024-11-27 03:24:40.584760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:38.930 03:24:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:38.930 03:24:41 -- common/autotest_common.sh@862 -- # return 0 00:29:38.930 03:24:41 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:38.930 03:24:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:39.189 03:24:41 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:39.189 03:24:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.189 03:24:41 -- common/autotest_common.sh@10 -- # set +x 00:29:39.189 03:24:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.189 03:24:41 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:39.189 03:24:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:39.755 nvme0n1 00:29:39.755 03:24:42 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:39.755 03:24:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.755 03:24:42 -- common/autotest_common.sh@10 -- # set +x 00:29:39.755 03:24:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.755 03:24:42 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:39.755 03:24:42 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:39.756 Running I/O for 2 seconds... 00:29:39.756 [2024-11-27 03:24:42.228903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190eea00 00:29:39.756 [2024-11-27 03:24:42.230184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:11078 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.230227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0044 p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.241763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190ea680 00:29:39.756 [2024-11-27 03:24:42.242563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:3774 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.242592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0054 p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.254234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f31b8 00:29:39.756 [2024-11-27 03:24:42.254722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:22666 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.254752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0053 p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.266719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e8d30 00:29:39.756 [2024-11-27 03:24:42.267168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:8619 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.267202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0052 p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.279192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190ec840 00:29:39.756 [2024-11-27 03:24:42.279623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:10513 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.279653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0051 p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.291547] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f2d80 00:29:39.756 [2024-11-27 03:24:42.291927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:10446 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.291960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0050 p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.304113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190de8a8 00:29:39.756 [2024-11-27 03:24:42.304450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:61 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.304483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:004f p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.316568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190df988 00:29:39.756 [2024-11-27 03:24:42.316864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24784 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.316893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:004e p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.330685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e2c28 00:29:39.756 [2024-11-27 03:24:42.332321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:16010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.332354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0074 p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.343127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e27f0 00:29:39.756 [2024-11-27 03:24:42.344950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:3049 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.344981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:006d p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.355594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e01f8 00:29:39.756 [2024-11-27 03:24:42.357177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:8248 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.357210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:006b p:0 m:0 dnr:0 00:29:39.756 [2024-11-27 03:24:42.368064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e2c28 00:29:39.756 [2024-11-27 03:24:42.369929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:528 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:39.756 [2024-11-27 03:24:42.369973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:006a p:0 m:0 dnr:0 00:29:40.017 [2024-11-27 03:24:42.379199] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f7538 00:29:40.017 [2024-11-27 03:24:42.379886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:7935 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.017 [2024-11-27 03:24:42.379919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0067 p:0 m:0 dnr:0 00:29:40.017 [2024-11-27 03:24:42.391491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e23b8 00:29:40.017 [2024-11-27 03:24:42.392195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:4138 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.017 [2024-11-27 03:24:42.392227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0066 p:0 m:0 dnr:0 00:29:40.017 [2024-11-27 03:24:42.403807] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f0350 00:29:40.017 [2024-11-27 03:24:42.404501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:18112 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.017 [2024-11-27 03:24:42.404544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0065 p:0 m:0 dnr:0 00:29:40.017 [2024-11-27 03:24:42.416054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e3060 00:29:40.017 [2024-11-27 03:24:42.416781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:19003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.017 [2024-11-27 03:24:42.416823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0064 p:0 m:0 dnr:0 00:29:40.017 [2024-11-27 03:24:42.430908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e84c0 00:29:40.017 [2024-11-27 03:24:42.432780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:10543 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.017 [2024-11-27 03:24:42.432809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:40.017 [2024-11-27 03:24:42.441750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e3498 00:29:40.017 [2024-11-27 03:24:42.442796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:21657 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.017 [2024-11-27 03:24:42.442841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:40.017 [2024-11-27 03:24:42.454109] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e3d08 00:29:40.017 [2024-11-27 03:24:42.455093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:7307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.017 [2024-11-27 03:24:42.455126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:40.017 [2024-11-27 03:24:42.466281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e27f0 00:29:40.017 [2024-11-27 03:24:42.467268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13332 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.017 [2024-11-27 03:24:42.467306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.478640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e8088 00:29:40.018 [2024-11-27 03:24:42.479630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:22854 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.479660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.490993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e1b48 00:29:40.018 [2024-11-27 03:24:42.491989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:8495 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.492022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.503300] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190eb328 00:29:40.018 [2024-11-27 03:24:42.504234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:19133 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.504268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.515327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e1710 00:29:40.018 [2024-11-27 03:24:42.517238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:24139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.517270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.526850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e5658 00:29:40.018 [2024-11-27 03:24:42.527899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:15073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.527935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0037 p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.541329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190ed920 00:29:40.018 [2024-11-27 03:24:42.543338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:4312 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.543370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0076 p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.553394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190ea248 00:29:40.018 [2024-11-27 03:24:42.554354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:8429 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.554386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.565588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190ee5c8 00:29:40.018 [2024-11-27 03:24:42.567369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:8579 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.567402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.578859] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e27f0 00:29:40.018 [2024-11-27 03:24:42.580707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:11023 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.580737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.589860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190fe720 00:29:40.018 [2024-11-27 03:24:42.590819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:13164 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.590846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:007a p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.602011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190fe720 00:29:40.018 [2024-11-27 03:24:42.603419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:6944 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.603452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.614333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190fe720 00:29:40.018 [2024-11-27 03:24:42.615868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:10830 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.615900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:40.018 [2024-11-27 03:24:42.626638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190fe720 00:29:40.018 [2024-11-27 03:24:42.628314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:9804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.018 [2024-11-27 03:24:42.628345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:40.279 [2024-11-27 03:24:42.638224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f4f40 00:29:40.280 [2024-11-27 03:24:42.638343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:10164 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.638373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.651180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e5ec8 00:29:40.280 [2024-11-27 03:24:42.652046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:9163 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.652079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0047 p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.663981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190ee5c8 00:29:40.280 [2024-11-27 03:24:42.664302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:17195 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.664335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0057 p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.678461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e6fa8 00:29:40.280 [2024-11-27 03:24:42.680207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:8840 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.680241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.690947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190ee190 00:29:40.280 [2024-11-27 03:24:42.692659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:22891 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.692703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.703329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190fe2e8 00:29:40.280 [2024-11-27 03:24:42.705044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:12757 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.705091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.715168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e6b70 00:29:40.280 [2024-11-27 03:24:42.716930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:7821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.716967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.727455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e5a90 00:29:40.280 [2024-11-27 03:24:42.729226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:5405 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.729258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.738479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e8088 00:29:40.280 [2024-11-27 03:24:42.739618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:18233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.739647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007b p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.750692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.280 [2024-11-27 03:24:42.752039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:11922 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.752072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:004d p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.763386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f57b0 00:29:40.280 [2024-11-27 03:24:42.764231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:214 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.764263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:005d p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.775908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190df118 00:29:40.280 [2024-11-27 03:24:42.776458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:20699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.776491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:005c p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.788281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e95a0 00:29:40.280 [2024-11-27 03:24:42.788813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:19640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.788862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:005b p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.800712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e6738 00:29:40.280 [2024-11-27 03:24:42.801190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:3015 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.801222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:005a p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.813076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190eb760 00:29:40.280 [2024-11-27 03:24:42.813522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:15958 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.813562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0059 p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.825470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190e6738 00:29:40.280 [2024-11-27 03:24:42.825911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4094 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.825944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0058 p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.838480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.280 [2024-11-27 03:24:42.839384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:16498 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.839418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.852256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.280 [2024-11-27 03:24:42.852509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:14764 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.852567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.280 [2024-11-27 03:24:42.866107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.280 [2024-11-27 03:24:42.866368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:14671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.280 [2024-11-27 03:24:42.866399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.281 [2024-11-27 03:24:42.879953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.281 [2024-11-27 03:24:42.880209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:9781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.281 [2024-11-27 03:24:42.880241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.281 [2024-11-27 03:24:42.893699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.281 [2024-11-27 03:24:42.893976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:3552 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.281 [2024-11-27 03:24:42.894008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:42.907423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:42.907711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:10468 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:42.907740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:42.921204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:42.921462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:20468 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:42.921494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:42.935042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:42.935298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:21148 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:42.935330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:42.948809] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:42.949079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:22379 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:42.949110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:42.962522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:42.962856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:15493 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:42.962903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:42.976327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:42.976603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:16996 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:42.976632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:42.990089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:42.990356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:8641 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:42.990388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:43.003703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:43.003967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:19565 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:43.003998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:43.017347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:43.017636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:15382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:43.017665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:43.031224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:43.031482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:4276 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:43.031515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:43.045029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:43.045279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:7074 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:43.045311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:43.058800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:43.059070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:7986 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:43.059102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:43.072645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:43.072931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:21899 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.542 [2024-11-27 03:24:43.072976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.542 [2024-11-27 03:24:43.086466] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.542 [2024-11-27 03:24:43.086745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:20706 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.543 [2024-11-27 03:24:43.086774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.543 [2024-11-27 03:24:43.100233] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.543 [2024-11-27 03:24:43.100483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:7597 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.543 [2024-11-27 03:24:43.100515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.543 [2024-11-27 03:24:43.114039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.543 [2024-11-27 03:24:43.114297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:14063 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.543 [2024-11-27 03:24:43.114329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.543 [2024-11-27 03:24:43.127748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.543 [2024-11-27 03:24:43.127998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:16203 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.543 [2024-11-27 03:24:43.128030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.543 [2024-11-27 03:24:43.141487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.543 [2024-11-27 03:24:43.141759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:2272 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.543 [2024-11-27 03:24:43.141794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.543 [2024-11-27 03:24:43.155264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.543 [2024-11-27 03:24:43.155523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:8382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.543 [2024-11-27 03:24:43.155578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.169041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.169300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:10704 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.169332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.182798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.183074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:12841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.183106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.196454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.196720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:2194 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.196749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.210219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.210477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:12068 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.210509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.224103] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.224362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:19181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.224394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.237880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.238139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:25453 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.238168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.251482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.251788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:15303 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.251817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.265154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.265414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:15003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.265445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.278883] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.279145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:11346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.279177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.292681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.292982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:8908 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.293014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.306438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.306723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:21570 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.306752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.320294] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.320571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:24145 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.320600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.804 [2024-11-27 03:24:43.333901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.804 [2024-11-27 03:24:43.334173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22775 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.804 [2024-11-27 03:24:43.334206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.805 [2024-11-27 03:24:43.347715] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.805 [2024-11-27 03:24:43.347977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:19562 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.805 [2024-11-27 03:24:43.348008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.805 [2024-11-27 03:24:43.361397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.805 [2024-11-27 03:24:43.361685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:16307 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.805 [2024-11-27 03:24:43.361715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.805 [2024-11-27 03:24:43.375210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.805 [2024-11-27 03:24:43.375458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:12517 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.805 [2024-11-27 03:24:43.375490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.805 [2024-11-27 03:24:43.389004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.805 [2024-11-27 03:24:43.389261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:12997 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.805 [2024-11-27 03:24:43.389293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.805 [2024-11-27 03:24:43.402784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.805 [2024-11-27 03:24:43.403061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:19165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.805 [2024-11-27 03:24:43.403093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:40.805 [2024-11-27 03:24:43.416450] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:40.805 [2024-11-27 03:24:43.416735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:17853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:40.805 [2024-11-27 03:24:43.416764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.430304] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.430583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:15970 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.430612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.444107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.444366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:9367 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.444398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.457887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.458144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:10539 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.458177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.471605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.471884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:16880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.471929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.485393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.485665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:21064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.485694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.499157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.499414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:23605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.499451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.512916] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.513174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:3275 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.513205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.526537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.526805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:1488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.526849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.540374] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.540653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:17794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.540681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.554154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.554412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:15449 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.554443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.567985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.568241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:20384 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.568273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.581748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.582028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:13003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.582059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.595579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.595855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:19567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.595887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.609338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.609620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:22189 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.609649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.623119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.623383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:12800 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.623414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.636896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.637149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:15429 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.637180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.650691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.650973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:20701 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.651005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.664463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.664726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:7627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.664754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.065 [2024-11-27 03:24:43.678097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.065 [2024-11-27 03:24:43.678355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:7346 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.065 [2024-11-27 03:24:43.678386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.691784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.692052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:20880 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.692085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.705549] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.705849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:16391 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.705877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.719226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.719475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:13114 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.719507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.732969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.733224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:20202 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.733256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.746668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.746936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:23530 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.746968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.760337] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.760628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:8350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.760657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.774092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.774343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:16757 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.774374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.787744] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.788013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:12366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.788045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.801440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.801728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:3209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.801757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.815181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.815436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:24765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.815467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.828811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.829085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:11751 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.829118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.842485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.842757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:7923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.842787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.856260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.856516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:24204 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.856564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.870056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.870320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:1011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.870352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.883864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.884119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:7911 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.884152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.897644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.897899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:1377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.897930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.911372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.911650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:14596 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.911679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.925067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.925349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:13627 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.925377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.325 [2024-11-27 03:24:43.938318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.325 [2024-11-27 03:24:43.938594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22976 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.325 [2024-11-27 03:24:43.938623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:43.951633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:43.951883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:11401 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:43.951915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:43.965343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:43.965618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:3316 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:43.965647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:43.979102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:43.979364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:24838 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:43.979396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:43.992939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:43.993193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:22699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:43.993225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.006658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.006939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:14804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.006974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.020464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.020755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:3917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.020784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.034202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.034458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:11055 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.034490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.047870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.048138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:6354 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.048169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.061599] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.061884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:3351 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.061915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.075302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.075581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:14064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.075610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.089094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.089349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22788 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.089381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.102884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.103138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:11342 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.103169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.116793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.117083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:20118 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.117115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.130615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.130904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:8879 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.130938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.144378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.144661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:23363 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.144690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.158140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.158397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:20520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.158429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.171993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.172247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:3336 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.172279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.185792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.186074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:22347 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.186105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.585 [2024-11-27 03:24:44.199590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.585 [2024-11-27 03:24:44.199882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:7194 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.585 [2024-11-27 03:24:44.199914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.844 [2024-11-27 03:24:44.213318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c223f0) with pdu=0x2000190f1ca0 00:29:41.844 [2024-11-27 03:24:44.213593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:7771 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:41.844 [2024-11-27 03:24:44.213627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:007e p:0 m:0 dnr:0 00:29:41.844 00:29:41.844 Latency(us) 00:29:41.844 [2024-11-27T02:24:44.463Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:41.844 [2024-11-27T02:24:44.463Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:41.844 nvme0n1 : 2.01 19180.14 74.92 0.00 0.00 6659.21 3155.44 15243.19 00:29:41.844 [2024-11-27T02:24:44.463Z] =================================================================================================================== 00:29:41.844 [2024-11-27T02:24:44.463Z] Total : 19180.14 74.92 0.00 0.00 6659.21 3155.44 15243.19 00:29:41.844 0 00:29:41.844 03:24:44 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:41.844 03:24:44 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:41.844 03:24:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:41.844 03:24:44 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:41.844 | .driver_specific 00:29:41.844 | .nvme_error 00:29:41.844 | .status_code 00:29:41.844 | .command_transient_transport_error' 00:29:42.104 03:24:44 -- host/digest.sh@71 -- # (( 150 > 0 )) 00:29:42.104 03:24:44 -- host/digest.sh@73 -- # killprocess 2579904 00:29:42.104 03:24:44 -- common/autotest_common.sh@936 -- # '[' -z 2579904 ']' 00:29:42.104 03:24:44 -- common/autotest_common.sh@940 -- # kill -0 2579904 00:29:42.104 03:24:44 -- common/autotest_common.sh@941 -- # uname 00:29:42.104 03:24:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:42.104 03:24:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2579904 00:29:42.104 03:24:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:42.104 03:24:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:42.104 03:24:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2579904' 00:29:42.104 killing process with pid 2579904 00:29:42.104 03:24:44 -- common/autotest_common.sh@955 -- # kill 2579904 00:29:42.104 Received shutdown signal, test time was about 2.000000 seconds 00:29:42.104 00:29:42.104 Latency(us) 00:29:42.104 [2024-11-27T02:24:44.723Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:42.104 [2024-11-27T02:24:44.723Z] =================================================================================================================== 00:29:42.104 [2024-11-27T02:24:44.723Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:42.104 03:24:44 -- common/autotest_common.sh@960 -- # wait 2579904 00:29:42.363 03:24:44 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:42.363 03:24:44 -- host/digest.sh@54 -- # local rw bs qd 00:29:42.363 03:24:44 -- host/digest.sh@56 -- # rw=randwrite 00:29:42.363 03:24:44 -- host/digest.sh@56 -- # bs=131072 00:29:42.363 03:24:44 -- host/digest.sh@56 -- # qd=16 00:29:42.363 03:24:44 -- host/digest.sh@58 -- # bperfpid=2580453 00:29:42.363 03:24:44 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:42.363 03:24:44 -- host/digest.sh@60 -- # waitforlisten 2580453 /var/tmp/bperf.sock 00:29:42.363 03:24:44 -- common/autotest_common.sh@829 -- # '[' -z 2580453 ']' 00:29:42.363 03:24:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:42.363 03:24:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:42.363 03:24:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:42.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:42.363 03:24:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:42.363 03:24:44 -- common/autotest_common.sh@10 -- # set +x 00:29:42.363 [2024-11-27 03:24:44.807826] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:42.363 [2024-11-27 03:24:44.807905] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2580453 ] 00:29:42.363 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:42.363 Zero copy mechanism will not be used. 00:29:42.363 EAL: No free 2048 kB hugepages reported on node 1 00:29:42.363 [2024-11-27 03:24:44.869435] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:42.363 [2024-11-27 03:24:44.956454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:43.302 03:24:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:43.302 03:24:45 -- common/autotest_common.sh@862 -- # return 0 00:29:43.302 03:24:45 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:43.302 03:24:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:43.560 03:24:46 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:43.560 03:24:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:43.560 03:24:46 -- common/autotest_common.sh@10 -- # set +x 00:29:43.560 03:24:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:43.560 03:24:46 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:43.560 03:24:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:44.128 nvme0n1 00:29:44.128 03:24:46 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:44.128 03:24:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:44.128 03:24:46 -- common/autotest_common.sh@10 -- # set +x 00:29:44.128 03:24:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:44.128 03:24:46 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:44.128 03:24:46 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:44.128 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:44.128 Zero copy mechanism will not be used. 00:29:44.128 Running I/O for 2 seconds... 00:29:44.128 [2024-11-27 03:24:46.719441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.128 [2024-11-27 03:24:46.719983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.128 [2024-11-27 03:24:46.720030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.128 [2024-11-27 03:24:46.724770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.128 [2024-11-27 03:24:46.725197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.128 [2024-11-27 03:24:46.725232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.128 [2024-11-27 03:24:46.729845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.128 [2024-11-27 03:24:46.730241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.128 [2024-11-27 03:24:46.730276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.128 [2024-11-27 03:24:46.734656] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.128 [2024-11-27 03:24:46.735253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.128 [2024-11-27 03:24:46.735287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.128 [2024-11-27 03:24:46.739743] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.128 [2024-11-27 03:24:46.740126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.128 [2024-11-27 03:24:46.740224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.128 [2024-11-27 03:24:46.744647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.128 [2024-11-27 03:24:46.744849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.128 [2024-11-27 03:24:46.744897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.750037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.750423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.750533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.754813] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.755245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.755279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.759555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.759852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.759931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.764336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.764800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.764886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.769030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.769523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.769621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.773786] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.774370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.774481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.778519] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.778906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.778940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.783286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.783719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.783750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.788005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.788539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.788601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.792773] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.793282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.793374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.797480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.797906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.797970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.802344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.802835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.802901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.806955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.807463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.807581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.811688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.812217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.812296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.816346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.816704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.816738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.821261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.821688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.391 [2024-11-27 03:24:46.821782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.391 [2024-11-27 03:24:46.825983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.391 [2024-11-27 03:24:46.826416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.826450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.830664] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.831067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.831100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.835385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.835790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.835877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.840059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.840376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.840481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.844851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.845220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.845254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.849720] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.850283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.850320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.854480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.854900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.854960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.859176] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.859609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.859672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.863973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.864433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.864532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.868706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.869011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.869089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.873504] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.874005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.874039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.878181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.878736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.878829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.882994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.883385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.883418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.887692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.888082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.888154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.892423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.892731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.892824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.897229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.897769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.897799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.901943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.902468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.902501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.906661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.907227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.907260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.911455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.392 [2024-11-27 03:24:46.911910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.392 [2024-11-27 03:24:46.912027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.392 [2024-11-27 03:24:46.916079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.916615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.916645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.920782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.921108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.921191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.925641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.925978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.926031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.930376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.930792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.930839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.935042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.935715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.935746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.939818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.940254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.940289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.944561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.945010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.945050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.949247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.949819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.949885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.954009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.954341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.954419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.958757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.959134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.959167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.963441] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.963978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.964053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.968193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.968717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.968811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.972941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.973362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.973417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.977590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.978000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.978077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.982356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.982772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.982823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.987140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.987592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.987647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.991879] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.992453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.992569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:46.996621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:46.996946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:46.997022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:47.001445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.393 [2024-11-27 03:24:47.001795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.393 [2024-11-27 03:24:47.001862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.393 [2024-11-27 03:24:47.006113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.654 [2024-11-27 03:24:47.006644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.654 [2024-11-27 03:24:47.006734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.654 [2024-11-27 03:24:47.010772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.654 [2024-11-27 03:24:47.011310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.654 [2024-11-27 03:24:47.011343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.654 [2024-11-27 03:24:47.015433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.654 [2024-11-27 03:24:47.015789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.654 [2024-11-27 03:24:47.015820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.654 [2024-11-27 03:24:47.020257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.654 [2024-11-27 03:24:47.020725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.654 [2024-11-27 03:24:47.020756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.654 [2024-11-27 03:24:47.025010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.654 [2024-11-27 03:24:47.025538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.654 [2024-11-27 03:24:47.025586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.654 [2024-11-27 03:24:47.029670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.654 [2024-11-27 03:24:47.030339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.654 [2024-11-27 03:24:47.030396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.654 [2024-11-27 03:24:47.034359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.654 [2024-11-27 03:24:47.034788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.654 [2024-11-27 03:24:47.034818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.654 [2024-11-27 03:24:47.039039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.654 [2024-11-27 03:24:47.039543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.039608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.043782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.044270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.044302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.048565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.049000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.049033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.053178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.053653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.053729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.057997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.058537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.058619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.062697] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.063011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.063102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.067640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.067956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.068046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.073132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.073517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.073559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.078873] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.079097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.079130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.084282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.084603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.084660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.089327] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.089688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.089719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.094955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.095403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.095436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.100095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.100601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.100632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.105209] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.105866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.105945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.110368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.110806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.110855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.115501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.115821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.115870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.120687] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.121218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.121251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.125888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.126421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.126547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.131025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.131349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.655 [2024-11-27 03:24:47.131415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.655 [2024-11-27 03:24:47.136283] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.655 [2024-11-27 03:24:47.136448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.136507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.141381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.141723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.141824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.146117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.146589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.146621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.150857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.151176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.151275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.155812] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.156213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.156310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.160674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.161061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.161094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.166223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.166562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.166628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.171947] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.172216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.172253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.177213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.177453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.177486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.182501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.182933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.183025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.187767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.188189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.188223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.192939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.193332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.193365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.198277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.198780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.198816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.203736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.204030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.204130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.208975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.209347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.209457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.214284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.214700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.214812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.219572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.220000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.220033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.224701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.225079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.225114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.230389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.230825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.230859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.656 [2024-11-27 03:24:47.235850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.656 [2024-11-27 03:24:47.236250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.656 [2024-11-27 03:24:47.236289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.657 [2024-11-27 03:24:47.241212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.657 [2024-11-27 03:24:47.241496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.657 [2024-11-27 03:24:47.241599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.657 [2024-11-27 03:24:47.246625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.657 [2024-11-27 03:24:47.246922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.657 [2024-11-27 03:24:47.246956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.657 [2024-11-27 03:24:47.252026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.657 [2024-11-27 03:24:47.252436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.657 [2024-11-27 03:24:47.252505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.657 [2024-11-27 03:24:47.257389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.657 [2024-11-27 03:24:47.257859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.657 [2024-11-27 03:24:47.257893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.657 [2024-11-27 03:24:47.262521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.657 [2024-11-27 03:24:47.262934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.657 [2024-11-27 03:24:47.262968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.657 [2024-11-27 03:24:47.268062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.657 [2024-11-27 03:24:47.268300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.657 [2024-11-27 03:24:47.268390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.918 [2024-11-27 03:24:47.273230] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.918 [2024-11-27 03:24:47.273608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.918 [2024-11-27 03:24:47.273638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.918 [2024-11-27 03:24:47.278543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.918 [2024-11-27 03:24:47.278934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.918 [2024-11-27 03:24:47.278968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.918 [2024-11-27 03:24:47.283619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.918 [2024-11-27 03:24:47.284042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.918 [2024-11-27 03:24:47.284127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.918 [2024-11-27 03:24:47.289018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.289242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.289326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.294457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.294630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.294667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.300958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.301113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.301146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.306703] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.306946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.306979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.311644] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.312224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.312314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.316984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.317207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.317237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.322387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.322558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.322598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.327416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.327490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.327518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.331968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.332327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.332377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.336175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.336542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.336573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.340447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.340836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.340908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.344726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.345248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.345278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.349043] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.349421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.349506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.353258] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.353675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.353705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.357451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.357832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.357919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.361739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.362088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.362143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.366030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.366461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.366491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.370212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.370541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.370632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.374407] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.374773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.374819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.378739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.379161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.379200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.382921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.383390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.383420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.387231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.387630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.387668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.391455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.391787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.391824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.919 [2024-11-27 03:24:47.395678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.919 [2024-11-27 03:24:47.395993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.919 [2024-11-27 03:24:47.396049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.399957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.400312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.400342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.404345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.404688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.404745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.409390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.409660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.409690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.414714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.414984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.415017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.420682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.420856] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.420890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.425875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.426041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.426099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.430246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.430647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.430678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.434463] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.434804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.434893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.439237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.439388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.439417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.444361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.444744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.444775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.448590] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.448954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.448984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.452785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.453199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.453283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.457015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.457456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.457500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.461219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.461675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.461726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.465472] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.465783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.465813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.470503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.470728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.470759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.475975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.476285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.476322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.481739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.481942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.481972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.487282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.487502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.487541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.492445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.492688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.492718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.497801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.498062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.498092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.502989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.503232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.503265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.508537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.508847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.920 [2024-11-27 03:24:47.508876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:44.920 [2024-11-27 03:24:47.513843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.920 [2024-11-27 03:24:47.514019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.921 [2024-11-27 03:24:47.514060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:44.921 [2024-11-27 03:24:47.519189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.921 [2024-11-27 03:24:47.519426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.921 [2024-11-27 03:24:47.519456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:44.921 [2024-11-27 03:24:47.524659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.921 [2024-11-27 03:24:47.524925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.921 [2024-11-27 03:24:47.524955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:44.921 [2024-11-27 03:24:47.530060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:44.921 [2024-11-27 03:24:47.530289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:44.921 [2024-11-27 03:24:47.530324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.535303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.535489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.535519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.540511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.540720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.540751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.545971] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.546218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.546247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.551251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.551538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.551568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.556551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.556872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.556902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.561762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.562070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.562120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.567132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.567400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.567431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.572204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.572466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.572496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.577028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.577218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.577249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.582625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.582790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.582820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.588141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.588432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.588480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.593550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.593801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.593836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.598989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.599353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.599437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.604521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.604842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.604872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.610009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.610205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.610242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.615760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.615911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.615980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.621324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.183 [2024-11-27 03:24:47.621506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.183 [2024-11-27 03:24:47.621592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.183 [2024-11-27 03:24:47.626397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.626614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.626657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.630930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.631288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.631352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.635422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.635882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.635912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.639868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.640291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.640321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.644274] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.644659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.644690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.648672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.649092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.649122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.653094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.653550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.653581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.657419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.657871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.657901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.662285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.662441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.662471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.666660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.667128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.667158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.670945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.671121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.671170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.676001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.676223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.676312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.681101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.681397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.681427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.687049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.687196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.687226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.692362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.692589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.692651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.696858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.697018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.697048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.701562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.701848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.701953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.706165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.706460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.706541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.710516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.710964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.711014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.714796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.715252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.715346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.719089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.719258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.719295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.724037] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.724108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.724190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.728263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.728686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.728768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.184 [2024-11-27 03:24:47.732635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.184 [2024-11-27 03:24:47.733000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.184 [2024-11-27 03:24:47.733077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.736899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.737269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.737311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.741055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.741574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.741604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.745248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.745705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.745762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.749453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.749922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.749951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.753693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.754081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.754110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.757939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.758407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.758437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.762148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.762770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.762811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.766404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.766758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.766788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.770654] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.771026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.771056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.774844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.775242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.775331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.779038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.779396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.779478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.783371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.783762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.783807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.787621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.787931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.787960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.791818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.792258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.792288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.185 [2024-11-27 03:24:47.796071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.185 [2024-11-27 03:24:47.796569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.185 [2024-11-27 03:24:47.796599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.447 [2024-11-27 03:24:47.800359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.447 [2024-11-27 03:24:47.800756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.447 [2024-11-27 03:24:47.800800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.447 [2024-11-27 03:24:47.804642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.447 [2024-11-27 03:24:47.805021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.447 [2024-11-27 03:24:47.805132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.447 [2024-11-27 03:24:47.808876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.447 [2024-11-27 03:24:47.809248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.447 [2024-11-27 03:24:47.809324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.447 [2024-11-27 03:24:47.813221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.447 [2024-11-27 03:24:47.813704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.447 [2024-11-27 03:24:47.813766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.447 [2024-11-27 03:24:47.817367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.447 [2024-11-27 03:24:47.817923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.447 [2024-11-27 03:24:47.817969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.447 [2024-11-27 03:24:47.821618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.447 [2024-11-27 03:24:47.822071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.447 [2024-11-27 03:24:47.822100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.825996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.826345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.826428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.830306] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.830784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.830896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.834657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.835042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.835129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.838832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.839342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.839392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.843162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.843481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.843558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.847439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.847810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.847868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.851785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.852094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.852124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.855921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.856333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.856363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.860175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.860628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.860701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.864501] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.865042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.865103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.868639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.869015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.869045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.873017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.873380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.873410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.877202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.877448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.877478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.881550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.881980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.882010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.885759] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.886103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.886190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.889864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.890258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.890288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.894132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.894437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.894481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.898457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.898802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.898894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.902606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.902944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.902999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.906803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.907089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.907178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.910953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.911286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.911330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.915107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.915552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.915582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.919305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.919623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.448 [2024-11-27 03:24:47.919671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.448 [2024-11-27 03:24:47.923448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.448 [2024-11-27 03:24:47.923815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.923893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.927897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.928312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.928384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.932154] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.932579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.932609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.936336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.936669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.936709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.940548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.940834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.940945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.944836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.945331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.945363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.949033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.949295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.949384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.953311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.953627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.953658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.957605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.957926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.957956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.961778] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.962122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.962154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.965990] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.966385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.966415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.970115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.970346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.970411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.974427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.974908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.974954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.978669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.978955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.979024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.982851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.983156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.983226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.987203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.987412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.987487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.991361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.991853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.991935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:47.995825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:47.996046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:47.996076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:48.000482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:48.000607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:48.000691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:48.005573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:48.005737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:48.005767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:48.010941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:48.011156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:48.011186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:48.015600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:48.015883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:48.015937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:48.020344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:48.020696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:48.020738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:48.025053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.449 [2024-11-27 03:24:48.025354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.449 [2024-11-27 03:24:48.025400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.449 [2024-11-27 03:24:48.029553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.450 [2024-11-27 03:24:48.029849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.450 [2024-11-27 03:24:48.029879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.450 [2024-11-27 03:24:48.034082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.450 [2024-11-27 03:24:48.034258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.450 [2024-11-27 03:24:48.034304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.450 [2024-11-27 03:24:48.038582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.450 [2024-11-27 03:24:48.038907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.450 [2024-11-27 03:24:48.038993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.450 [2024-11-27 03:24:48.042954] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.450 [2024-11-27 03:24:48.043225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.450 [2024-11-27 03:24:48.043315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.450 [2024-11-27 03:24:48.047962] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.450 [2024-11-27 03:24:48.048221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.450 [2024-11-27 03:24:48.048275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.450 [2024-11-27 03:24:48.053197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.450 [2024-11-27 03:24:48.053410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.450 [2024-11-27 03:24:48.053491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.450 [2024-11-27 03:24:48.058678] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.450 [2024-11-27 03:24:48.058829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.450 [2024-11-27 03:24:48.058867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.064289] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.064577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.064626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.068541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.068931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.068981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.072968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.073346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.073387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.077939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.078018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.078046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.083356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.083569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.083600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.088189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.088398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.088428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.093189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.093416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.093500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.097934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.098169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.098199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.102922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.103100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.103129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.107798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.107882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.107910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.112915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.113053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.113132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.117824] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.118027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.118076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.122738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.122997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.123028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.127603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.127715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.127805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.132516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.132735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.132824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.136844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.137366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.137396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.141169] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.141631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.141698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.145345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.145708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.145738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.713 [2024-11-27 03:24:48.149662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.713 [2024-11-27 03:24:48.150182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.713 [2024-11-27 03:24:48.150224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.153882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.154219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.154248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.158096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.158351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.158385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.162394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.162693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.162723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.166512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.166930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.166960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.171138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.171332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.171406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.176252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.176453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.176498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.181838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.181972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.182007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.187729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.188029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.188060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.192870] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.193029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.193059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.198285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.198538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.198570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.203613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.203784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.203839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.208920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.209143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.209174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.214256] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.214510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.214590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.219479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.219718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.219750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.224920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.225247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.225282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.230180] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.230504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.230598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.235564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.235808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.235838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.240740] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.240996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.241047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.246104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.246316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.246362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.251280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.251502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.251540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.256533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.256654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.256722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.261793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.262067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.262097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.266276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.266575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.714 [2024-11-27 03:24:48.266646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.714 [2024-11-27 03:24:48.270708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.714 [2024-11-27 03:24:48.270975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.271006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.275725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.275946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.275977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.281228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.281535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.281573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.285593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.285978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.286027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.290005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.290354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.290416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.294257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.294734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.294789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.298478] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.298903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.298968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.302733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.303106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.303137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.306930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.307337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.307367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.311171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.311617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.311715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.315353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.315893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.315967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.319521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.319900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.319989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.323798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.324057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.324149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.715 [2024-11-27 03:24:48.327937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.715 [2024-11-27 03:24:48.328413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.715 [2024-11-27 03:24:48.328501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.977 [2024-11-27 03:24:48.332285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.977 [2024-11-27 03:24:48.332558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.977 [2024-11-27 03:24:48.332653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.977 [2024-11-27 03:24:48.336516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.977 [2024-11-27 03:24:48.336892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.977 [2024-11-27 03:24:48.336980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.977 [2024-11-27 03:24:48.340940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.977 [2024-11-27 03:24:48.341361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.977 [2024-11-27 03:24:48.341392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.977 [2024-11-27 03:24:48.345271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.977 [2024-11-27 03:24:48.345691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.977 [2024-11-27 03:24:48.345801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.977 [2024-11-27 03:24:48.349544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.977 [2024-11-27 03:24:48.349943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.977 [2024-11-27 03:24:48.350033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.977 [2024-11-27 03:24:48.353811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.977 [2024-11-27 03:24:48.354175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.977 [2024-11-27 03:24:48.354205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.977 [2024-11-27 03:24:48.358424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.977 [2024-11-27 03:24:48.358851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.977 [2024-11-27 03:24:48.358919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.977 [2024-11-27 03:24:48.363151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.977 [2024-11-27 03:24:48.363620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.977 [2024-11-27 03:24:48.363651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.367968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.368453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.368553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.373213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.373378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.373442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.378139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.378640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.378670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.382881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.383379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.383433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.387765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.387977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.388066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.392555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.392884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.392917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.397268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.397693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.397759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.402095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.402579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.402609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.406903] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.407350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.407403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.411675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.412076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.412109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.416489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.416898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.416964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.421717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.421950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.422032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.426975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.427403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.427484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.432770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.432965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.433008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.438851] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.439308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.439395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.443729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.444101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.444135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.448600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.448829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.448875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.453384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.453717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.453753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.458439] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.458701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.978 [2024-11-27 03:24:48.458734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.978 [2024-11-27 03:24:48.463855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.978 [2024-11-27 03:24:48.464160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.464194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.469406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.469567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.469621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.475938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.476147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.476245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.480696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.481305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.481396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.485761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.486039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.486098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.490535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.490861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.490891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.495561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.495903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.495988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.500514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.500730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.500761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.505676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.506006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.506036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.510489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.510947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.510981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.515544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.515807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.515837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.521146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.521499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.521542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.526214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.526603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.526634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.531360] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.531692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.531768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.536310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.536875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.536908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.541385] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.541578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.541609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.546770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.547254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.547324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.551455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.551960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.552035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.556123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.556609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.556643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.560741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.979 [2024-11-27 03:24:48.561238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.979 [2024-11-27 03:24:48.561337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.979 [2024-11-27 03:24:48.565558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.980 [2024-11-27 03:24:48.565895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.980 [2024-11-27 03:24:48.565981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.980 [2024-11-27 03:24:48.570292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.980 [2024-11-27 03:24:48.570751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.980 [2024-11-27 03:24:48.570825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:45.980 [2024-11-27 03:24:48.575045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.980 [2024-11-27 03:24:48.575447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.980 [2024-11-27 03:24:48.575506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:45.980 [2024-11-27 03:24:48.579850] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.980 [2024-11-27 03:24:48.580406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.980 [2024-11-27 03:24:48.580466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:45.980 [2024-11-27 03:24:48.584503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.980 [2024-11-27 03:24:48.584879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.980 [2024-11-27 03:24:48.584981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:45.980 [2024-11-27 03:24:48.589995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:45.980 [2024-11-27 03:24:48.590221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:45.980 [2024-11-27 03:24:48.590249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.594754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.595183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.595216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.599424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.599952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.600013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.604147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.604733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.604782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.608949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.609456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.609490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.614073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.614216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.614247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.618763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.619206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.619239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.623475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.623885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.623983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.628177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.628798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.628841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.632939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.633268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.633325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.637797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.638125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.638155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.642511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.643044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.643114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.647726] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.647843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.647872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.652534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.240 [2024-11-27 03:24:48.652953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.240 [2024-11-27 03:24:48.653039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.240 [2024-11-27 03:24:48.657325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.657704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.657814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.661999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.662356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.662485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.666674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.667130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.667162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.671288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.671765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.671827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.676210] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.676746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.676776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.680889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.681186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.681216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.686282] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.686511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.686551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.690974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.691338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.691374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.695667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.696085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.696149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.700397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.700820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.700894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.705056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.705606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.705645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.709781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.710142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.710189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:46.241 [2024-11-27 03:24:48.714416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x1c22590) with pdu=0x2000190fef90 00:29:46.241 [2024-11-27 03:24:48.714987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:46.241 [2024-11-27 03:24:48.715075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:46.241 00:29:46.241 Latency(us) 00:29:46.241 [2024-11-27T02:24:48.860Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:46.241 [2024-11-27T02:24:48.860Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:46.241 nvme0n1 : 2.00 6467.25 808.41 0.00 0.00 2463.83 1662.67 6747.78 00:29:46.241 [2024-11-27T02:24:48.860Z] =================================================================================================================== 00:29:46.241 [2024-11-27T02:24:48.860Z] Total : 6467.25 808.41 0.00 0.00 2463.83 1662.67 6747.78 00:29:46.241 0 00:29:46.241 03:24:48 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:46.241 03:24:48 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:46.241 03:24:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:46.241 03:24:48 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:46.241 | .driver_specific 00:29:46.241 | .nvme_error 00:29:46.241 | .status_code 00:29:46.241 | .command_transient_transport_error' 00:29:46.501 03:24:48 -- host/digest.sh@71 -- # (( 417 > 0 )) 00:29:46.501 03:24:48 -- host/digest.sh@73 -- # killprocess 2580453 00:29:46.501 03:24:48 -- common/autotest_common.sh@936 -- # '[' -z 2580453 ']' 00:29:46.501 03:24:48 -- common/autotest_common.sh@940 -- # kill -0 2580453 00:29:46.501 03:24:48 -- common/autotest_common.sh@941 -- # uname 00:29:46.501 03:24:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:46.501 03:24:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2580453 00:29:46.501 03:24:49 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:46.501 03:24:49 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:46.501 03:24:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2580453' 00:29:46.501 killing process with pid 2580453 00:29:46.501 03:24:49 -- common/autotest_common.sh@955 -- # kill 2580453 00:29:46.501 Received shutdown signal, test time was about 2.000000 seconds 00:29:46.501 00:29:46.501 Latency(us) 00:29:46.501 [2024-11-27T02:24:49.120Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:46.501 [2024-11-27T02:24:49.120Z] =================================================================================================================== 00:29:46.501 [2024-11-27T02:24:49.120Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:46.501 03:24:49 -- common/autotest_common.sh@960 -- # wait 2580453 00:29:46.771 03:24:49 -- host/digest.sh@115 -- # killprocess 2578765 00:29:46.771 03:24:49 -- common/autotest_common.sh@936 -- # '[' -z 2578765 ']' 00:29:46.771 03:24:49 -- common/autotest_common.sh@940 -- # kill -0 2578765 00:29:46.771 03:24:49 -- common/autotest_common.sh@941 -- # uname 00:29:46.771 03:24:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:46.771 03:24:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2578765 00:29:46.771 03:24:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:46.771 03:24:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:46.771 03:24:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2578765' 00:29:46.771 killing process with pid 2578765 00:29:46.771 03:24:49 -- common/autotest_common.sh@955 -- # kill 2578765 00:29:46.771 03:24:49 -- common/autotest_common.sh@960 -- # wait 2578765 00:29:47.033 00:29:47.033 real 0m18.417s 00:29:47.033 user 0m36.601s 00:29:47.033 sys 0m4.773s 00:29:47.033 03:24:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:47.033 03:24:49 -- common/autotest_common.sh@10 -- # set +x 00:29:47.033 ************************************ 00:29:47.033 END TEST nvmf_digest_error 00:29:47.033 ************************************ 00:29:47.033 03:24:49 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:29:47.033 03:24:49 -- host/digest.sh@139 -- # nvmftestfini 00:29:47.033 03:24:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:47.033 03:24:49 -- nvmf/common.sh@116 -- # sync 00:29:47.033 03:24:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:47.033 03:24:49 -- nvmf/common.sh@119 -- # set +e 00:29:47.033 03:24:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:47.033 03:24:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:47.033 rmmod nvme_tcp 00:29:47.033 rmmod nvme_fabrics 00:29:47.033 rmmod nvme_keyring 00:29:47.033 03:24:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:47.033 03:24:49 -- nvmf/common.sh@123 -- # set -e 00:29:47.033 03:24:49 -- nvmf/common.sh@124 -- # return 0 00:29:47.033 03:24:49 -- nvmf/common.sh@477 -- # '[' -n 2578765 ']' 00:29:47.033 03:24:49 -- nvmf/common.sh@478 -- # killprocess 2578765 00:29:47.033 03:24:49 -- common/autotest_common.sh@936 -- # '[' -z 2578765 ']' 00:29:47.033 03:24:49 -- common/autotest_common.sh@940 -- # kill -0 2578765 00:29:47.033 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2578765) - No such process 00:29:47.033 03:24:49 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2578765 is not found' 00:29:47.033 Process with pid 2578765 is not found 00:29:47.033 03:24:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:47.033 03:24:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:47.033 03:24:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:47.033 03:24:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:47.033 03:24:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:47.033 03:24:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:47.033 03:24:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:47.033 03:24:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:49.568 03:24:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:49.568 00:29:49.568 real 0m38.344s 00:29:49.568 user 1m7.718s 00:29:49.568 sys 0m10.809s 00:29:49.569 03:24:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:49.569 03:24:51 -- common/autotest_common.sh@10 -- # set +x 00:29:49.569 ************************************ 00:29:49.569 END TEST nvmf_digest 00:29:49.569 ************************************ 00:29:49.569 03:24:51 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:29:49.569 03:24:51 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:29:49.569 03:24:51 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:29:49.569 03:24:51 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:49.569 03:24:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:49.569 03:24:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:49.569 03:24:51 -- common/autotest_common.sh@10 -- # set +x 00:29:49.569 ************************************ 00:29:49.569 START TEST nvmf_bdevperf 00:29:49.569 ************************************ 00:29:49.569 03:24:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:49.569 * Looking for test storage... 00:29:49.569 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:49.569 03:24:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:49.569 03:24:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:49.569 03:24:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:49.569 03:24:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:49.569 03:24:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:49.569 03:24:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:49.569 03:24:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:49.569 03:24:51 -- scripts/common.sh@335 -- # IFS=.-: 00:29:49.569 03:24:51 -- scripts/common.sh@335 -- # read -ra ver1 00:29:49.569 03:24:51 -- scripts/common.sh@336 -- # IFS=.-: 00:29:49.569 03:24:51 -- scripts/common.sh@336 -- # read -ra ver2 00:29:49.569 03:24:51 -- scripts/common.sh@337 -- # local 'op=<' 00:29:49.569 03:24:51 -- scripts/common.sh@339 -- # ver1_l=2 00:29:49.569 03:24:51 -- scripts/common.sh@340 -- # ver2_l=1 00:29:49.569 03:24:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:49.569 03:24:51 -- scripts/common.sh@343 -- # case "$op" in 00:29:49.569 03:24:51 -- scripts/common.sh@344 -- # : 1 00:29:49.569 03:24:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:49.569 03:24:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:49.569 03:24:51 -- scripts/common.sh@364 -- # decimal 1 00:29:49.569 03:24:51 -- scripts/common.sh@352 -- # local d=1 00:29:49.569 03:24:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:49.569 03:24:51 -- scripts/common.sh@354 -- # echo 1 00:29:49.569 03:24:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:49.569 03:24:51 -- scripts/common.sh@365 -- # decimal 2 00:29:49.569 03:24:51 -- scripts/common.sh@352 -- # local d=2 00:29:49.569 03:24:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:49.569 03:24:51 -- scripts/common.sh@354 -- # echo 2 00:29:49.569 03:24:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:49.569 03:24:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:49.569 03:24:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:49.569 03:24:51 -- scripts/common.sh@367 -- # return 0 00:29:49.569 03:24:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:49.569 03:24:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:49.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:49.569 --rc genhtml_branch_coverage=1 00:29:49.569 --rc genhtml_function_coverage=1 00:29:49.569 --rc genhtml_legend=1 00:29:49.569 --rc geninfo_all_blocks=1 00:29:49.569 --rc geninfo_unexecuted_blocks=1 00:29:49.569 00:29:49.569 ' 00:29:49.569 03:24:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:49.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:49.569 --rc genhtml_branch_coverage=1 00:29:49.569 --rc genhtml_function_coverage=1 00:29:49.569 --rc genhtml_legend=1 00:29:49.569 --rc geninfo_all_blocks=1 00:29:49.569 --rc geninfo_unexecuted_blocks=1 00:29:49.569 00:29:49.569 ' 00:29:49.569 03:24:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:49.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:49.569 --rc genhtml_branch_coverage=1 00:29:49.569 --rc genhtml_function_coverage=1 00:29:49.569 --rc genhtml_legend=1 00:29:49.569 --rc geninfo_all_blocks=1 00:29:49.569 --rc geninfo_unexecuted_blocks=1 00:29:49.569 00:29:49.569 ' 00:29:49.569 03:24:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:49.569 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:49.569 --rc genhtml_branch_coverage=1 00:29:49.569 --rc genhtml_function_coverage=1 00:29:49.569 --rc genhtml_legend=1 00:29:49.569 --rc geninfo_all_blocks=1 00:29:49.569 --rc geninfo_unexecuted_blocks=1 00:29:49.569 00:29:49.569 ' 00:29:49.569 03:24:51 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:49.569 03:24:51 -- nvmf/common.sh@7 -- # uname -s 00:29:49.569 03:24:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:49.569 03:24:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:49.569 03:24:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:49.569 03:24:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:49.569 03:24:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:49.569 03:24:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:49.569 03:24:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:49.569 03:24:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:49.569 03:24:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:49.569 03:24:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:49.569 03:24:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:49.569 03:24:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:49.569 03:24:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:49.569 03:24:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:49.569 03:24:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:49.569 03:24:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:49.569 03:24:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:49.569 03:24:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:49.569 03:24:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:49.569 03:24:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.569 03:24:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.569 03:24:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.569 03:24:51 -- paths/export.sh@5 -- # export PATH 00:29:49.569 03:24:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:49.569 03:24:51 -- nvmf/common.sh@46 -- # : 0 00:29:49.569 03:24:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:49.569 03:24:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:49.569 03:24:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:49.569 03:24:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:49.569 03:24:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:49.569 03:24:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:49.569 03:24:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:49.569 03:24:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:49.569 03:24:51 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:49.569 03:24:51 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:49.569 03:24:51 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:49.569 03:24:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:49.569 03:24:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:49.569 03:24:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:49.569 03:24:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:49.569 03:24:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:49.570 03:24:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:49.570 03:24:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:49.570 03:24:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:49.570 03:24:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:49.570 03:24:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:49.570 03:24:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:49.570 03:24:51 -- common/autotest_common.sh@10 -- # set +x 00:29:51.475 03:24:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:51.475 03:24:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:51.475 03:24:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:51.475 03:24:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:51.475 03:24:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:51.475 03:24:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:51.475 03:24:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:51.475 03:24:53 -- nvmf/common.sh@294 -- # net_devs=() 00:29:51.475 03:24:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:51.475 03:24:53 -- nvmf/common.sh@295 -- # e810=() 00:29:51.475 03:24:53 -- nvmf/common.sh@295 -- # local -ga e810 00:29:51.475 03:24:53 -- nvmf/common.sh@296 -- # x722=() 00:29:51.475 03:24:53 -- nvmf/common.sh@296 -- # local -ga x722 00:29:51.475 03:24:53 -- nvmf/common.sh@297 -- # mlx=() 00:29:51.475 03:24:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:51.475 03:24:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:51.475 03:24:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:51.475 03:24:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:51.475 03:24:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:51.475 03:24:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:51.475 03:24:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:51.475 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:51.475 03:24:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:51.475 03:24:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:51.475 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:51.475 03:24:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:51.475 03:24:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:51.475 03:24:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:51.475 03:24:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:51.475 03:24:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:51.475 03:24:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:51.475 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:51.475 03:24:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:51.475 03:24:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:51.475 03:24:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:51.475 03:24:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:51.475 03:24:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:51.475 03:24:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:51.475 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:51.475 03:24:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:51.475 03:24:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:51.475 03:24:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:51.475 03:24:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:51.475 03:24:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:51.475 03:24:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:51.475 03:24:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:51.475 03:24:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:51.475 03:24:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:51.475 03:24:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:51.475 03:24:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:51.475 03:24:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:51.475 03:24:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:51.475 03:24:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:51.475 03:24:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:51.475 03:24:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:51.475 03:24:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:51.475 03:24:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:51.475 03:24:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:51.475 03:24:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:51.475 03:24:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:51.475 03:24:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:51.475 03:24:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:51.475 03:24:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:51.475 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:51.475 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:29:51.475 00:29:51.475 --- 10.0.0.2 ping statistics --- 00:29:51.475 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:51.475 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:29:51.475 03:24:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:51.475 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:51.475 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.071 ms 00:29:51.475 00:29:51.475 --- 10.0.0.1 ping statistics --- 00:29:51.475 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:51.475 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:29:51.475 03:24:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:51.475 03:24:53 -- nvmf/common.sh@410 -- # return 0 00:29:51.475 03:24:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:51.475 03:24:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:51.475 03:24:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:51.475 03:24:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:51.475 03:24:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:51.475 03:24:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:51.475 03:24:54 -- host/bdevperf.sh@25 -- # tgt_init 00:29:51.475 03:24:54 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:51.475 03:24:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:51.475 03:24:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:51.475 03:24:54 -- common/autotest_common.sh@10 -- # set +x 00:29:51.475 03:24:54 -- nvmf/common.sh@469 -- # nvmfpid=2582964 00:29:51.475 03:24:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:51.475 03:24:54 -- nvmf/common.sh@470 -- # waitforlisten 2582964 00:29:51.475 03:24:54 -- common/autotest_common.sh@829 -- # '[' -z 2582964 ']' 00:29:51.475 03:24:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:51.475 03:24:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:51.475 03:24:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:51.475 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:51.475 03:24:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:51.476 03:24:54 -- common/autotest_common.sh@10 -- # set +x 00:29:51.476 [2024-11-27 03:24:54.062625] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:51.476 [2024-11-27 03:24:54.062699] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:51.736 EAL: No free 2048 kB hugepages reported on node 1 00:29:51.736 [2024-11-27 03:24:54.128912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:51.736 [2024-11-27 03:24:54.217234] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:51.736 [2024-11-27 03:24:54.217408] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:51.736 [2024-11-27 03:24:54.217425] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:51.736 [2024-11-27 03:24:54.217437] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:51.736 [2024-11-27 03:24:54.217692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:51.736 [2024-11-27 03:24:54.217719] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:51.736 [2024-11-27 03:24:54.217722] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:52.674 03:24:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:52.674 03:24:55 -- common/autotest_common.sh@862 -- # return 0 00:29:52.674 03:24:55 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:52.674 03:24:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:52.674 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.674 03:24:55 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:52.674 03:24:55 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:52.674 03:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.674 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.674 [2024-11-27 03:24:55.117672] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:52.674 03:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.674 03:24:55 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:52.674 03:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.674 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.674 Malloc0 00:29:52.674 03:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.674 03:24:55 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:52.674 03:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.674 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.674 03:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.674 03:24:55 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:52.674 03:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.674 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.674 03:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.674 03:24:55 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:52.674 03:24:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.674 03:24:55 -- common/autotest_common.sh@10 -- # set +x 00:29:52.674 [2024-11-27 03:24:55.184302] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:52.674 03:24:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.674 03:24:55 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:52.674 03:24:55 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:52.674 03:24:55 -- nvmf/common.sh@520 -- # config=() 00:29:52.674 03:24:55 -- nvmf/common.sh@520 -- # local subsystem config 00:29:52.674 03:24:55 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:52.674 03:24:55 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:52.674 { 00:29:52.674 "params": { 00:29:52.674 "name": "Nvme$subsystem", 00:29:52.674 "trtype": "$TEST_TRANSPORT", 00:29:52.674 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:52.674 "adrfam": "ipv4", 00:29:52.674 "trsvcid": "$NVMF_PORT", 00:29:52.674 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:52.674 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:52.674 "hdgst": ${hdgst:-false}, 00:29:52.674 "ddgst": ${ddgst:-false} 00:29:52.674 }, 00:29:52.674 "method": "bdev_nvme_attach_controller" 00:29:52.674 } 00:29:52.674 EOF 00:29:52.674 )") 00:29:52.674 03:24:55 -- nvmf/common.sh@542 -- # cat 00:29:52.674 03:24:55 -- nvmf/common.sh@544 -- # jq . 00:29:52.674 03:24:55 -- nvmf/common.sh@545 -- # IFS=, 00:29:52.674 03:24:55 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:52.674 "params": { 00:29:52.674 "name": "Nvme1", 00:29:52.674 "trtype": "tcp", 00:29:52.674 "traddr": "10.0.0.2", 00:29:52.674 "adrfam": "ipv4", 00:29:52.674 "trsvcid": "4420", 00:29:52.674 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:52.674 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:52.674 "hdgst": false, 00:29:52.674 "ddgst": false 00:29:52.674 }, 00:29:52.674 "method": "bdev_nvme_attach_controller" 00:29:52.674 }' 00:29:52.674 [2024-11-27 03:24:55.229110] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:52.674 [2024-11-27 03:24:55.229184] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2583144 ] 00:29:52.674 EAL: No free 2048 kB hugepages reported on node 1 00:29:52.932 [2024-11-27 03:24:55.294302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:52.932 [2024-11-27 03:24:55.378426] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:52.932 Running I/O for 1 seconds... 00:29:54.310 00:29:54.310 Latency(us) 00:29:54.310 [2024-11-27T02:24:56.929Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:54.310 [2024-11-27T02:24:56.929Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:54.310 Verification LBA range: start 0x0 length 0x4000 00:29:54.310 Nvme1n1 : 1.01 12809.25 50.04 0.00 0.00 9948.31 1280.38 16796.63 00:29:54.310 [2024-11-27T02:24:56.929Z] =================================================================================================================== 00:29:54.310 [2024-11-27T02:24:56.929Z] Total : 12809.25 50.04 0.00 0.00 9948.31 1280.38 16796.63 00:29:54.310 03:24:56 -- host/bdevperf.sh@30 -- # bdevperfpid=2583390 00:29:54.310 03:24:56 -- host/bdevperf.sh@32 -- # sleep 3 00:29:54.310 03:24:56 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:54.310 03:24:56 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:54.310 03:24:56 -- nvmf/common.sh@520 -- # config=() 00:29:54.310 03:24:56 -- nvmf/common.sh@520 -- # local subsystem config 00:29:54.310 03:24:56 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:54.310 03:24:56 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:54.310 { 00:29:54.310 "params": { 00:29:54.310 "name": "Nvme$subsystem", 00:29:54.310 "trtype": "$TEST_TRANSPORT", 00:29:54.310 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:54.310 "adrfam": "ipv4", 00:29:54.310 "trsvcid": "$NVMF_PORT", 00:29:54.310 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:54.310 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:54.310 "hdgst": ${hdgst:-false}, 00:29:54.310 "ddgst": ${ddgst:-false} 00:29:54.310 }, 00:29:54.310 "method": "bdev_nvme_attach_controller" 00:29:54.310 } 00:29:54.310 EOF 00:29:54.310 )") 00:29:54.310 03:24:56 -- nvmf/common.sh@542 -- # cat 00:29:54.310 03:24:56 -- nvmf/common.sh@544 -- # jq . 00:29:54.310 03:24:56 -- nvmf/common.sh@545 -- # IFS=, 00:29:54.310 03:24:56 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:54.310 "params": { 00:29:54.310 "name": "Nvme1", 00:29:54.310 "trtype": "tcp", 00:29:54.310 "traddr": "10.0.0.2", 00:29:54.310 "adrfam": "ipv4", 00:29:54.310 "trsvcid": "4420", 00:29:54.310 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:54.310 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:54.310 "hdgst": false, 00:29:54.310 "ddgst": false 00:29:54.310 }, 00:29:54.310 "method": "bdev_nvme_attach_controller" 00:29:54.310 }' 00:29:54.310 [2024-11-27 03:24:56.824718] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:54.310 [2024-11-27 03:24:56.824801] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2583390 ] 00:29:54.310 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.310 [2024-11-27 03:24:56.885674] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:54.568 [2024-11-27 03:24:56.969923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:54.825 Running I/O for 15 seconds... 00:29:57.365 03:24:59 -- host/bdevperf.sh@33 -- # kill -9 2582964 00:29:57.365 03:24:59 -- host/bdevperf.sh@35 -- # sleep 3 00:29:57.365 [2024-11-27 03:24:59.794419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794877] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:1008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:1016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:1024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.794978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.794995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:1032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:1040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:1048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:1064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:1096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:1112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:1136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:1160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:1192 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.365 [2024-11-27 03:24:59.795338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:1200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:1208 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.365 [2024-11-27 03:24:59.795403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:1216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.365 [2024-11-27 03:24:59.795435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:1224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.365 [2024-11-27 03:24:59.795622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.365 [2024-11-27 03:24:59.795636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.795969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.795986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.366 [2024-11-27 03:24:59.796065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:1240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:1248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.366 [2024-11-27 03:24:59.796129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:1256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.366 [2024-11-27 03:24:59.796165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:1264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.366 [2024-11-27 03:24:59.796199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:1272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:1280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:1288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:1296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:1304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:1312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:1320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:1328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.366 [2024-11-27 03:24:59.796728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:1336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.366 [2024-11-27 03:24:59.796757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.366 [2024-11-27 03:24:59.796772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:1344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.796786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.796801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:1352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.796832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.796849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:1360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.796864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.796881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:1368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.796896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.796913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:1376 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.796928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.796945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:1384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.796960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.796977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.796992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:1400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:1408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:1416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:1424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:1432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:1440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:1448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:1456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:1464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:1472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:1480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:1488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:1496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:1504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:1512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:1520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:1528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:1536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:1544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.367 [2024-11-27 03:24:59.797905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:1552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.367 [2024-11-27 03:24:59.797937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.367 [2024-11-27 03:24:59.797953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:1560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.368 [2024-11-27 03:24:59.797968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.797984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:1568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.368 [2024-11-27 03:24:59.797999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:1000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:1072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:1576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:1584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.368 [2024-11-27 03:24:59.798322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:1592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:1600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.368 [2024-11-27 03:24:59.798386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:1608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:1624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.368 [2024-11-27 03:24:59.798481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:1632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:1080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:1088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:1104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:1152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:1168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:1176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:57.368 [2024-11-27 03:24:59.798751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798767] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12bd900 is same with the state(5) to be set 00:29:57.368 [2024-11-27 03:24:59.798784] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:57.368 [2024-11-27 03:24:59.798796] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:57.368 [2024-11-27 03:24:59.798824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1184 len:8 PRP1 0x0 PRP2 0x0 00:29:57.368 [2024-11-27 03:24:59.798839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:57.368 [2024-11-27 03:24:59.798903] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x12bd900 was disconnected and freed. reset controller. 00:29:57.368 [2024-11-27 03:24:59.801357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.368 [2024-11-27 03:24:59.801431] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.368 [2024-11-27 03:24:59.801934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.368 [2024-11-27 03:24:59.802035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.368 [2024-11-27 03:24:59.802063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.368 [2024-11-27 03:24:59.802081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.368 [2024-11-27 03:24:59.802231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.368 [2024-11-27 03:24:59.802421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.368 [2024-11-27 03:24:59.802444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.368 [2024-11-27 03:24:59.802463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.368 [2024-11-27 03:24:59.805096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.368 [2024-11-27 03:24:59.813990] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.368 [2024-11-27 03:24:59.814320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.368 [2024-11-27 03:24:59.814456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.368 [2024-11-27 03:24:59.814485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.368 [2024-11-27 03:24:59.814502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.368 [2024-11-27 03:24:59.814715] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.368 [2024-11-27 03:24:59.814936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.369 [2024-11-27 03:24:59.814967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.369 [2024-11-27 03:24:59.814984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.369 [2024-11-27 03:24:59.817474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.369 [2024-11-27 03:24:59.826644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.369 [2024-11-27 03:24:59.827006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.827113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.827142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.369 [2024-11-27 03:24:59.827159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.369 [2024-11-27 03:24:59.827325] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.369 [2024-11-27 03:24:59.827496] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.369 [2024-11-27 03:24:59.827520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.369 [2024-11-27 03:24:59.827552] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.369 [2024-11-27 03:24:59.829700] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.369 [2024-11-27 03:24:59.839085] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.369 [2024-11-27 03:24:59.839358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.839517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.839550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.369 [2024-11-27 03:24:59.839567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.369 [2024-11-27 03:24:59.839708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.369 [2024-11-27 03:24:59.839880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.369 [2024-11-27 03:24:59.839904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.369 [2024-11-27 03:24:59.839920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.369 [2024-11-27 03:24:59.842321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.369 [2024-11-27 03:24:59.851820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.369 [2024-11-27 03:24:59.852185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.852350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.852378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.369 [2024-11-27 03:24:59.852396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.369 [2024-11-27 03:24:59.852555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.369 [2024-11-27 03:24:59.852745] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.369 [2024-11-27 03:24:59.852770] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.369 [2024-11-27 03:24:59.852791] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.369 [2024-11-27 03:24:59.855103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.369 [2024-11-27 03:24:59.864370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.369 [2024-11-27 03:24:59.864687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.864794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.864823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.369 [2024-11-27 03:24:59.864841] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.369 [2024-11-27 03:24:59.865025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.369 [2024-11-27 03:24:59.865195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.369 [2024-11-27 03:24:59.865219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.369 [2024-11-27 03:24:59.865234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.369 [2024-11-27 03:24:59.867459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.369 [2024-11-27 03:24:59.876988] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.369 [2024-11-27 03:24:59.877340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.877468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.877494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.369 [2024-11-27 03:24:59.877509] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.369 [2024-11-27 03:24:59.877666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.369 [2024-11-27 03:24:59.877858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.369 [2024-11-27 03:24:59.877883] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.369 [2024-11-27 03:24:59.877899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.369 [2024-11-27 03:24:59.880244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.369 [2024-11-27 03:24:59.889476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.369 [2024-11-27 03:24:59.889745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.889855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.889884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.369 [2024-11-27 03:24:59.889901] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.369 [2024-11-27 03:24:59.890012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.369 [2024-11-27 03:24:59.890219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.369 [2024-11-27 03:24:59.890243] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.369 [2024-11-27 03:24:59.890259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.369 [2024-11-27 03:24:59.892819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.369 [2024-11-27 03:24:59.901878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.369 [2024-11-27 03:24:59.902136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.902253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.902296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.369 [2024-11-27 03:24:59.902313] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.369 [2024-11-27 03:24:59.902444] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.369 [2024-11-27 03:24:59.902698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.369 [2024-11-27 03:24:59.902724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.369 [2024-11-27 03:24:59.902740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.369 [2024-11-27 03:24:59.905138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.369 [2024-11-27 03:24:59.914408] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.369 [2024-11-27 03:24:59.914707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.914847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.369 [2024-11-27 03:24:59.914876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.369 [2024-11-27 03:24:59.914893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.369 [2024-11-27 03:24:59.915077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.369 [2024-11-27 03:24:59.915284] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.369 [2024-11-27 03:24:59.915308] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.369 [2024-11-27 03:24:59.915324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.369 [2024-11-27 03:24:59.917537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.370 [2024-11-27 03:24:59.927026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.370 [2024-11-27 03:24:59.927379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.927496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.927536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.370 [2024-11-27 03:24:59.927556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.370 [2024-11-27 03:24:59.927741] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.370 [2024-11-27 03:24:59.927912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.370 [2024-11-27 03:24:59.927936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.370 [2024-11-27 03:24:59.927952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.370 [2024-11-27 03:24:59.930100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.370 [2024-11-27 03:24:59.939692] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.370 [2024-11-27 03:24:59.940022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.940120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.940149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.370 [2024-11-27 03:24:59.940166] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.370 [2024-11-27 03:24:59.940349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.370 [2024-11-27 03:24:59.940520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.370 [2024-11-27 03:24:59.940556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.370 [2024-11-27 03:24:59.940572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.370 [2024-11-27 03:24:59.942846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.370 [2024-11-27 03:24:59.952286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.370 [2024-11-27 03:24:59.952543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.952732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.952781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.370 [2024-11-27 03:24:59.952799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.370 [2024-11-27 03:24:59.952946] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.370 [2024-11-27 03:24:59.953154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.370 [2024-11-27 03:24:59.953178] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.370 [2024-11-27 03:24:59.953194] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.370 [2024-11-27 03:24:59.955522] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.370 [2024-11-27 03:24:59.964834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.370 [2024-11-27 03:24:59.965118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.965252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.965280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.370 [2024-11-27 03:24:59.965298] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.370 [2024-11-27 03:24:59.965446] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.370 [2024-11-27 03:24:59.965611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.370 [2024-11-27 03:24:59.965636] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.370 [2024-11-27 03:24:59.965652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.370 [2024-11-27 03:24:59.967907] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.370 [2024-11-27 03:24:59.977435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.370 [2024-11-27 03:24:59.977742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.977869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.370 [2024-11-27 03:24:59.977895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.370 [2024-11-27 03:24:59.977911] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.370 [2024-11-27 03:24:59.978123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.370 [2024-11-27 03:24:59.978298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.370 [2024-11-27 03:24:59.978322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.370 [2024-11-27 03:24:59.978338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.631 [2024-11-27 03:24:59.980965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.631 [2024-11-27 03:24:59.990179] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.631 [2024-11-27 03:24:59.990481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.631 [2024-11-27 03:24:59.990611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.631 [2024-11-27 03:24:59.990638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.631 [2024-11-27 03:24:59.990654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.631 [2024-11-27 03:24:59.990849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.631 [2024-11-27 03:24:59.991002] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.631 [2024-11-27 03:24:59.991027] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.631 [2024-11-27 03:24:59.991043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.631 [2024-11-27 03:24:59.993515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.631 [2024-11-27 03:25:00.002764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.631 [2024-11-27 03:25:00.003007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.631 [2024-11-27 03:25:00.003118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.631 [2024-11-27 03:25:00.003144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.631 [2024-11-27 03:25:00.003160] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.631 [2024-11-27 03:25:00.003333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.631 [2024-11-27 03:25:00.003630] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.631 [2024-11-27 03:25:00.003673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.631 [2024-11-27 03:25:00.003702] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.631 [2024-11-27 03:25:00.006561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.631 [2024-11-27 03:25:00.015340] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.631 [2024-11-27 03:25:00.015709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.631 [2024-11-27 03:25:00.015805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.015838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.632 [2024-11-27 03:25:00.015856] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.632 [2024-11-27 03:25:00.016006] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.632 [2024-11-27 03:25:00.016171] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.632 [2024-11-27 03:25:00.016193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.632 [2024-11-27 03:25:00.016206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.632 [2024-11-27 03:25:00.018516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.632 [2024-11-27 03:25:00.028120] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.632 [2024-11-27 03:25:00.028476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.028638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.028665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.632 [2024-11-27 03:25:00.028682] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.632 [2024-11-27 03:25:00.028864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.632 [2024-11-27 03:25:00.029036] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.632 [2024-11-27 03:25:00.029056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.632 [2024-11-27 03:25:00.029068] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.632 [2024-11-27 03:25:00.031426] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.632 [2024-11-27 03:25:00.040800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.632 [2024-11-27 03:25:00.041234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.041428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.041454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.632 [2024-11-27 03:25:00.041470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.632 [2024-11-27 03:25:00.041657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.632 [2024-11-27 03:25:00.041761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.632 [2024-11-27 03:25:00.041782] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.632 [2024-11-27 03:25:00.041795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.632 [2024-11-27 03:25:00.044337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.632 [2024-11-27 03:25:00.053414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.632 [2024-11-27 03:25:00.053790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.053929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.053955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.632 [2024-11-27 03:25:00.053977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.632 [2024-11-27 03:25:00.054161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.632 [2024-11-27 03:25:00.054380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.632 [2024-11-27 03:25:00.054402] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.632 [2024-11-27 03:25:00.054415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.632 [2024-11-27 03:25:00.056742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.632 [2024-11-27 03:25:00.066032] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.632 [2024-11-27 03:25:00.066408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.066520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.066570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.632 [2024-11-27 03:25:00.066594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.632 [2024-11-27 03:25:00.066743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.632 [2024-11-27 03:25:00.066865] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.632 [2024-11-27 03:25:00.066886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.632 [2024-11-27 03:25:00.066900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.632 [2024-11-27 03:25:00.069282] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.632 [2024-11-27 03:25:00.078592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.632 [2024-11-27 03:25:00.078836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.078929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.078955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.632 [2024-11-27 03:25:00.078971] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.632 [2024-11-27 03:25:00.079133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.632 [2024-11-27 03:25:00.079318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.632 [2024-11-27 03:25:00.079338] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.632 [2024-11-27 03:25:00.079351] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.632 [2024-11-27 03:25:00.081591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.632 [2024-11-27 03:25:00.091055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.632 [2024-11-27 03:25:00.091373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.091502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.091537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.632 [2024-11-27 03:25:00.091556] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.632 [2024-11-27 03:25:00.091710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.632 [2024-11-27 03:25:00.091920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.632 [2024-11-27 03:25:00.091941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.632 [2024-11-27 03:25:00.091954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.632 [2024-11-27 03:25:00.094237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.632 [2024-11-27 03:25:00.103683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.632 [2024-11-27 03:25:00.103980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.104131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.104157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.632 [2024-11-27 03:25:00.104173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.632 [2024-11-27 03:25:00.104400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.632 [2024-11-27 03:25:00.104624] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.632 [2024-11-27 03:25:00.104646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.632 [2024-11-27 03:25:00.104659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.632 [2024-11-27 03:25:00.107012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.632 [2024-11-27 03:25:00.116418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.632 [2024-11-27 03:25:00.116729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.116875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.632 [2024-11-27 03:25:00.116901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.632 [2024-11-27 03:25:00.116917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.633 [2024-11-27 03:25:00.117124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.633 [2024-11-27 03:25:00.117295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.633 [2024-11-27 03:25:00.117314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.633 [2024-11-27 03:25:00.117327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.633 [2024-11-27 03:25:00.119497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.633 [2024-11-27 03:25:00.128994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.633 [2024-11-27 03:25:00.129403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.129560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.129586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.633 [2024-11-27 03:25:00.129603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.633 [2024-11-27 03:25:00.129736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.633 [2024-11-27 03:25:00.129891] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.633 [2024-11-27 03:25:00.129911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.633 [2024-11-27 03:25:00.129923] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.633 [2024-11-27 03:25:00.132175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.633 [2024-11-27 03:25:00.141696] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.633 [2024-11-27 03:25:00.142045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.142143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.142168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.633 [2024-11-27 03:25:00.142183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.633 [2024-11-27 03:25:00.142327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.633 [2024-11-27 03:25:00.142469] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.633 [2024-11-27 03:25:00.142490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.633 [2024-11-27 03:25:00.142503] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.633 [2024-11-27 03:25:00.144918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.633 [2024-11-27 03:25:00.154361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.633 [2024-11-27 03:25:00.154747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.154903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.154929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.633 [2024-11-27 03:25:00.154945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.633 [2024-11-27 03:25:00.155062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.633 [2024-11-27 03:25:00.155239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.633 [2024-11-27 03:25:00.155258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.633 [2024-11-27 03:25:00.155285] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.633 [2024-11-27 03:25:00.157799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.633 [2024-11-27 03:25:00.166869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.633 [2024-11-27 03:25:00.167160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.167336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.167362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.633 [2024-11-27 03:25:00.167378] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.633 [2024-11-27 03:25:00.167538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.633 [2024-11-27 03:25:00.167725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.633 [2024-11-27 03:25:00.167755] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.633 [2024-11-27 03:25:00.167771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.633 [2024-11-27 03:25:00.170047] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.633 [2024-11-27 03:25:00.179506] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.633 [2024-11-27 03:25:00.179853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.179994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.180019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.633 [2024-11-27 03:25:00.180035] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.633 [2024-11-27 03:25:00.180152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.633 [2024-11-27 03:25:00.180313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.633 [2024-11-27 03:25:00.180348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.633 [2024-11-27 03:25:00.180362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.633 [2024-11-27 03:25:00.182557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.633 [2024-11-27 03:25:00.192225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.633 [2024-11-27 03:25:00.192588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.192736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.192761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.633 [2024-11-27 03:25:00.192777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.633 [2024-11-27 03:25:00.192927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.633 [2024-11-27 03:25:00.193100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.633 [2024-11-27 03:25:00.193135] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.633 [2024-11-27 03:25:00.193148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.633 [2024-11-27 03:25:00.195469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.633 [2024-11-27 03:25:00.204749] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.633 [2024-11-27 03:25:00.205149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.205310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.205336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.633 [2024-11-27 03:25:00.205351] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.633 [2024-11-27 03:25:00.205498] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.633 [2024-11-27 03:25:00.205699] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.633 [2024-11-27 03:25:00.205722] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.633 [2024-11-27 03:25:00.205741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.633 [2024-11-27 03:25:00.207955] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.633 [2024-11-27 03:25:00.217467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.633 [2024-11-27 03:25:00.217779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.217936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.633 [2024-11-27 03:25:00.217962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.633 [2024-11-27 03:25:00.217977] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.633 [2024-11-27 03:25:00.218124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.633 [2024-11-27 03:25:00.218321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.634 [2024-11-27 03:25:00.218340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.634 [2024-11-27 03:25:00.218353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.634 [2024-11-27 03:25:00.220675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.634 [2024-11-27 03:25:00.230125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.634 [2024-11-27 03:25:00.230427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.634 [2024-11-27 03:25:00.230562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.634 [2024-11-27 03:25:00.230588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.634 [2024-11-27 03:25:00.230604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.634 [2024-11-27 03:25:00.230754] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.634 [2024-11-27 03:25:00.230918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.634 [2024-11-27 03:25:00.230952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.634 [2024-11-27 03:25:00.230965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.634 [2024-11-27 03:25:00.233367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.634 [2024-11-27 03:25:00.242887] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.634 [2024-11-27 03:25:00.243184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.634 [2024-11-27 03:25:00.243310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.634 [2024-11-27 03:25:00.243335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.634 [2024-11-27 03:25:00.243352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.634 [2024-11-27 03:25:00.243485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.634 [2024-11-27 03:25:00.243645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.634 [2024-11-27 03:25:00.243667] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.634 [2024-11-27 03:25:00.243681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.634 [2024-11-27 03:25:00.245954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.895 [2024-11-27 03:25:00.255614] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.895 [2024-11-27 03:25:00.255936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.256066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.256091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.895 [2024-11-27 03:25:00.256107] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.895 [2024-11-27 03:25:00.256272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.895 [2024-11-27 03:25:00.256473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.895 [2024-11-27 03:25:00.256493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.895 [2024-11-27 03:25:00.256521] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.895 [2024-11-27 03:25:00.258690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.895 [2024-11-27 03:25:00.268097] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.895 [2024-11-27 03:25:00.268393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.268545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.268572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.895 [2024-11-27 03:25:00.268588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.895 [2024-11-27 03:25:00.268739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.895 [2024-11-27 03:25:00.268918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.895 [2024-11-27 03:25:00.268938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.895 [2024-11-27 03:25:00.268951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.895 [2024-11-27 03:25:00.271207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.895 [2024-11-27 03:25:00.280808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.895 [2024-11-27 03:25:00.281159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.281286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.281312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.895 [2024-11-27 03:25:00.281328] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.895 [2024-11-27 03:25:00.281491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.895 [2024-11-27 03:25:00.281678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.895 [2024-11-27 03:25:00.281698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.895 [2024-11-27 03:25:00.281711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.895 [2024-11-27 03:25:00.284114] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.895 [2024-11-27 03:25:00.293330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.895 [2024-11-27 03:25:00.293649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.293807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.293833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.895 [2024-11-27 03:25:00.293849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.895 [2024-11-27 03:25:00.293982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.895 [2024-11-27 03:25:00.294160] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.895 [2024-11-27 03:25:00.294181] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.895 [2024-11-27 03:25:00.294208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.895 [2024-11-27 03:25:00.296425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.895 [2024-11-27 03:25:00.305906] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.895 [2024-11-27 03:25:00.306285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.306408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.895 [2024-11-27 03:25:00.306433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.895 [2024-11-27 03:25:00.306450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.895 [2024-11-27 03:25:00.306684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.896 [2024-11-27 03:25:00.306849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.896 [2024-11-27 03:25:00.306870] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.896 [2024-11-27 03:25:00.306884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.896 [2024-11-27 03:25:00.309177] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.896 [2024-11-27 03:25:00.318496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.896 [2024-11-27 03:25:00.318835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.319025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.319052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.896 [2024-11-27 03:25:00.319069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.896 [2024-11-27 03:25:00.319245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.896 [2024-11-27 03:25:00.319432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.896 [2024-11-27 03:25:00.319452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.896 [2024-11-27 03:25:00.319464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.896 [2024-11-27 03:25:00.321796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.896 [2024-11-27 03:25:00.331118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.896 [2024-11-27 03:25:00.331552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.331695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.331721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.896 [2024-11-27 03:25:00.331738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.896 [2024-11-27 03:25:00.331900] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.896 [2024-11-27 03:25:00.332101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.896 [2024-11-27 03:25:00.332135] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.896 [2024-11-27 03:25:00.332148] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.896 [2024-11-27 03:25:00.334405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.896 [2024-11-27 03:25:00.343631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.896 [2024-11-27 03:25:00.344010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.344144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.344168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.896 [2024-11-27 03:25:00.344184] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.896 [2024-11-27 03:25:00.344364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.896 [2024-11-27 03:25:00.344607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.896 [2024-11-27 03:25:00.344629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.896 [2024-11-27 03:25:00.344642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.896 [2024-11-27 03:25:00.346925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.896 [2024-11-27 03:25:00.356157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.896 [2024-11-27 03:25:00.356476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.356605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.356632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.896 [2024-11-27 03:25:00.356649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.896 [2024-11-27 03:25:00.356766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.896 [2024-11-27 03:25:00.356966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.896 [2024-11-27 03:25:00.356986] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.896 [2024-11-27 03:25:00.356998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.896 [2024-11-27 03:25:00.359337] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.896 [2024-11-27 03:25:00.368708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.896 [2024-11-27 03:25:00.369010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.369186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.369216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.896 [2024-11-27 03:25:00.369233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.896 [2024-11-27 03:25:00.369350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.896 [2024-11-27 03:25:00.369554] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.896 [2024-11-27 03:25:00.369575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.896 [2024-11-27 03:25:00.369604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.896 [2024-11-27 03:25:00.371911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.896 [2024-11-27 03:25:00.381215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.896 [2024-11-27 03:25:00.381564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.381708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.381734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.896 [2024-11-27 03:25:00.381749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.896 [2024-11-27 03:25:00.381897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.896 [2024-11-27 03:25:00.382059] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.896 [2024-11-27 03:25:00.382079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.896 [2024-11-27 03:25:00.382091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.896 [2024-11-27 03:25:00.384385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.896 [2024-11-27 03:25:00.393758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.896 [2024-11-27 03:25:00.394127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.394246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.394271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.896 [2024-11-27 03:25:00.394287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.896 [2024-11-27 03:25:00.394450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.896 [2024-11-27 03:25:00.394668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.896 [2024-11-27 03:25:00.394691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.896 [2024-11-27 03:25:00.394704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.896 [2024-11-27 03:25:00.396900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.896 [2024-11-27 03:25:00.406567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.896 [2024-11-27 03:25:00.406901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.407024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.896 [2024-11-27 03:25:00.407049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.896 [2024-11-27 03:25:00.407069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.896 [2024-11-27 03:25:00.407220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.896 [2024-11-27 03:25:00.407352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.896 [2024-11-27 03:25:00.407387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.897 [2024-11-27 03:25:00.407400] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.897 [2024-11-27 03:25:00.409757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.897 [2024-11-27 03:25:00.419077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.897 [2024-11-27 03:25:00.419385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.419497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.419522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.897 [2024-11-27 03:25:00.419549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.897 [2024-11-27 03:25:00.419730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.897 [2024-11-27 03:25:00.419902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.897 [2024-11-27 03:25:00.419922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.897 [2024-11-27 03:25:00.419934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.897 [2024-11-27 03:25:00.422420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.897 [2024-11-27 03:25:00.431708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.897 [2024-11-27 03:25:00.432035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.432185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.432210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.897 [2024-11-27 03:25:00.432226] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.897 [2024-11-27 03:25:00.432357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.897 [2024-11-27 03:25:00.432540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.897 [2024-11-27 03:25:00.432576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.897 [2024-11-27 03:25:00.432589] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.897 [2024-11-27 03:25:00.434848] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.897 [2024-11-27 03:25:00.444172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.897 [2024-11-27 03:25:00.444472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.444576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.444602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.897 [2024-11-27 03:25:00.444618] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.897 [2024-11-27 03:25:00.444772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.897 [2024-11-27 03:25:00.444962] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.897 [2024-11-27 03:25:00.444981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.897 [2024-11-27 03:25:00.444994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.897 [2024-11-27 03:25:00.447071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.897 [2024-11-27 03:25:00.456693] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.897 [2024-11-27 03:25:00.457019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.457143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.457170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.897 [2024-11-27 03:25:00.457186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.897 [2024-11-27 03:25:00.457364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.897 [2024-11-27 03:25:00.457557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.897 [2024-11-27 03:25:00.457593] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.897 [2024-11-27 03:25:00.457606] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.897 [2024-11-27 03:25:00.460058] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.897 [2024-11-27 03:25:00.469233] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.897 [2024-11-27 03:25:00.469565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.469656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.469682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.897 [2024-11-27 03:25:00.469697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.897 [2024-11-27 03:25:00.469856] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.897 [2024-11-27 03:25:00.470054] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.897 [2024-11-27 03:25:00.470074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.897 [2024-11-27 03:25:00.470086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.897 [2024-11-27 03:25:00.472326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.897 [2024-11-27 03:25:00.481804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.897 [2024-11-27 03:25:00.482065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.482224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.482250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.897 [2024-11-27 03:25:00.482266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.897 [2024-11-27 03:25:00.482384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.897 [2024-11-27 03:25:00.482577] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.897 [2024-11-27 03:25:00.482614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.897 [2024-11-27 03:25:00.482627] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.897 [2024-11-27 03:25:00.485076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.897 [2024-11-27 03:25:00.494404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.897 [2024-11-27 03:25:00.494720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.494816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.494842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.897 [2024-11-27 03:25:00.494858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.897 [2024-11-27 03:25:00.494991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.897 [2024-11-27 03:25:00.495195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.897 [2024-11-27 03:25:00.495215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.897 [2024-11-27 03:25:00.495227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.897 [2024-11-27 03:25:00.497502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:57.897 [2024-11-27 03:25:00.507020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:57.897 [2024-11-27 03:25:00.507388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.507502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:57.897 [2024-11-27 03:25:00.507539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:57.897 [2024-11-27 03:25:00.507557] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:57.897 [2024-11-27 03:25:00.507674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:57.897 [2024-11-27 03:25:00.507810] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:57.897 [2024-11-27 03:25:00.507846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:57.897 [2024-11-27 03:25:00.507859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:57.897 [2024-11-27 03:25:00.510242] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.157 [2024-11-27 03:25:00.519517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.157 [2024-11-27 03:25:00.519857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.157 [2024-11-27 03:25:00.519943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.157 [2024-11-27 03:25:00.519968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.157 [2024-11-27 03:25:00.519984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.157 [2024-11-27 03:25:00.520133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.157 [2024-11-27 03:25:00.520322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.157 [2024-11-27 03:25:00.520348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.158 [2024-11-27 03:25:00.520361] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.158 [2024-11-27 03:25:00.522653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.158 [2024-11-27 03:25:00.532034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.158 [2024-11-27 03:25:00.532391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.532540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.532566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.158 [2024-11-27 03:25:00.532582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.158 [2024-11-27 03:25:00.532699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.158 [2024-11-27 03:25:00.532884] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.158 [2024-11-27 03:25:00.532919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.158 [2024-11-27 03:25:00.532932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.158 [2024-11-27 03:25:00.535040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.158 [2024-11-27 03:25:00.544511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.158 [2024-11-27 03:25:00.544808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.544985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.545011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.158 [2024-11-27 03:25:00.545027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.158 [2024-11-27 03:25:00.545190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.158 [2024-11-27 03:25:00.545348] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.158 [2024-11-27 03:25:00.545367] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.158 [2024-11-27 03:25:00.545379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.158 [2024-11-27 03:25:00.547673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.158 [2024-11-27 03:25:00.557039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.158 [2024-11-27 03:25:00.557385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.557498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.557531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.158 [2024-11-27 03:25:00.557549] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.158 [2024-11-27 03:25:00.557683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.158 [2024-11-27 03:25:00.557851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.158 [2024-11-27 03:25:00.557872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.158 [2024-11-27 03:25:00.557892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.158 [2024-11-27 03:25:00.560253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.158 [2024-11-27 03:25:00.569751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.158 [2024-11-27 03:25:00.570051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.570204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.570230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.158 [2024-11-27 03:25:00.570245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.158 [2024-11-27 03:25:00.570393] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.158 [2024-11-27 03:25:00.570589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.158 [2024-11-27 03:25:00.570612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.158 [2024-11-27 03:25:00.570626] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.158 [2024-11-27 03:25:00.572681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.158 [2024-11-27 03:25:00.582470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.158 [2024-11-27 03:25:00.582763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.582886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.582912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.158 [2024-11-27 03:25:00.582927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.158 [2024-11-27 03:25:00.583092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.158 [2024-11-27 03:25:00.583282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.158 [2024-11-27 03:25:00.583302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.158 [2024-11-27 03:25:00.583315] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.158 [2024-11-27 03:25:00.585597] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.158 [2024-11-27 03:25:00.594866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.158 [2024-11-27 03:25:00.595183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.595310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.595337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.158 [2024-11-27 03:25:00.595352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.158 [2024-11-27 03:25:00.595556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.158 [2024-11-27 03:25:00.595686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.158 [2024-11-27 03:25:00.595706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.158 [2024-11-27 03:25:00.595720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.158 [2024-11-27 03:25:00.597973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.158 [2024-11-27 03:25:00.607444] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.158 [2024-11-27 03:25:00.607832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.608041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.608067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.158 [2024-11-27 03:25:00.608083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.158 [2024-11-27 03:25:00.608245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.158 [2024-11-27 03:25:00.608398] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.158 [2024-11-27 03:25:00.608418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.158 [2024-11-27 03:25:00.608430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.158 [2024-11-27 03:25:00.610796] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.158 [2024-11-27 03:25:00.619940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.158 [2024-11-27 03:25:00.620250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.620403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.158 [2024-11-27 03:25:00.620428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.158 [2024-11-27 03:25:00.620444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.158 [2024-11-27 03:25:00.620666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.158 [2024-11-27 03:25:00.620844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.158 [2024-11-27 03:25:00.620864] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.158 [2024-11-27 03:25:00.620890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.159 [2024-11-27 03:25:00.623076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.159 [2024-11-27 03:25:00.632654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.159 [2024-11-27 03:25:00.633005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.633124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.633151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.159 [2024-11-27 03:25:00.633167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.159 [2024-11-27 03:25:00.633316] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.159 [2024-11-27 03:25:00.633457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.159 [2024-11-27 03:25:00.633476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.159 [2024-11-27 03:25:00.633488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.159 [2024-11-27 03:25:00.635748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.159 [2024-11-27 03:25:00.645186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.159 [2024-11-27 03:25:00.645466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.645594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.645621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.159 [2024-11-27 03:25:00.645638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.159 [2024-11-27 03:25:00.645755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.159 [2024-11-27 03:25:00.645990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.159 [2024-11-27 03:25:00.646010] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.159 [2024-11-27 03:25:00.646023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.159 [2024-11-27 03:25:00.648259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.159 [2024-11-27 03:25:00.657669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.159 [2024-11-27 03:25:00.658030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.658154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.658180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.159 [2024-11-27 03:25:00.658195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.159 [2024-11-27 03:25:00.658374] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.159 [2024-11-27 03:25:00.658584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.159 [2024-11-27 03:25:00.658619] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.159 [2024-11-27 03:25:00.658633] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.159 [2024-11-27 03:25:00.660970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.159 [2024-11-27 03:25:00.670133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.159 [2024-11-27 03:25:00.670463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.670583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.670610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.159 [2024-11-27 03:25:00.670626] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.159 [2024-11-27 03:25:00.670775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.159 [2024-11-27 03:25:00.670949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.159 [2024-11-27 03:25:00.670968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.159 [2024-11-27 03:25:00.670981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.159 [2024-11-27 03:25:00.673218] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.159 [2024-11-27 03:25:00.682691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.159 [2024-11-27 03:25:00.683014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.683174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.683200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.159 [2024-11-27 03:25:00.683215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.159 [2024-11-27 03:25:00.683364] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.159 [2024-11-27 03:25:00.683558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.159 [2024-11-27 03:25:00.683579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.159 [2024-11-27 03:25:00.683592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.159 [2024-11-27 03:25:00.686039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.159 [2024-11-27 03:25:00.695267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.159 [2024-11-27 03:25:00.695583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.695711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.695737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.159 [2024-11-27 03:25:00.695753] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.159 [2024-11-27 03:25:00.695947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.159 [2024-11-27 03:25:00.696120] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.159 [2024-11-27 03:25:00.696154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.159 [2024-11-27 03:25:00.696167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.159 [2024-11-27 03:25:00.698559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.159 [2024-11-27 03:25:00.707794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.159 [2024-11-27 03:25:00.708086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.708198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.708223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.159 [2024-11-27 03:25:00.708239] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.159 [2024-11-27 03:25:00.708436] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.159 [2024-11-27 03:25:00.708599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.159 [2024-11-27 03:25:00.708621] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.159 [2024-11-27 03:25:00.708634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.159 [2024-11-27 03:25:00.710713] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.159 [2024-11-27 03:25:00.720308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.159 [2024-11-27 03:25:00.720653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.720779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.159 [2024-11-27 03:25:00.720810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.159 [2024-11-27 03:25:00.720826] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.159 [2024-11-27 03:25:00.721020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.159 [2024-11-27 03:25:00.721204] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.159 [2024-11-27 03:25:00.721224] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.159 [2024-11-27 03:25:00.721237] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.159 [2024-11-27 03:25:00.723553] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.160 [2024-11-27 03:25:00.732898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.160 [2024-11-27 03:25:00.733213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.160 [2024-11-27 03:25:00.733367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.160 [2024-11-27 03:25:00.733393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.160 [2024-11-27 03:25:00.733409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.160 [2024-11-27 03:25:00.733601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.160 [2024-11-27 03:25:00.733759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.160 [2024-11-27 03:25:00.733779] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.160 [2024-11-27 03:25:00.733792] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.160 [2024-11-27 03:25:00.735694] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.160 [2024-11-27 03:25:00.745576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.160 [2024-11-27 03:25:00.745982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.160 [2024-11-27 03:25:00.746132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.160 [2024-11-27 03:25:00.746158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.160 [2024-11-27 03:25:00.746174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.160 [2024-11-27 03:25:00.746352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.160 [2024-11-27 03:25:00.746588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.160 [2024-11-27 03:25:00.746609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.160 [2024-11-27 03:25:00.746622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.160 [2024-11-27 03:25:00.748902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.160 [2024-11-27 03:25:00.758306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.160 [2024-11-27 03:25:00.758658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.160 [2024-11-27 03:25:00.758813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.160 [2024-11-27 03:25:00.758839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.160 [2024-11-27 03:25:00.758863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.160 [2024-11-27 03:25:00.758998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.160 [2024-11-27 03:25:00.759174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.160 [2024-11-27 03:25:00.759194] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.160 [2024-11-27 03:25:00.759206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.160 [2024-11-27 03:25:00.761413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.160 [2024-11-27 03:25:00.770651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.160 [2024-11-27 03:25:00.770989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.160 [2024-11-27 03:25:00.771137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.160 [2024-11-27 03:25:00.771164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.160 [2024-11-27 03:25:00.771180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.160 [2024-11-27 03:25:00.771341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.160 [2024-11-27 03:25:00.771610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.160 [2024-11-27 03:25:00.771631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.160 [2024-11-27 03:25:00.771644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.160 [2024-11-27 03:25:00.773788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.420 [2024-11-27 03:25:00.783060] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.420 [2024-11-27 03:25:00.783349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.420 [2024-11-27 03:25:00.783500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.420 [2024-11-27 03:25:00.783534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.420 [2024-11-27 03:25:00.783552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.420 [2024-11-27 03:25:00.783731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.420 [2024-11-27 03:25:00.783919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.420 [2024-11-27 03:25:00.783938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.420 [2024-11-27 03:25:00.783951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.420 [2024-11-27 03:25:00.786149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.420 [2024-11-27 03:25:00.795715] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.420 [2024-11-27 03:25:00.796035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.420 [2024-11-27 03:25:00.796162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.420 [2024-11-27 03:25:00.796187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.420 [2024-11-27 03:25:00.796204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.420 [2024-11-27 03:25:00.796418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.420 [2024-11-27 03:25:00.796620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.420 [2024-11-27 03:25:00.796641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.420 [2024-11-27 03:25:00.796655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.420 [2024-11-27 03:25:00.798865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.420 [2024-11-27 03:25:00.808490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.420 [2024-11-27 03:25:00.808822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.420 [2024-11-27 03:25:00.808969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.420 [2024-11-27 03:25:00.808994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.420 [2024-11-27 03:25:00.809010] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.420 [2024-11-27 03:25:00.809180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.420 [2024-11-27 03:25:00.809355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.420 [2024-11-27 03:25:00.809380] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.420 [2024-11-27 03:25:00.809396] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.420 [2024-11-27 03:25:00.811838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.420 [2024-11-27 03:25:00.820948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.420 [2024-11-27 03:25:00.821275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.420 [2024-11-27 03:25:00.821403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.821429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.421 [2024-11-27 03:25:00.821445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.421 [2024-11-27 03:25:00.821607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.421 [2024-11-27 03:25:00.821837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.421 [2024-11-27 03:25:00.821857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.421 [2024-11-27 03:25:00.821886] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.421 [2024-11-27 03:25:00.824211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.421 [2024-11-27 03:25:00.833592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.421 [2024-11-27 03:25:00.833917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.834063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.834089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.421 [2024-11-27 03:25:00.834104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.421 [2024-11-27 03:25:00.834205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.421 [2024-11-27 03:25:00.834432] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.421 [2024-11-27 03:25:00.834452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.421 [2024-11-27 03:25:00.834465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.421 [2024-11-27 03:25:00.836755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.421 [2024-11-27 03:25:00.846019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.421 [2024-11-27 03:25:00.846409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.846605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.846631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.421 [2024-11-27 03:25:00.846647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.421 [2024-11-27 03:25:00.846748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.421 [2024-11-27 03:25:00.846926] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.421 [2024-11-27 03:25:00.846946] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.421 [2024-11-27 03:25:00.846958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.421 [2024-11-27 03:25:00.849427] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.421 [2024-11-27 03:25:00.858465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.421 [2024-11-27 03:25:00.858827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.858945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.858971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.421 [2024-11-27 03:25:00.858986] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.421 [2024-11-27 03:25:00.859195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.421 [2024-11-27 03:25:00.859375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.421 [2024-11-27 03:25:00.859395] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.421 [2024-11-27 03:25:00.859407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.421 [2024-11-27 03:25:00.861696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.421 [2024-11-27 03:25:00.871026] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.421 [2024-11-27 03:25:00.871365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.871474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.871499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.421 [2024-11-27 03:25:00.871537] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.421 [2024-11-27 03:25:00.871672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.421 [2024-11-27 03:25:00.871805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.421 [2024-11-27 03:25:00.871845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.421 [2024-11-27 03:25:00.871860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.421 [2024-11-27 03:25:00.874086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.421 [2024-11-27 03:25:00.883619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.421 [2024-11-27 03:25:00.883901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.884053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.884078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.421 [2024-11-27 03:25:00.884094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.421 [2024-11-27 03:25:00.884322] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.421 [2024-11-27 03:25:00.884483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.421 [2024-11-27 03:25:00.884508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.421 [2024-11-27 03:25:00.884532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.421 [2024-11-27 03:25:00.886773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.421 [2024-11-27 03:25:00.896198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.421 [2024-11-27 03:25:00.896476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.896647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.896674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.421 [2024-11-27 03:25:00.896689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.421 [2024-11-27 03:25:00.896918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.421 [2024-11-27 03:25:00.897086] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.421 [2024-11-27 03:25:00.897106] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.421 [2024-11-27 03:25:00.897118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.421 [2024-11-27 03:25:00.899394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.421 [2024-11-27 03:25:00.908949] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.421 [2024-11-27 03:25:00.909266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.909391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.909417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.421 [2024-11-27 03:25:00.909433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.421 [2024-11-27 03:25:00.909591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.421 [2024-11-27 03:25:00.909772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.421 [2024-11-27 03:25:00.909793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.421 [2024-11-27 03:25:00.909826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.421 [2024-11-27 03:25:00.912262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.421 [2024-11-27 03:25:00.921600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.421 [2024-11-27 03:25:00.921975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.922102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.421 [2024-11-27 03:25:00.922128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.422 [2024-11-27 03:25:00.922143] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.422 [2024-11-27 03:25:00.922334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.422 [2024-11-27 03:25:00.922473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.422 [2024-11-27 03:25:00.922492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.422 [2024-11-27 03:25:00.922519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.422 [2024-11-27 03:25:00.924859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.422 [2024-11-27 03:25:00.934219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.422 [2024-11-27 03:25:00.934481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.934617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.934643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.422 [2024-11-27 03:25:00.934659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.422 [2024-11-27 03:25:00.934823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.422 [2024-11-27 03:25:00.935017] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.422 [2024-11-27 03:25:00.935042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.422 [2024-11-27 03:25:00.935058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.422 [2024-11-27 03:25:00.937385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.422 [2024-11-27 03:25:00.946733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.422 [2024-11-27 03:25:00.947041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.947172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.947200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.422 [2024-11-27 03:25:00.947217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.422 [2024-11-27 03:25:00.947366] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.422 [2024-11-27 03:25:00.947584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.422 [2024-11-27 03:25:00.947608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.422 [2024-11-27 03:25:00.947622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.422 [2024-11-27 03:25:00.950056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.422 [2024-11-27 03:25:00.959363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.422 [2024-11-27 03:25:00.959648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.959771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.959797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.422 [2024-11-27 03:25:00.959812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.422 [2024-11-27 03:25:00.959957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.422 [2024-11-27 03:25:00.960127] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.422 [2024-11-27 03:25:00.960151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.422 [2024-11-27 03:25:00.960167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.422 [2024-11-27 03:25:00.962551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.422 [2024-11-27 03:25:00.971905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.422 [2024-11-27 03:25:00.972203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.972357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.972382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.422 [2024-11-27 03:25:00.972398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.422 [2024-11-27 03:25:00.972585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.422 [2024-11-27 03:25:00.972747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.422 [2024-11-27 03:25:00.972767] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.422 [2024-11-27 03:25:00.972781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.422 [2024-11-27 03:25:00.975043] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.422 [2024-11-27 03:25:00.984568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.422 [2024-11-27 03:25:00.984920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.985037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.985062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.422 [2024-11-27 03:25:00.985078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.422 [2024-11-27 03:25:00.985234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.422 [2024-11-27 03:25:00.985422] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.422 [2024-11-27 03:25:00.985446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.422 [2024-11-27 03:25:00.985462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.422 [2024-11-27 03:25:00.987684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.422 [2024-11-27 03:25:00.997264] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.422 [2024-11-27 03:25:00.997576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.997731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:00.997759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.422 [2024-11-27 03:25:00.997776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.422 [2024-11-27 03:25:00.997960] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.422 [2024-11-27 03:25:00.998149] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.422 [2024-11-27 03:25:00.998173] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.422 [2024-11-27 03:25:00.998188] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.422 [2024-11-27 03:25:01.000681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.422 [2024-11-27 03:25:01.009932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.422 [2024-11-27 03:25:01.010252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:01.010374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:01.010403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.422 [2024-11-27 03:25:01.010421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.422 [2024-11-27 03:25:01.010615] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.422 [2024-11-27 03:25:01.010809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.422 [2024-11-27 03:25:01.010833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.422 [2024-11-27 03:25:01.010849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.422 [2024-11-27 03:25:01.012994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.422 [2024-11-27 03:25:01.022620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.422 [2024-11-27 03:25:01.022941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:01.023115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.422 [2024-11-27 03:25:01.023141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.422 [2024-11-27 03:25:01.023157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.422 [2024-11-27 03:25:01.023319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.423 [2024-11-27 03:25:01.023472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.423 [2024-11-27 03:25:01.023496] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.423 [2024-11-27 03:25:01.023511] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.423 [2024-11-27 03:25:01.025775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.423 [2024-11-27 03:25:01.035322] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.423 [2024-11-27 03:25:01.035605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.423 [2024-11-27 03:25:01.035728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.423 [2024-11-27 03:25:01.035756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.423 [2024-11-27 03:25:01.035773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.423 [2024-11-27 03:25:01.035993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.423 [2024-11-27 03:25:01.036164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.423 [2024-11-27 03:25:01.036188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.423 [2024-11-27 03:25:01.036204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.682 [2024-11-27 03:25:01.038650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.682 [2024-11-27 03:25:01.047836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.682 [2024-11-27 03:25:01.048153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.682 [2024-11-27 03:25:01.048290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.682 [2024-11-27 03:25:01.048319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.682 [2024-11-27 03:25:01.048336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.682 [2024-11-27 03:25:01.048550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.682 [2024-11-27 03:25:01.048685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.682 [2024-11-27 03:25:01.048709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.682 [2024-11-27 03:25:01.048725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.682 [2024-11-27 03:25:01.051015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.682 [2024-11-27 03:25:01.060350] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.682 [2024-11-27 03:25:01.060717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.682 [2024-11-27 03:25:01.060832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.682 [2024-11-27 03:25:01.060857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.682 [2024-11-27 03:25:01.060873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.682 [2024-11-27 03:25:01.061050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.682 [2024-11-27 03:25:01.061257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.682 [2024-11-27 03:25:01.061281] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.682 [2024-11-27 03:25:01.061297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.682 [2024-11-27 03:25:01.063719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.682 [2024-11-27 03:25:01.072854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.682 [2024-11-27 03:25:01.073088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.682 [2024-11-27 03:25:01.073218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.682 [2024-11-27 03:25:01.073249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.682 [2024-11-27 03:25:01.073266] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.682 [2024-11-27 03:25:01.073457] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.682 [2024-11-27 03:25:01.073638] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.682 [2024-11-27 03:25:01.073663] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.682 [2024-11-27 03:25:01.073678] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.682 [2024-11-27 03:25:01.076098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.682 [2024-11-27 03:25:01.085510] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.682 [2024-11-27 03:25:01.085832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.682 [2024-11-27 03:25:01.085972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.085997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.683 [2024-11-27 03:25:01.086013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.683 [2024-11-27 03:25:01.086262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.683 [2024-11-27 03:25:01.086452] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.683 [2024-11-27 03:25:01.086476] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.683 [2024-11-27 03:25:01.086492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.683 [2024-11-27 03:25:01.088989] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.683 [2024-11-27 03:25:01.098165] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.683 [2024-11-27 03:25:01.098511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.098642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.098684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.683 [2024-11-27 03:25:01.098702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.683 [2024-11-27 03:25:01.098939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.683 [2024-11-27 03:25:01.099127] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.683 [2024-11-27 03:25:01.099151] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.683 [2024-11-27 03:25:01.099167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.683 [2024-11-27 03:25:01.101459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.683 [2024-11-27 03:25:01.110588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.683 [2024-11-27 03:25:01.110849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.110974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.111002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.683 [2024-11-27 03:25:01.111025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.683 [2024-11-27 03:25:01.111210] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.683 [2024-11-27 03:25:01.111381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.683 [2024-11-27 03:25:01.111405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.683 [2024-11-27 03:25:01.111420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.683 [2024-11-27 03:25:01.113810] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.683 [2024-11-27 03:25:01.123152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.683 [2024-11-27 03:25:01.123472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.123648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.123675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.683 [2024-11-27 03:25:01.123690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.683 [2024-11-27 03:25:01.123884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.683 [2024-11-27 03:25:01.124097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.683 [2024-11-27 03:25:01.124122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.683 [2024-11-27 03:25:01.124137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.683 [2024-11-27 03:25:01.126517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.683 [2024-11-27 03:25:01.135641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.683 [2024-11-27 03:25:01.136008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.136121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.136149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.683 [2024-11-27 03:25:01.136167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.683 [2024-11-27 03:25:01.136368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.683 [2024-11-27 03:25:01.136550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.683 [2024-11-27 03:25:01.136576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.683 [2024-11-27 03:25:01.136592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.683 [2024-11-27 03:25:01.139038] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.683 [2024-11-27 03:25:01.148127] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.683 [2024-11-27 03:25:01.148411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.148546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.148576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.683 [2024-11-27 03:25:01.148593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.683 [2024-11-27 03:25:01.148801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.683 [2024-11-27 03:25:01.148990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.683 [2024-11-27 03:25:01.149015] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.683 [2024-11-27 03:25:01.149031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.683 [2024-11-27 03:25:01.151355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.683 [2024-11-27 03:25:01.160634] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.683 [2024-11-27 03:25:01.160905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.161003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.161046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.683 [2024-11-27 03:25:01.161062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.683 [2024-11-27 03:25:01.161194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.683 [2024-11-27 03:25:01.161381] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.683 [2024-11-27 03:25:01.161405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.683 [2024-11-27 03:25:01.161421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.683 [2024-11-27 03:25:01.163611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.683 [2024-11-27 03:25:01.173131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.683 [2024-11-27 03:25:01.173464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.173608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.173635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.683 [2024-11-27 03:25:01.173651] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.683 [2024-11-27 03:25:01.173785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.683 [2024-11-27 03:25:01.174010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.683 [2024-11-27 03:25:01.174036] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.683 [2024-11-27 03:25:01.174051] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.683 [2024-11-27 03:25:01.176601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.683 [2024-11-27 03:25:01.185794] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.683 [2024-11-27 03:25:01.186072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.186192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.683 [2024-11-27 03:25:01.186220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.684 [2024-11-27 03:25:01.186238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.684 [2024-11-27 03:25:01.186403] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.684 [2024-11-27 03:25:01.186609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.684 [2024-11-27 03:25:01.186635] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.684 [2024-11-27 03:25:01.186651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.684 [2024-11-27 03:25:01.188977] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.684 [2024-11-27 03:25:01.198377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.684 [2024-11-27 03:25:01.198685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.198841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.198870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.684 [2024-11-27 03:25:01.198887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.684 [2024-11-27 03:25:01.199071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.684 [2024-11-27 03:25:01.199206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.684 [2024-11-27 03:25:01.199230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.684 [2024-11-27 03:25:01.199246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.684 [2024-11-27 03:25:01.201409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.684 [2024-11-27 03:25:01.211054] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.684 [2024-11-27 03:25:01.211387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.211516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.211554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.684 [2024-11-27 03:25:01.211573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.684 [2024-11-27 03:25:01.211739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.684 [2024-11-27 03:25:01.211928] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.684 [2024-11-27 03:25:01.211952] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.684 [2024-11-27 03:25:01.211968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.684 [2024-11-27 03:25:01.214348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.684 [2024-11-27 03:25:01.223573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.684 [2024-11-27 03:25:01.223858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.223969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.223998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.684 [2024-11-27 03:25:01.224015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.684 [2024-11-27 03:25:01.224200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.684 [2024-11-27 03:25:01.224389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.684 [2024-11-27 03:25:01.224421] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.684 [2024-11-27 03:25:01.224438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.684 [2024-11-27 03:25:01.226682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.684 [2024-11-27 03:25:01.236240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.684 [2024-11-27 03:25:01.236539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.236661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.236687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.684 [2024-11-27 03:25:01.236702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.684 [2024-11-27 03:25:01.236897] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.684 [2024-11-27 03:25:01.237105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.684 [2024-11-27 03:25:01.237129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.684 [2024-11-27 03:25:01.237145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.684 [2024-11-27 03:25:01.239569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.684 [2024-11-27 03:25:01.248689] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.684 [2024-11-27 03:25:01.248943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.249102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.249130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.684 [2024-11-27 03:25:01.249148] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.684 [2024-11-27 03:25:01.249314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.684 [2024-11-27 03:25:01.249504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.684 [2024-11-27 03:25:01.249538] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.684 [2024-11-27 03:25:01.249556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.684 [2024-11-27 03:25:01.251737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.684 [2024-11-27 03:25:01.261079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.684 [2024-11-27 03:25:01.261405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.261541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.261570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.684 [2024-11-27 03:25:01.261587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.684 [2024-11-27 03:25:01.261735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.684 [2024-11-27 03:25:01.261887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.684 [2024-11-27 03:25:01.261911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.684 [2024-11-27 03:25:01.261932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.684 [2024-11-27 03:25:01.264330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.684 [2024-11-27 03:25:01.273468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.684 [2024-11-27 03:25:01.273815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.273920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.273948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.684 [2024-11-27 03:25:01.273966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.684 [2024-11-27 03:25:01.274150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.684 [2024-11-27 03:25:01.274338] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.684 [2024-11-27 03:25:01.274362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.684 [2024-11-27 03:25:01.274378] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.684 [2024-11-27 03:25:01.276679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.684 [2024-11-27 03:25:01.286103] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.684 [2024-11-27 03:25:01.286390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.286556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.684 [2024-11-27 03:25:01.286582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.684 [2024-11-27 03:25:01.286598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.684 [2024-11-27 03:25:01.286762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.684 [2024-11-27 03:25:01.286948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.685 [2024-11-27 03:25:01.286972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.685 [2024-11-27 03:25:01.286988] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.685 [2024-11-27 03:25:01.289327] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.685 [2024-11-27 03:25:01.298716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.685 [2024-11-27 03:25:01.299060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.299192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.299222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.946 [2024-11-27 03:25:01.299240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.946 [2024-11-27 03:25:01.299424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.946 [2024-11-27 03:25:01.299589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.946 [2024-11-27 03:25:01.299614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.946 [2024-11-27 03:25:01.299629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.946 [2024-11-27 03:25:01.301924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.946 [2024-11-27 03:25:01.311139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.946 [2024-11-27 03:25:01.311391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.311520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.311557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.946 [2024-11-27 03:25:01.311576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.946 [2024-11-27 03:25:01.311760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.946 [2024-11-27 03:25:01.311931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.946 [2024-11-27 03:25:01.311955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.946 [2024-11-27 03:25:01.311971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.946 [2024-11-27 03:25:01.314153] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.946 [2024-11-27 03:25:01.323763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.946 [2024-11-27 03:25:01.324094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.324195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.324224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.946 [2024-11-27 03:25:01.324241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.946 [2024-11-27 03:25:01.324442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.946 [2024-11-27 03:25:01.324625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.946 [2024-11-27 03:25:01.324650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.946 [2024-11-27 03:25:01.324666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.946 [2024-11-27 03:25:01.326935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.946 [2024-11-27 03:25:01.336437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.946 [2024-11-27 03:25:01.336806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.336903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.336928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.946 [2024-11-27 03:25:01.336944] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.946 [2024-11-27 03:25:01.337134] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.946 [2024-11-27 03:25:01.337339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.946 [2024-11-27 03:25:01.337364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.946 [2024-11-27 03:25:01.337379] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.946 [2024-11-27 03:25:01.339769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.946 [2024-11-27 03:25:01.348936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.946 [2024-11-27 03:25:01.349260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.349432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.946 [2024-11-27 03:25:01.349458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.946 [2024-11-27 03:25:01.349473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.946 [2024-11-27 03:25:01.349599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.946 [2024-11-27 03:25:01.349790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.946 [2024-11-27 03:25:01.349815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.946 [2024-11-27 03:25:01.349830] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.947 [2024-11-27 03:25:01.352208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.947 [2024-11-27 03:25:01.361483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.947 [2024-11-27 03:25:01.361844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.362068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.362097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.947 [2024-11-27 03:25:01.362114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.947 [2024-11-27 03:25:01.362280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.947 [2024-11-27 03:25:01.362450] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.947 [2024-11-27 03:25:01.362474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.947 [2024-11-27 03:25:01.362490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.947 [2024-11-27 03:25:01.364933] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.947 [2024-11-27 03:25:01.374113] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.947 [2024-11-27 03:25:01.374466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.374595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.374630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.947 [2024-11-27 03:25:01.374665] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.947 [2024-11-27 03:25:01.374814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.947 [2024-11-27 03:25:01.374984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.947 [2024-11-27 03:25:01.375008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.947 [2024-11-27 03:25:01.375025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.947 [2024-11-27 03:25:01.377423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.947 [2024-11-27 03:25:01.386330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.947 [2024-11-27 03:25:01.386661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.386791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.386830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.947 [2024-11-27 03:25:01.386848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.947 [2024-11-27 03:25:01.387032] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.947 [2024-11-27 03:25:01.387202] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.947 [2024-11-27 03:25:01.387227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.947 [2024-11-27 03:25:01.387243] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.947 [2024-11-27 03:25:01.389496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.947 [2024-11-27 03:25:01.398947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.947 [2024-11-27 03:25:01.399303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.399434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.399463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.947 [2024-11-27 03:25:01.399480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.947 [2024-11-27 03:25:01.399638] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.947 [2024-11-27 03:25:01.399773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.947 [2024-11-27 03:25:01.399797] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.947 [2024-11-27 03:25:01.399813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.947 [2024-11-27 03:25:01.402008] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.947 [2024-11-27 03:25:01.411442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.947 [2024-11-27 03:25:01.411752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.411892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.411920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.947 [2024-11-27 03:25:01.411937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.947 [2024-11-27 03:25:01.412121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.947 [2024-11-27 03:25:01.412310] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.947 [2024-11-27 03:25:01.412335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.947 [2024-11-27 03:25:01.412350] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.947 [2024-11-27 03:25:01.414561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.947 [2024-11-27 03:25:01.424328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.947 [2024-11-27 03:25:01.424641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.424815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.424845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.947 [2024-11-27 03:25:01.424862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.947 [2024-11-27 03:25:01.425010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.947 [2024-11-27 03:25:01.425168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.947 [2024-11-27 03:25:01.425192] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.947 [2024-11-27 03:25:01.425208] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.947 [2024-11-27 03:25:01.427414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.947 [2024-11-27 03:25:01.437069] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.947 [2024-11-27 03:25:01.437437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.437600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.437630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.947 [2024-11-27 03:25:01.437647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.947 [2024-11-27 03:25:01.437831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.947 [2024-11-27 03:25:01.437984] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.947 [2024-11-27 03:25:01.438008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.947 [2024-11-27 03:25:01.438024] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.947 [2024-11-27 03:25:01.440535] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.947 [2024-11-27 03:25:01.449627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.947 [2024-11-27 03:25:01.449982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.450104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.947 [2024-11-27 03:25:01.450129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.947 [2024-11-27 03:25:01.450145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.947 [2024-11-27 03:25:01.450308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.947 [2024-11-27 03:25:01.450499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.947 [2024-11-27 03:25:01.450532] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.947 [2024-11-27 03:25:01.450551] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.947 [2024-11-27 03:25:01.452787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.948 [2024-11-27 03:25:01.462355] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.948 [2024-11-27 03:25:01.462688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.462821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.462849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.948 [2024-11-27 03:25:01.462871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.948 [2024-11-27 03:25:01.463051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.948 [2024-11-27 03:25:01.463251] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.948 [2024-11-27 03:25:01.463275] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.948 [2024-11-27 03:25:01.463291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.948 [2024-11-27 03:25:01.465508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.948 [2024-11-27 03:25:01.474905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.948 [2024-11-27 03:25:01.475235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.475365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.475393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.948 [2024-11-27 03:25:01.475411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.948 [2024-11-27 03:25:01.475586] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.948 [2024-11-27 03:25:01.475756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.948 [2024-11-27 03:25:01.475780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.948 [2024-11-27 03:25:01.475795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.948 [2024-11-27 03:25:01.478112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.948 [2024-11-27 03:25:01.487286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.948 [2024-11-27 03:25:01.487623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.487754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.487783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.948 [2024-11-27 03:25:01.487800] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.948 [2024-11-27 03:25:01.487966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.948 [2024-11-27 03:25:01.488119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.948 [2024-11-27 03:25:01.488143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.948 [2024-11-27 03:25:01.488159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.948 [2024-11-27 03:25:01.490412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.948 [2024-11-27 03:25:01.499760] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.948 [2024-11-27 03:25:01.500090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.500235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.500260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.948 [2024-11-27 03:25:01.500276] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.948 [2024-11-27 03:25:01.500477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.948 [2024-11-27 03:25:01.500658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.948 [2024-11-27 03:25:01.500683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.948 [2024-11-27 03:25:01.500699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.948 [2024-11-27 03:25:01.503003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.948 [2024-11-27 03:25:01.512356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.948 [2024-11-27 03:25:01.512682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.512823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.512848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.948 [2024-11-27 03:25:01.512864] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.948 [2024-11-27 03:25:01.513091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.948 [2024-11-27 03:25:01.513334] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.948 [2024-11-27 03:25:01.513358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.948 [2024-11-27 03:25:01.513373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.948 [2024-11-27 03:25:01.515727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.948 [2024-11-27 03:25:01.524843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.948 [2024-11-27 03:25:01.525162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.525314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.525343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.948 [2024-11-27 03:25:01.525360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.948 [2024-11-27 03:25:01.525575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.948 [2024-11-27 03:25:01.525765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.948 [2024-11-27 03:25:01.525789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.948 [2024-11-27 03:25:01.525804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.948 [2024-11-27 03:25:01.528145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.948 [2024-11-27 03:25:01.537292] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.948 [2024-11-27 03:25:01.537647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.537793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.537819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.948 [2024-11-27 03:25:01.537835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.948 [2024-11-27 03:25:01.538051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.948 [2024-11-27 03:25:01.538246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.948 [2024-11-27 03:25:01.538271] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.948 [2024-11-27 03:25:01.538287] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.948 [2024-11-27 03:25:01.540764] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.948 [2024-11-27 03:25:01.549901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:58.948 [2024-11-27 03:25:01.550249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.550371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:58.948 [2024-11-27 03:25:01.550396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:58.948 [2024-11-27 03:25:01.550412] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:58.948 [2024-11-27 03:25:01.550600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:58.948 [2024-11-27 03:25:01.550772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:58.948 [2024-11-27 03:25:01.550796] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:58.948 [2024-11-27 03:25:01.550812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:58.948 [2024-11-27 03:25:01.553119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:58.948 [2024-11-27 03:25:01.562511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.209 [2024-11-27 03:25:01.562816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.209 [2024-11-27 03:25:01.562966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.209 [2024-11-27 03:25:01.562992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.209 [2024-11-27 03:25:01.563008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.209 [2024-11-27 03:25:01.563150] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.209 [2024-11-27 03:25:01.563313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.209 [2024-11-27 03:25:01.563337] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.209 [2024-11-27 03:25:01.563353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.209 [2024-11-27 03:25:01.565566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.209 [2024-11-27 03:25:01.575308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.209 [2024-11-27 03:25:01.575597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.209 [2024-11-27 03:25:01.575744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.209 [2024-11-27 03:25:01.575776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.209 [2024-11-27 03:25:01.575792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.209 [2024-11-27 03:25:01.575924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.209 [2024-11-27 03:25:01.576115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.209 [2024-11-27 03:25:01.576146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.209 [2024-11-27 03:25:01.576163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.209 [2024-11-27 03:25:01.578590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.209 [2024-11-27 03:25:01.587842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.209 [2024-11-27 03:25:01.588166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.209 [2024-11-27 03:25:01.588268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.588296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.210 [2024-11-27 03:25:01.588314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.210 [2024-11-27 03:25:01.588497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.210 [2024-11-27 03:25:01.588712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.210 [2024-11-27 03:25:01.588738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.210 [2024-11-27 03:25:01.588754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.210 [2024-11-27 03:25:01.591063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.210 [2024-11-27 03:25:01.600314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.210 [2024-11-27 03:25:01.600633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.600789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.600818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.210 [2024-11-27 03:25:01.600835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.210 [2024-11-27 03:25:01.600965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.210 [2024-11-27 03:25:01.601135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.210 [2024-11-27 03:25:01.601160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.210 [2024-11-27 03:25:01.601176] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.210 [2024-11-27 03:25:01.603544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.210 [2024-11-27 03:25:01.612936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.210 [2024-11-27 03:25:01.613213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.613356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.613382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.210 [2024-11-27 03:25:01.613397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.210 [2024-11-27 03:25:01.613549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.210 [2024-11-27 03:25:01.613695] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.210 [2024-11-27 03:25:01.613719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.210 [2024-11-27 03:25:01.613740] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.210 [2024-11-27 03:25:01.616081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.210 [2024-11-27 03:25:01.625541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.210 [2024-11-27 03:25:01.625878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.626023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.626051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.210 [2024-11-27 03:25:01.626069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.210 [2024-11-27 03:25:01.626252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.210 [2024-11-27 03:25:01.626386] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.210 [2024-11-27 03:25:01.626410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.210 [2024-11-27 03:25:01.626425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.210 [2024-11-27 03:25:01.628690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.210 [2024-11-27 03:25:01.638046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.210 [2024-11-27 03:25:01.638334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.638467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.638496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.210 [2024-11-27 03:25:01.638513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.210 [2024-11-27 03:25:01.638709] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.210 [2024-11-27 03:25:01.638880] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.210 [2024-11-27 03:25:01.638904] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.210 [2024-11-27 03:25:01.638920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.210 [2024-11-27 03:25:01.641193] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.210 [2024-11-27 03:25:01.650589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.210 [2024-11-27 03:25:01.651013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.651109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.651134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.210 [2024-11-27 03:25:01.651149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.210 [2024-11-27 03:25:01.651230] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.210 [2024-11-27 03:25:01.651392] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.210 [2024-11-27 03:25:01.651431] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.210 [2024-11-27 03:25:01.651448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.210 [2024-11-27 03:25:01.653809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.210 [2024-11-27 03:25:01.663198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.210 [2024-11-27 03:25:01.663530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.663662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.663690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.210 [2024-11-27 03:25:01.663707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.210 [2024-11-27 03:25:01.663891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.210 [2024-11-27 03:25:01.664079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.210 [2024-11-27 03:25:01.664103] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.210 [2024-11-27 03:25:01.664118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.210 [2024-11-27 03:25:01.666502] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.210 [2024-11-27 03:25:01.675683] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.210 [2024-11-27 03:25:01.675960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.676091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.676133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.210 [2024-11-27 03:25:01.676149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.210 [2024-11-27 03:25:01.676342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.210 [2024-11-27 03:25:01.676508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.210 [2024-11-27 03:25:01.676543] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.210 [2024-11-27 03:25:01.676560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.210 [2024-11-27 03:25:01.678886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.210 [2024-11-27 03:25:01.688557] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.210 [2024-11-27 03:25:01.688861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.688988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.210 [2024-11-27 03:25:01.689016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.211 [2024-11-27 03:25:01.689033] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.211 [2024-11-27 03:25:01.689181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.211 [2024-11-27 03:25:01.689314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.211 [2024-11-27 03:25:01.689339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.211 [2024-11-27 03:25:01.689354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.211 [2024-11-27 03:25:01.691710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.211 [2024-11-27 03:25:01.701176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.211 [2024-11-27 03:25:01.701506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.701648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.701694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.211 [2024-11-27 03:25:01.701710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.211 [2024-11-27 03:25:01.701902] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.211 [2024-11-27 03:25:01.702091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.211 [2024-11-27 03:25:01.702116] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.211 [2024-11-27 03:25:01.702132] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.211 [2024-11-27 03:25:01.704582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.211 [2024-11-27 03:25:01.713851] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.211 [2024-11-27 03:25:01.714094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.714198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.714227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.211 [2024-11-27 03:25:01.714245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.211 [2024-11-27 03:25:01.714429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.211 [2024-11-27 03:25:01.714611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.211 [2024-11-27 03:25:01.714637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.211 [2024-11-27 03:25:01.714652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.211 [2024-11-27 03:25:01.716959] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.211 [2024-11-27 03:25:01.726225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.211 [2024-11-27 03:25:01.726556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.726655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.726681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.211 [2024-11-27 03:25:01.726697] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.211 [2024-11-27 03:25:01.726843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.211 [2024-11-27 03:25:01.727046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.211 [2024-11-27 03:25:01.727071] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.211 [2024-11-27 03:25:01.727087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.211 [2024-11-27 03:25:01.729429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.211 [2024-11-27 03:25:01.738827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.211 [2024-11-27 03:25:01.739193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.739328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.739357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.211 [2024-11-27 03:25:01.739374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.211 [2024-11-27 03:25:01.739522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.211 [2024-11-27 03:25:01.739740] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.211 [2024-11-27 03:25:01.739766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.211 [2024-11-27 03:25:01.739781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.211 [2024-11-27 03:25:01.742105] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.211 [2024-11-27 03:25:01.751400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.211 [2024-11-27 03:25:01.751733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.751862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.751890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.211 [2024-11-27 03:25:01.751908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.211 [2024-11-27 03:25:01.752074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.211 [2024-11-27 03:25:01.752281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.211 [2024-11-27 03:25:01.752305] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.211 [2024-11-27 03:25:01.752320] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.211 [2024-11-27 03:25:01.754710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.211 [2024-11-27 03:25:01.764007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.211 [2024-11-27 03:25:01.764306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.764403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.764446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.211 [2024-11-27 03:25:01.764463] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.211 [2024-11-27 03:25:01.764651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.211 [2024-11-27 03:25:01.764814] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.211 [2024-11-27 03:25:01.764839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.211 [2024-11-27 03:25:01.764855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.211 [2024-11-27 03:25:01.767182] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.211 [2024-11-27 03:25:01.776693] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.211 [2024-11-27 03:25:01.776999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.777153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.777182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.211 [2024-11-27 03:25:01.777199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.211 [2024-11-27 03:25:01.777434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.211 [2024-11-27 03:25:01.777543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.211 [2024-11-27 03:25:01.777567] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.211 [2024-11-27 03:25:01.777583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.211 [2024-11-27 03:25:01.779894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.211 [2024-11-27 03:25:01.789129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.211 [2024-11-27 03:25:01.789440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.789570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.211 [2024-11-27 03:25:01.789596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.211 [2024-11-27 03:25:01.789612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.211 [2024-11-27 03:25:01.789820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.212 [2024-11-27 03:25:01.789954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.212 [2024-11-27 03:25:01.789979] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.212 [2024-11-27 03:25:01.789994] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.212 [2024-11-27 03:25:01.792466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.212 [2024-11-27 03:25:01.801700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.212 [2024-11-27 03:25:01.802017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.212 [2024-11-27 03:25:01.802150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.212 [2024-11-27 03:25:01.802178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.212 [2024-11-27 03:25:01.802196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.212 [2024-11-27 03:25:01.802326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.212 [2024-11-27 03:25:01.802564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.212 [2024-11-27 03:25:01.802589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.212 [2024-11-27 03:25:01.802604] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.212 [2024-11-27 03:25:01.804947] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.212 [2024-11-27 03:25:01.814194] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.212 [2024-11-27 03:25:01.814539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.212 [2024-11-27 03:25:01.814640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.212 [2024-11-27 03:25:01.814669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.212 [2024-11-27 03:25:01.814692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.212 [2024-11-27 03:25:01.814823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.212 [2024-11-27 03:25:01.815029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.212 [2024-11-27 03:25:01.815054] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.212 [2024-11-27 03:25:01.815070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.212 [2024-11-27 03:25:01.817215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.472 [2024-11-27 03:25:01.826655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.472 [2024-11-27 03:25:01.826959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.827091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.827117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.472 [2024-11-27 03:25:01.827132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.472 [2024-11-27 03:25:01.827295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.472 [2024-11-27 03:25:01.827476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.472 [2024-11-27 03:25:01.827501] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.472 [2024-11-27 03:25:01.827516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.472 [2024-11-27 03:25:01.829717] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.472 [2024-11-27 03:25:01.839145] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.472 [2024-11-27 03:25:01.839455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.839584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.839614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.472 [2024-11-27 03:25:01.839631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.472 [2024-11-27 03:25:01.839779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.472 [2024-11-27 03:25:01.839931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.472 [2024-11-27 03:25:01.839955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.472 [2024-11-27 03:25:01.839970] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.472 [2024-11-27 03:25:01.842403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.472 [2024-11-27 03:25:01.851676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.472 [2024-11-27 03:25:01.852080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.852201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.852226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.472 [2024-11-27 03:25:01.852242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.472 [2024-11-27 03:25:01.852390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.472 [2024-11-27 03:25:01.852536] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.472 [2024-11-27 03:25:01.852561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.472 [2024-11-27 03:25:01.852577] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.472 [2024-11-27 03:25:01.855063] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.472 [2024-11-27 03:25:01.864192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.472 [2024-11-27 03:25:01.864517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.864670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.864696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.472 [2024-11-27 03:25:01.864711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.472 [2024-11-27 03:25:01.864905] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.472 [2024-11-27 03:25:01.865104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.472 [2024-11-27 03:25:01.865129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.472 [2024-11-27 03:25:01.865145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.472 [2024-11-27 03:25:01.867508] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.472 [2024-11-27 03:25:01.876716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.472 [2024-11-27 03:25:01.877018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.877149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.472 [2024-11-27 03:25:01.877177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.472 [2024-11-27 03:25:01.877195] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.472 [2024-11-27 03:25:01.877306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.473 [2024-11-27 03:25:01.877476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.473 [2024-11-27 03:25:01.877500] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.473 [2024-11-27 03:25:01.877516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.473 [2024-11-27 03:25:01.879655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.473 [2024-11-27 03:25:01.889374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.473 [2024-11-27 03:25:01.889682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.889815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.889856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.473 [2024-11-27 03:25:01.889871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.473 [2024-11-27 03:25:01.890042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.473 [2024-11-27 03:25:01.890255] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.473 [2024-11-27 03:25:01.890279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.473 [2024-11-27 03:25:01.890295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.473 [2024-11-27 03:25:01.892651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.473 [2024-11-27 03:25:01.902058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.473 [2024-11-27 03:25:01.902387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.902545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.902574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.473 [2024-11-27 03:25:01.902592] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.473 [2024-11-27 03:25:01.902758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.473 [2024-11-27 03:25:01.902965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.473 [2024-11-27 03:25:01.902989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.473 [2024-11-27 03:25:01.903005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.473 [2024-11-27 03:25:01.905367] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.473 [2024-11-27 03:25:01.914666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.473 [2024-11-27 03:25:01.915018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.915144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.915173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.473 [2024-11-27 03:25:01.915190] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.473 [2024-11-27 03:25:01.915302] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.473 [2024-11-27 03:25:01.915490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.473 [2024-11-27 03:25:01.915514] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.473 [2024-11-27 03:25:01.915541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.473 [2024-11-27 03:25:01.917925] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.473 [2024-11-27 03:25:01.927201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.473 [2024-11-27 03:25:01.927507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.927682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.927708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.473 [2024-11-27 03:25:01.927723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.473 [2024-11-27 03:25:01.927871] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.473 [2024-11-27 03:25:01.928063] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.473 [2024-11-27 03:25:01.928096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.473 [2024-11-27 03:25:01.928114] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.473 [2024-11-27 03:25:01.930542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.473 [2024-11-27 03:25:01.939792] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.473 [2024-11-27 03:25:01.940128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.940262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.940290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.473 [2024-11-27 03:25:01.940308] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.473 [2024-11-27 03:25:01.940438] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.473 [2024-11-27 03:25:01.940619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.473 [2024-11-27 03:25:01.940644] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.473 [2024-11-27 03:25:01.940660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.473 [2024-11-27 03:25:01.942930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.473 [2024-11-27 03:25:01.952456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.473 [2024-11-27 03:25:01.952875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.953024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.953066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.473 [2024-11-27 03:25:01.953083] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.473 [2024-11-27 03:25:01.953267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.473 [2024-11-27 03:25:01.953437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.473 [2024-11-27 03:25:01.953461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.473 [2024-11-27 03:25:01.953478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.473 [2024-11-27 03:25:01.956012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.473 [2024-11-27 03:25:01.965044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.473 [2024-11-27 03:25:01.965413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.965539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.965565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.473 [2024-11-27 03:25:01.965581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.473 [2024-11-27 03:25:01.965714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.473 [2024-11-27 03:25:01.965935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.473 [2024-11-27 03:25:01.965960] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.473 [2024-11-27 03:25:01.965981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.473 [2024-11-27 03:25:01.968112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.473 [2024-11-27 03:25:01.977648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.473 [2024-11-27 03:25:01.977945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.978103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.473 [2024-11-27 03:25:01.978132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.473 [2024-11-27 03:25:01.978149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.473 [2024-11-27 03:25:01.978333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.473 [2024-11-27 03:25:01.978504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.474 [2024-11-27 03:25:01.978539] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.474 [2024-11-27 03:25:01.978557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.474 [2024-11-27 03:25:01.980866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.474 [2024-11-27 03:25:01.990312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.474 [2024-11-27 03:25:01.990615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:01.990742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:01.990768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.474 [2024-11-27 03:25:01.990784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.474 [2024-11-27 03:25:01.990907] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.474 [2024-11-27 03:25:01.991097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.474 [2024-11-27 03:25:01.991123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.474 [2024-11-27 03:25:01.991138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.474 [2024-11-27 03:25:01.993623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.474 [2024-11-27 03:25:02.002905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.474 [2024-11-27 03:25:02.003251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.003388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.003414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.474 [2024-11-27 03:25:02.003429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.474 [2024-11-27 03:25:02.003554] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.474 [2024-11-27 03:25:02.003666] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.474 [2024-11-27 03:25:02.003690] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.474 [2024-11-27 03:25:02.003706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.474 [2024-11-27 03:25:02.005932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.474 [2024-11-27 03:25:02.015404] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.474 [2024-11-27 03:25:02.015707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.015865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.015901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.474 [2024-11-27 03:25:02.015919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.474 [2024-11-27 03:25:02.016084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.474 [2024-11-27 03:25:02.016256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.474 [2024-11-27 03:25:02.016279] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.474 [2024-11-27 03:25:02.016295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.474 [2024-11-27 03:25:02.018543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.474 [2024-11-27 03:25:02.028198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.474 [2024-11-27 03:25:02.028516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.028632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.028661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.474 [2024-11-27 03:25:02.028678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.474 [2024-11-27 03:25:02.028845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.474 [2024-11-27 03:25:02.028979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.474 [2024-11-27 03:25:02.029004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.474 [2024-11-27 03:25:02.029019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.474 [2024-11-27 03:25:02.031403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.474 [2024-11-27 03:25:02.040925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.474 [2024-11-27 03:25:02.041210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.041334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.041362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.474 [2024-11-27 03:25:02.041380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.474 [2024-11-27 03:25:02.041558] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.474 [2024-11-27 03:25:02.041748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.474 [2024-11-27 03:25:02.041772] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.474 [2024-11-27 03:25:02.041788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.474 [2024-11-27 03:25:02.044222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.474 [2024-11-27 03:25:02.053623] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.474 [2024-11-27 03:25:02.053936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.054067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.054095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.474 [2024-11-27 03:25:02.054113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.474 [2024-11-27 03:25:02.054261] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.474 [2024-11-27 03:25:02.054414] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.474 [2024-11-27 03:25:02.054438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.474 [2024-11-27 03:25:02.054453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.474 [2024-11-27 03:25:02.056808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.474 [2024-11-27 03:25:02.066236] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.474 [2024-11-27 03:25:02.066557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.066687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.066715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.474 [2024-11-27 03:25:02.066732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.474 [2024-11-27 03:25:02.066862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.474 [2024-11-27 03:25:02.066996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.474 [2024-11-27 03:25:02.067021] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.474 [2024-11-27 03:25:02.067037] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.474 [2024-11-27 03:25:02.069420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.474 [2024-11-27 03:25:02.078848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.474 [2024-11-27 03:25:02.079098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.079269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.474 [2024-11-27 03:25:02.079301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.474 [2024-11-27 03:25:02.079317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.474 [2024-11-27 03:25:02.079495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.474 [2024-11-27 03:25:02.079715] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.474 [2024-11-27 03:25:02.079740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.474 [2024-11-27 03:25:02.079756] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.475 [2024-11-27 03:25:02.081948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.736 [2024-11-27 03:25:02.091653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.736 [2024-11-27 03:25:02.091949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.092111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.092139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.736 [2024-11-27 03:25:02.092157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.736 [2024-11-27 03:25:02.092305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.736 [2024-11-27 03:25:02.092475] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.736 [2024-11-27 03:25:02.092499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.736 [2024-11-27 03:25:02.092515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.736 [2024-11-27 03:25:02.094845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.736 [2024-11-27 03:25:02.104434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.736 [2024-11-27 03:25:02.104757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.104922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.104951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.736 [2024-11-27 03:25:02.104968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.736 [2024-11-27 03:25:02.105152] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.736 [2024-11-27 03:25:02.105359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.736 [2024-11-27 03:25:02.105383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.736 [2024-11-27 03:25:02.105399] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.736 [2024-11-27 03:25:02.107775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.736 [2024-11-27 03:25:02.117173] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.736 [2024-11-27 03:25:02.117461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.117580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.117610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.736 [2024-11-27 03:25:02.117628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.736 [2024-11-27 03:25:02.117758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.736 [2024-11-27 03:25:02.117911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.736 [2024-11-27 03:25:02.117935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.736 [2024-11-27 03:25:02.117952] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.736 [2024-11-27 03:25:02.120208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.736 [2024-11-27 03:25:02.129870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.736 [2024-11-27 03:25:02.130159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.130320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.130349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.736 [2024-11-27 03:25:02.130367] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.736 [2024-11-27 03:25:02.130561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.736 [2024-11-27 03:25:02.130755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.736 [2024-11-27 03:25:02.130778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.736 [2024-11-27 03:25:02.130794] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.736 [2024-11-27 03:25:02.133137] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.736 [2024-11-27 03:25:02.142403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.736 [2024-11-27 03:25:02.142688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.142840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.142873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.736 [2024-11-27 03:25:02.142907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.736 [2024-11-27 03:25:02.143074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.736 [2024-11-27 03:25:02.143263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.736 [2024-11-27 03:25:02.143288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.736 [2024-11-27 03:25:02.143304] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.736 [2024-11-27 03:25:02.145771] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.736 [2024-11-27 03:25:02.155003] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.736 [2024-11-27 03:25:02.155339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.155469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.736 [2024-11-27 03:25:02.155498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.736 [2024-11-27 03:25:02.155515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.736 [2024-11-27 03:25:02.155674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.736 [2024-11-27 03:25:02.155845] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.736 [2024-11-27 03:25:02.155869] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.736 [2024-11-27 03:25:02.155885] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.736 [2024-11-27 03:25:02.157975] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.737 [2024-11-27 03:25:02.167459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.737 [2024-11-27 03:25:02.167777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.167936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.167961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.737 [2024-11-27 03:25:02.167982] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.737 [2024-11-27 03:25:02.168196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.737 [2024-11-27 03:25:02.168367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.737 [2024-11-27 03:25:02.168392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.737 [2024-11-27 03:25:02.168407] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.737 [2024-11-27 03:25:02.170819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.737 [2024-11-27 03:25:02.180048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.737 [2024-11-27 03:25:02.180324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.180456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.180485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.737 [2024-11-27 03:25:02.180502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.737 [2024-11-27 03:25:02.180679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.737 [2024-11-27 03:25:02.180833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.737 [2024-11-27 03:25:02.180857] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.737 [2024-11-27 03:25:02.180872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.737 [2024-11-27 03:25:02.183416] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.737 [2024-11-27 03:25:02.192666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.737 [2024-11-27 03:25:02.192904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.193054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.193080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.737 [2024-11-27 03:25:02.193096] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.737 [2024-11-27 03:25:02.193275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.737 [2024-11-27 03:25:02.193463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.737 [2024-11-27 03:25:02.193488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.737 [2024-11-27 03:25:02.193504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.737 [2024-11-27 03:25:02.195549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.737 [2024-11-27 03:25:02.205356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.737 [2024-11-27 03:25:02.205633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.205728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.205754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.737 [2024-11-27 03:25:02.205770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.737 [2024-11-27 03:25:02.205924] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.737 [2024-11-27 03:25:02.206119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.737 [2024-11-27 03:25:02.206143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.737 [2024-11-27 03:25:02.206160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.737 [2024-11-27 03:25:02.208447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.737 [2024-11-27 03:25:02.217863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.737 [2024-11-27 03:25:02.218244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.218354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.218382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.737 [2024-11-27 03:25:02.218397] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.737 [2024-11-27 03:25:02.218596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.737 [2024-11-27 03:25:02.218767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.737 [2024-11-27 03:25:02.218791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.737 [2024-11-27 03:25:02.218807] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.737 [2024-11-27 03:25:02.221294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.737 [2024-11-27 03:25:02.230396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.737 [2024-11-27 03:25:02.230694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.230804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.230832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.737 [2024-11-27 03:25:02.230849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.737 [2024-11-27 03:25:02.231015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.737 [2024-11-27 03:25:02.231222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.737 [2024-11-27 03:25:02.231246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.737 [2024-11-27 03:25:02.231262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.737 [2024-11-27 03:25:02.233566] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.737 [2024-11-27 03:25:02.242869] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.737 [2024-11-27 03:25:02.243182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.243317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.243345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.737 [2024-11-27 03:25:02.243363] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.737 [2024-11-27 03:25:02.243539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.737 [2024-11-27 03:25:02.243716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.737 [2024-11-27 03:25:02.243741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.737 [2024-11-27 03:25:02.243757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.737 [2024-11-27 03:25:02.245956] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.737 [2024-11-27 03:25:02.255207] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.737 [2024-11-27 03:25:02.255478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.255599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.737 [2024-11-27 03:25:02.255629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.737 [2024-11-27 03:25:02.255646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.737 [2024-11-27 03:25:02.255812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.737 [2024-11-27 03:25:02.256001] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.737 [2024-11-27 03:25:02.256025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.737 [2024-11-27 03:25:02.256041] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.737 [2024-11-27 03:25:02.258294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.737 [2024-11-27 03:25:02.267880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.737 [2024-11-27 03:25:02.268194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.268365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.268391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.738 [2024-11-27 03:25:02.268406] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.738 [2024-11-27 03:25:02.268618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.738 [2024-11-27 03:25:02.268807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.738 [2024-11-27 03:25:02.268833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.738 [2024-11-27 03:25:02.268848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.738 [2024-11-27 03:25:02.271279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.738 [2024-11-27 03:25:02.280472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.738 [2024-11-27 03:25:02.280793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.280881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.280906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.738 [2024-11-27 03:25:02.280922] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.738 [2024-11-27 03:25:02.281102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.738 [2024-11-27 03:25:02.281321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.738 [2024-11-27 03:25:02.281351] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.738 [2024-11-27 03:25:02.281368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.738 [2024-11-27 03:25:02.283579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.738 [2024-11-27 03:25:02.292805] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.738 [2024-11-27 03:25:02.293149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.293302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.293330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.738 [2024-11-27 03:25:02.293348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.738 [2024-11-27 03:25:02.293477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.738 [2024-11-27 03:25:02.293604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.738 [2024-11-27 03:25:02.293630] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.738 [2024-11-27 03:25:02.293646] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.738 [2024-11-27 03:25:02.296189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.738 [2024-11-27 03:25:02.305213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.738 [2024-11-27 03:25:02.305498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.305672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.305698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.738 [2024-11-27 03:25:02.305714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.738 [2024-11-27 03:25:02.305893] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.738 [2024-11-27 03:25:02.306097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.738 [2024-11-27 03:25:02.306121] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.738 [2024-11-27 03:25:02.306137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.738 [2024-11-27 03:25:02.308710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.738 [2024-11-27 03:25:02.317719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.738 [2024-11-27 03:25:02.318011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.318178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.318207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.738 [2024-11-27 03:25:02.318224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.738 [2024-11-27 03:25:02.318372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.738 [2024-11-27 03:25:02.318555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.738 [2024-11-27 03:25:02.318580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.738 [2024-11-27 03:25:02.318601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.738 [2024-11-27 03:25:02.320928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.738 [2024-11-27 03:25:02.330375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.738 [2024-11-27 03:25:02.330681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.330791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.330819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.738 [2024-11-27 03:25:02.330837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.738 [2024-11-27 03:25:02.331002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.738 [2024-11-27 03:25:02.331209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.738 [2024-11-27 03:25:02.331234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.738 [2024-11-27 03:25:02.331249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.738 [2024-11-27 03:25:02.333453] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.738 [2024-11-27 03:25:02.342960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.738 [2024-11-27 03:25:02.343311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.343442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.738 [2024-11-27 03:25:02.343467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.738 [2024-11-27 03:25:02.343483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.738 [2024-11-27 03:25:02.343674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.738 [2024-11-27 03:25:02.343823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.738 [2024-11-27 03:25:02.343848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.738 [2024-11-27 03:25:02.343863] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.738 [2024-11-27 03:25:02.346387] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.999 [2024-11-27 03:25:02.355546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.999 [2024-11-27 03:25:02.356000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.356230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.356284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.999 [2024-11-27 03:25:02.356301] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.999 [2024-11-27 03:25:02.356449] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.999 [2024-11-27 03:25:02.356669] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.999 [2024-11-27 03:25:02.356694] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.999 [2024-11-27 03:25:02.356710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.999 [2024-11-27 03:25:02.359044] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.999 [2024-11-27 03:25:02.368193] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.999 [2024-11-27 03:25:02.368477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.368573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.368599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.999 [2024-11-27 03:25:02.368615] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.999 [2024-11-27 03:25:02.368807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.999 [2024-11-27 03:25:02.368959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.999 [2024-11-27 03:25:02.368984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.999 [2024-11-27 03:25:02.368999] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.999 [2024-11-27 03:25:02.371452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.999 [2024-11-27 03:25:02.380677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.999 [2024-11-27 03:25:02.381003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.381131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.381160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.999 [2024-11-27 03:25:02.381177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.999 [2024-11-27 03:25:02.381343] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.999 [2024-11-27 03:25:02.381513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.999 [2024-11-27 03:25:02.381548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.999 [2024-11-27 03:25:02.381565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.999 [2024-11-27 03:25:02.383979] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.999 [2024-11-27 03:25:02.393221] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.999 [2024-11-27 03:25:02.393500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.393642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.393671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.999 [2024-11-27 03:25:02.393688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.999 [2024-11-27 03:25:02.393854] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.999 [2024-11-27 03:25:02.394007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.999 [2024-11-27 03:25:02.394031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:59.999 [2024-11-27 03:25:02.394046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:59.999 [2024-11-27 03:25:02.396481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:59.999 [2024-11-27 03:25:02.405721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:59.999 [2024-11-27 03:25:02.406053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.406173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-11-27 03:25:02.406198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:29:59.999 [2024-11-27 03:25:02.406215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:29:59.999 [2024-11-27 03:25:02.406362] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:29:59.999 [2024-11-27 03:25:02.406539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:59.999 [2024-11-27 03:25:02.406564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.000 [2024-11-27 03:25:02.406580] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.000 [2024-11-27 03:25:02.409028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.000 [2024-11-27 03:25:02.418171] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.000 [2024-11-27 03:25:02.418604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.418735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.418761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.000 [2024-11-27 03:25:02.418793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.000 [2024-11-27 03:25:02.418923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.000 [2024-11-27 03:25:02.419130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.000 [2024-11-27 03:25:02.419154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.000 [2024-11-27 03:25:02.419169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.000 [2024-11-27 03:25:02.421442] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.000 [2024-11-27 03:25:02.430957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.000 [2024-11-27 03:25:02.431280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.431408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.431438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.000 [2024-11-27 03:25:02.431456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.000 [2024-11-27 03:25:02.431616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.000 [2024-11-27 03:25:02.431787] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.000 [2024-11-27 03:25:02.431811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.000 [2024-11-27 03:25:02.431826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.000 [2024-11-27 03:25:02.434372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.000 [2024-11-27 03:25:02.443456] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.000 [2024-11-27 03:25:02.443783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.443895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.443923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.000 [2024-11-27 03:25:02.443941] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.000 [2024-11-27 03:25:02.444071] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.000 [2024-11-27 03:25:02.444222] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.000 [2024-11-27 03:25:02.444246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.000 [2024-11-27 03:25:02.444262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.000 [2024-11-27 03:25:02.446545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.000 [2024-11-27 03:25:02.456155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.000 [2024-11-27 03:25:02.456443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.456549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.456594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.000 [2024-11-27 03:25:02.456611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.000 [2024-11-27 03:25:02.456760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.000 [2024-11-27 03:25:02.456919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.000 [2024-11-27 03:25:02.456944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.000 [2024-11-27 03:25:02.456960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.000 [2024-11-27 03:25:02.459499] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.000 [2024-11-27 03:25:02.468734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.000 [2024-11-27 03:25:02.469026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.469156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.469185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.000 [2024-11-27 03:25:02.469203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.000 [2024-11-27 03:25:02.469351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.000 [2024-11-27 03:25:02.469522] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.000 [2024-11-27 03:25:02.469557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.000 [2024-11-27 03:25:02.469574] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.000 [2024-11-27 03:25:02.471721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.000 [2024-11-27 03:25:02.481254] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.000 [2024-11-27 03:25:02.481618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.481721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.481747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.000 [2024-11-27 03:25:02.481763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.000 [2024-11-27 03:25:02.481942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.000 [2024-11-27 03:25:02.482103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.000 [2024-11-27 03:25:02.482123] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.000 [2024-11-27 03:25:02.482136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.000 [2024-11-27 03:25:02.484123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.000 [2024-11-27 03:25:02.493327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.000 [2024-11-27 03:25:02.493624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.493745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-11-27 03:25:02.493772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.000 [2024-11-27 03:25:02.493788] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.000 [2024-11-27 03:25:02.493953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.001 [2024-11-27 03:25:02.494114] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.001 [2024-11-27 03:25:02.494134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.001 [2024-11-27 03:25:02.494147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.001 [2024-11-27 03:25:02.496178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.001 [2024-11-27 03:25:02.505568] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.001 [2024-11-27 03:25:02.505853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.505998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.506024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.001 [2024-11-27 03:25:02.506040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.001 [2024-11-27 03:25:02.506250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.001 [2024-11-27 03:25:02.506408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.001 [2024-11-27 03:25:02.506428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.001 [2024-11-27 03:25:02.506441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.001 [2024-11-27 03:25:02.508413] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.001 [2024-11-27 03:25:02.517733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.001 [2024-11-27 03:25:02.518053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.518177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.518203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.001 [2024-11-27 03:25:02.518228] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.001 [2024-11-27 03:25:02.518346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.001 [2024-11-27 03:25:02.518546] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.001 [2024-11-27 03:25:02.518578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.001 [2024-11-27 03:25:02.518592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.001 [2024-11-27 03:25:02.520540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.001 [2024-11-27 03:25:02.529893] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.001 [2024-11-27 03:25:02.530197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.530319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.530345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.001 [2024-11-27 03:25:02.530360] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.001 [2024-11-27 03:25:02.530568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.001 [2024-11-27 03:25:02.530718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.001 [2024-11-27 03:25:02.530740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.001 [2024-11-27 03:25:02.530754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.001 [2024-11-27 03:25:02.532807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.001 [2024-11-27 03:25:02.542184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.001 [2024-11-27 03:25:02.542530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.542642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.542668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.001 [2024-11-27 03:25:02.542684] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.001 [2024-11-27 03:25:02.542802] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.001 [2024-11-27 03:25:02.542997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.001 [2024-11-27 03:25:02.543017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.001 [2024-11-27 03:25:02.543030] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.001 [2024-11-27 03:25:02.545059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.001 [2024-11-27 03:25:02.554343] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.001 [2024-11-27 03:25:02.554709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.554834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.554860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.001 [2024-11-27 03:25:02.554876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.001 [2024-11-27 03:25:02.554998] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.001 [2024-11-27 03:25:02.555135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.001 [2024-11-27 03:25:02.555171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.001 [2024-11-27 03:25:02.555184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.001 [2024-11-27 03:25:02.557204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.001 [2024-11-27 03:25:02.566419] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.001 [2024-11-27 03:25:02.566821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.566919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.566944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.001 [2024-11-27 03:25:02.566960] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.001 [2024-11-27 03:25:02.567186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.001 [2024-11-27 03:25:02.567343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.001 [2024-11-27 03:25:02.567364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.001 [2024-11-27 03:25:02.567376] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.001 [2024-11-27 03:25:02.569394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.001 [2024-11-27 03:25:02.578991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.001 [2024-11-27 03:25:02.579316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.579435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-11-27 03:25:02.579460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.001 [2024-11-27 03:25:02.579475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.002 [2024-11-27 03:25:02.579650] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.002 [2024-11-27 03:25:02.579853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.002 [2024-11-27 03:25:02.579890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.002 [2024-11-27 03:25:02.579903] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.002 [2024-11-27 03:25:02.581990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.002 [2024-11-27 03:25:02.591400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.002 [2024-11-27 03:25:02.591687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-11-27 03:25:02.591792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-11-27 03:25:02.591819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.002 [2024-11-27 03:25:02.591836] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.002 [2024-11-27 03:25:02.591970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.002 [2024-11-27 03:25:02.592165] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.002 [2024-11-27 03:25:02.592186] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.002 [2024-11-27 03:25:02.592201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.002 [2024-11-27 03:25:02.594301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.002 [2024-11-27 03:25:02.603558] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.002 [2024-11-27 03:25:02.603917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-11-27 03:25:02.604009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-11-27 03:25:02.604034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.002 [2024-11-27 03:25:02.604050] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.002 [2024-11-27 03:25:02.604183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.002 [2024-11-27 03:25:02.604378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.002 [2024-11-27 03:25:02.604399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.002 [2024-11-27 03:25:02.604411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.002 [2024-11-27 03:25:02.606316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.262 [2024-11-27 03:25:02.615860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.262 [2024-11-27 03:25:02.616270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.616387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.616413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.262 [2024-11-27 03:25:02.616429] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.262 [2024-11-27 03:25:02.616604] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.262 [2024-11-27 03:25:02.616759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.262 [2024-11-27 03:25:02.616781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.262 [2024-11-27 03:25:02.616795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.262 [2024-11-27 03:25:02.618640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.262 [2024-11-27 03:25:02.627900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.262 [2024-11-27 03:25:02.628230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.628358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.628384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.262 [2024-11-27 03:25:02.628399] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.262 [2024-11-27 03:25:02.628541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.262 [2024-11-27 03:25:02.628709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.262 [2024-11-27 03:25:02.628736] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.262 [2024-11-27 03:25:02.628751] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.262 [2024-11-27 03:25:02.630716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.262 [2024-11-27 03:25:02.640204] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.262 [2024-11-27 03:25:02.640487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.640618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.640644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.262 [2024-11-27 03:25:02.640660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.262 [2024-11-27 03:25:02.640810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.262 [2024-11-27 03:25:02.640985] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.262 [2024-11-27 03:25:02.641005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.262 [2024-11-27 03:25:02.641018] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.262 [2024-11-27 03:25:02.642815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.262 [2024-11-27 03:25:02.652569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.262 [2024-11-27 03:25:02.652865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.653014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.653040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.262 [2024-11-27 03:25:02.653055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.262 [2024-11-27 03:25:02.653220] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.262 [2024-11-27 03:25:02.653408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.262 [2024-11-27 03:25:02.653428] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.262 [2024-11-27 03:25:02.653441] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.262 [2024-11-27 03:25:02.655391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.262 [2024-11-27 03:25:02.664720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.262 [2024-11-27 03:25:02.665017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.665160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.665186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.262 [2024-11-27 03:25:02.665201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.262 [2024-11-27 03:25:02.665381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.262 [2024-11-27 03:25:02.665595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.262 [2024-11-27 03:25:02.665632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.262 [2024-11-27 03:25:02.665651] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.262 [2024-11-27 03:25:02.667489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.262 [2024-11-27 03:25:02.676963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.262 [2024-11-27 03:25:02.677318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.677438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.677464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.262 [2024-11-27 03:25:02.677480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.262 [2024-11-27 03:25:02.677671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.262 [2024-11-27 03:25:02.677867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.262 [2024-11-27 03:25:02.677887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.262 [2024-11-27 03:25:02.677900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.262 [2024-11-27 03:25:02.679829] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.262 [2024-11-27 03:25:02.689238] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.262 [2024-11-27 03:25:02.689539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.262 [2024-11-27 03:25:02.689662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.689688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.263 [2024-11-27 03:25:02.689704] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.263 [2024-11-27 03:25:02.689821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.263 [2024-11-27 03:25:02.690015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.263 [2024-11-27 03:25:02.690035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.263 [2024-11-27 03:25:02.690049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.263 [2024-11-27 03:25:02.692110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.263 [2024-11-27 03:25:02.701359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.263 [2024-11-27 03:25:02.701762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.701880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.701905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.263 [2024-11-27 03:25:02.701921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.263 [2024-11-27 03:25:02.702069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.263 [2024-11-27 03:25:02.702213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.263 [2024-11-27 03:25:02.702233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.263 [2024-11-27 03:25:02.702246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.263 [2024-11-27 03:25:02.704143] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.263 [2024-11-27 03:25:02.713497] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.263 [2024-11-27 03:25:02.713853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.713978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.714004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.263 [2024-11-27 03:25:02.714020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.263 [2024-11-27 03:25:02.714213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.263 [2024-11-27 03:25:02.714385] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.263 [2024-11-27 03:25:02.714405] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.263 [2024-11-27 03:25:02.714418] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.263 [2024-11-27 03:25:02.716575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.263 [2024-11-27 03:25:02.725669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.263 [2024-11-27 03:25:02.726020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.726196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.726221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.263 [2024-11-27 03:25:02.726236] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.263 [2024-11-27 03:25:02.726419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.263 [2024-11-27 03:25:02.726592] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.263 [2024-11-27 03:25:02.726614] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.263 [2024-11-27 03:25:02.726628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.263 [2024-11-27 03:25:02.728490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.263 [2024-11-27 03:25:02.737698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.263 [2024-11-27 03:25:02.738024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.738150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.738176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.263 [2024-11-27 03:25:02.738192] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.263 [2024-11-27 03:25:02.738342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.263 [2024-11-27 03:25:02.738517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.263 [2024-11-27 03:25:02.738561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.263 [2024-11-27 03:25:02.738575] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.263 [2024-11-27 03:25:02.740455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.263 [2024-11-27 03:25:02.749900] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.263 [2024-11-27 03:25:02.750231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.750353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.750379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.263 [2024-11-27 03:25:02.750395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.263 [2024-11-27 03:25:02.750535] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.263 [2024-11-27 03:25:02.750685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.263 [2024-11-27 03:25:02.750706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.263 [2024-11-27 03:25:02.750720] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.263 [2024-11-27 03:25:02.752872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.263 [2024-11-27 03:25:02.762088] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.263 [2024-11-27 03:25:02.762409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.762534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.762560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.263 [2024-11-27 03:25:02.762576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.263 [2024-11-27 03:25:02.762725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.263 [2024-11-27 03:25:02.762934] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.263 [2024-11-27 03:25:02.762954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.263 [2024-11-27 03:25:02.762966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.263 [2024-11-27 03:25:02.764859] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.263 [2024-11-27 03:25:02.774231] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.263 [2024-11-27 03:25:02.774516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.774627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.263 [2024-11-27 03:25:02.774652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.263 [2024-11-27 03:25:02.774668] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.263 [2024-11-27 03:25:02.774801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.263 [2024-11-27 03:25:02.774980] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.263 [2024-11-27 03:25:02.775000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.263 [2024-11-27 03:25:02.775013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.264 [2024-11-27 03:25:02.777035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.264 [2024-11-27 03:25:02.786381] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.264 [2024-11-27 03:25:02.786690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.786845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.786871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.264 [2024-11-27 03:25:02.786887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.264 [2024-11-27 03:25:02.787036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.264 [2024-11-27 03:25:02.787212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.264 [2024-11-27 03:25:02.787234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.264 [2024-11-27 03:25:02.787247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.264 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2582964 Killed "${NVMF_APP[@]}" "$@" 00:30:00.264 03:25:02 -- host/bdevperf.sh@36 -- # tgt_init 00:30:00.264 03:25:02 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:00.264 03:25:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:00.264 03:25:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:00.264 03:25:02 -- common/autotest_common.sh@10 -- # set +x 00:30:00.264 [2024-11-27 03:25:02.789176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.264 03:25:02 -- nvmf/common.sh@469 -- # nvmfpid=2584085 00:30:00.264 03:25:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:00.264 03:25:02 -- nvmf/common.sh@470 -- # waitforlisten 2584085 00:30:00.264 03:25:02 -- common/autotest_common.sh@829 -- # '[' -z 2584085 ']' 00:30:00.264 03:25:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:00.264 03:25:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:00.264 03:25:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:00.264 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:00.264 03:25:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:00.264 03:25:02 -- common/autotest_common.sh@10 -- # set +x 00:30:00.264 [2024-11-27 03:25:02.798641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.264 [2024-11-27 03:25:02.798981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.799098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.799124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.264 [2024-11-27 03:25:02.799140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.264 [2024-11-27 03:25:02.799289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.264 [2024-11-27 03:25:02.799483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.264 [2024-11-27 03:25:02.799518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.264 [2024-11-27 03:25:02.799542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.264 [2024-11-27 03:25:02.801599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.264 [2024-11-27 03:25:02.810882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.264 [2024-11-27 03:25:02.811181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.811301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.811332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.264 [2024-11-27 03:25:02.811348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.264 [2024-11-27 03:25:02.811553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.264 [2024-11-27 03:25:02.811675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.264 [2024-11-27 03:25:02.811697] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.264 [2024-11-27 03:25:02.811711] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.264 [2024-11-27 03:25:02.813923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.264 [2024-11-27 03:25:02.823077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.264 [2024-11-27 03:25:02.823418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.823563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.823591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.264 [2024-11-27 03:25:02.823607] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.264 [2024-11-27 03:25:02.823789] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.264 [2024-11-27 03:25:02.823979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.264 [2024-11-27 03:25:02.824001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.264 [2024-11-27 03:25:02.824015] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.264 [2024-11-27 03:25:02.826225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.264 [2024-11-27 03:25:02.835579] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.264 [2024-11-27 03:25:02.835857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.835956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.835981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.264 [2024-11-27 03:25:02.835997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.264 [2024-11-27 03:25:02.836163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.264 [2024-11-27 03:25:02.836387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.264 [2024-11-27 03:25:02.836408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.264 [2024-11-27 03:25:02.836421] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.264 [2024-11-27 03:25:02.838704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.264 [2024-11-27 03:25:02.839004] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:00.264 [2024-11-27 03:25:02.839078] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:00.264 [2024-11-27 03:25:02.847827] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.264 [2024-11-27 03:25:02.848147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.848279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.848304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.264 [2024-11-27 03:25:02.848320] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.264 [2024-11-27 03:25:02.848485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.264 [2024-11-27 03:25:02.848648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.264 [2024-11-27 03:25:02.848671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.264 [2024-11-27 03:25:02.848685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.264 [2024-11-27 03:25:02.850672] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.264 [2024-11-27 03:25:02.860043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.264 [2024-11-27 03:25:02.860343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.860469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.264 [2024-11-27 03:25:02.860495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.264 [2024-11-27 03:25:02.860511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.264 [2024-11-27 03:25:02.860668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.264 [2024-11-27 03:25:02.860835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.264 [2024-11-27 03:25:02.860871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.265 [2024-11-27 03:25:02.860884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.265 [2024-11-27 03:25:02.862769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.265 [2024-11-27 03:25:02.872216] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.265 [2024-11-27 03:25:02.872594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.265 [2024-11-27 03:25:02.872719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.265 [2024-11-27 03:25:02.872746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.265 [2024-11-27 03:25:02.872761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.265 [2024-11-27 03:25:02.872944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.265 [2024-11-27 03:25:02.873073] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.265 [2024-11-27 03:25:02.873093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.265 [2024-11-27 03:25:02.873105] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.265 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.265 [2024-11-27 03:25:02.875462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.550 [2024-11-27 03:25:02.884457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.550 [2024-11-27 03:25:02.884749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.550 [2024-11-27 03:25:02.884855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.550 [2024-11-27 03:25:02.884882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.550 [2024-11-27 03:25:02.884898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.550 [2024-11-27 03:25:02.885031] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.550 [2024-11-27 03:25:02.885213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.550 [2024-11-27 03:25:02.885234] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.550 [2024-11-27 03:25:02.885247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.550 [2024-11-27 03:25:02.887349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.550 [2024-11-27 03:25:02.896784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.550 [2024-11-27 03:25:02.897163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.550 [2024-11-27 03:25:02.897260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.550 [2024-11-27 03:25:02.897286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.550 [2024-11-27 03:25:02.897302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.550 [2024-11-27 03:25:02.897467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.550 [2024-11-27 03:25:02.897645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.550 [2024-11-27 03:25:02.897668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.550 [2024-11-27 03:25:02.897682] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.551 [2024-11-27 03:25:02.899684] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.551 [2024-11-27 03:25:02.906719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:00.551 [2024-11-27 03:25:02.909192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.551 [2024-11-27 03:25:02.909498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.909601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.909629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.551 [2024-11-27 03:25:02.909645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.551 [2024-11-27 03:25:02.909762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.551 [2024-11-27 03:25:02.909947] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.551 [2024-11-27 03:25:02.909969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.551 [2024-11-27 03:25:02.909982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.551 [2024-11-27 03:25:02.912005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.551 [2024-11-27 03:25:02.921599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.551 [2024-11-27 03:25:02.922125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.922284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.922311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.551 [2024-11-27 03:25:02.922330] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.551 [2024-11-27 03:25:02.922487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.551 [2024-11-27 03:25:02.922665] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.551 [2024-11-27 03:25:02.922688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.551 [2024-11-27 03:25:02.922705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.551 [2024-11-27 03:25:02.924737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.551 [2024-11-27 03:25:02.933938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.551 [2024-11-27 03:25:02.934313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.934436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.934462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.551 [2024-11-27 03:25:02.934477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.551 [2024-11-27 03:25:02.934637] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.551 [2024-11-27 03:25:02.934790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.551 [2024-11-27 03:25:02.934826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.551 [2024-11-27 03:25:02.934840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.551 [2024-11-27 03:25:02.937069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.551 [2024-11-27 03:25:02.946048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.551 [2024-11-27 03:25:02.946323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.946458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.946485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.551 [2024-11-27 03:25:02.946501] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.551 [2024-11-27 03:25:02.946678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.551 [2024-11-27 03:25:02.946801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.551 [2024-11-27 03:25:02.946838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.551 [2024-11-27 03:25:02.946853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.551 [2024-11-27 03:25:02.948850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.551 [2024-11-27 03:25:02.958351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.551 [2024-11-27 03:25:02.958792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.958967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.958994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.551 [2024-11-27 03:25:02.959022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.551 [2024-11-27 03:25:02.959182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.551 [2024-11-27 03:25:02.959351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.551 [2024-11-27 03:25:02.959372] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.551 [2024-11-27 03:25:02.959389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.551 [2024-11-27 03:25:02.961416] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.551 [2024-11-27 03:25:02.970563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.551 [2024-11-27 03:25:02.970956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.971084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.971110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.551 [2024-11-27 03:25:02.971127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.551 [2024-11-27 03:25:02.971263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.551 [2024-11-27 03:25:02.971416] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.551 [2024-11-27 03:25:02.971438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.551 [2024-11-27 03:25:02.971453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.551 [2024-11-27 03:25:02.973445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.551 [2024-11-27 03:25:02.982971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.551 [2024-11-27 03:25:02.983299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.983427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.983453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.551 [2024-11-27 03:25:02.983469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.551 [2024-11-27 03:25:02.983646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.551 [2024-11-27 03:25:02.983801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.551 [2024-11-27 03:25:02.983838] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.551 [2024-11-27 03:25:02.983853] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.551 [2024-11-27 03:25:02.985835] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.551 [2024-11-27 03:25:02.992167] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:00.551 [2024-11-27 03:25:02.992316] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:00.551 [2024-11-27 03:25:02.992336] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:00.551 [2024-11-27 03:25:02.992348] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:00.551 [2024-11-27 03:25:02.995172] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.551 [2024-11-27 03:25:02.995546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.995553] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:00.551 [2024-11-27 03:25:02.995587] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:00.551 [2024-11-27 03:25:02.995678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:02.995591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:00.551 [2024-11-27 03:25:02.995705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.551 [2024-11-27 03:25:02.995721] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.551 [2024-11-27 03:25:02.995904] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.551 [2024-11-27 03:25:02.996087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.551 [2024-11-27 03:25:02.996109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.551 [2024-11-27 03:25:02.996123] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.551 [2024-11-27 03:25:02.998483] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.551 [2024-11-27 03:25:03.007441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.551 [2024-11-27 03:25:03.007873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:03.008015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.551 [2024-11-27 03:25:03.008042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.551 [2024-11-27 03:25:03.008061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.551 [2024-11-27 03:25:03.008188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.008329] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.008352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.008369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.552 [2024-11-27 03:25:03.010431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.552 [2024-11-27 03:25:03.019944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.552 [2024-11-27 03:25:03.020374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.020483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.020509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.552 [2024-11-27 03:25:03.020538] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.552 [2024-11-27 03:25:03.020683] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.020873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.020895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.020912] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.552 [2024-11-27 03:25:03.023185] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.552 [2024-11-27 03:25:03.032457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.552 [2024-11-27 03:25:03.032899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.033078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.033105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.552 [2024-11-27 03:25:03.033124] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.552 [2024-11-27 03:25:03.033284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.033442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.033464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.033481] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.552 [2024-11-27 03:25:03.035515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.552 [2024-11-27 03:25:03.044939] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.552 [2024-11-27 03:25:03.045386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.045511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.045546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.552 [2024-11-27 03:25:03.045578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.552 [2024-11-27 03:25:03.045725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.045883] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.045906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.045924] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.552 [2024-11-27 03:25:03.048128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.552 [2024-11-27 03:25:03.057332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.552 [2024-11-27 03:25:03.057616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.057730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.057756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.552 [2024-11-27 03:25:03.057775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.552 [2024-11-27 03:25:03.057898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.058104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.058127] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.058143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.552 [2024-11-27 03:25:03.060494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.552 [2024-11-27 03:25:03.069857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.552 [2024-11-27 03:25:03.070323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.070449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.070477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.552 [2024-11-27 03:25:03.070497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.552 [2024-11-27 03:25:03.070669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.070794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.070817] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.070834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.552 [2024-11-27 03:25:03.072851] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.552 [2024-11-27 03:25:03.082299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.552 [2024-11-27 03:25:03.082606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.082766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.082792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.552 [2024-11-27 03:25:03.082810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.552 [2024-11-27 03:25:03.082964] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.083137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.083159] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.083175] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.552 [2024-11-27 03:25:03.085316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.552 [2024-11-27 03:25:03.094675] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.552 [2024-11-27 03:25:03.094932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.095032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.095058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.552 [2024-11-27 03:25:03.095074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.552 [2024-11-27 03:25:03.095273] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.095460] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.095483] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.095497] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.552 [2024-11-27 03:25:03.097587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.552 [2024-11-27 03:25:03.106959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.552 [2024-11-27 03:25:03.107238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.107402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.107428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.552 [2024-11-27 03:25:03.107444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.552 [2024-11-27 03:25:03.107587] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.107741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.107763] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.107778] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.552 [2024-11-27 03:25:03.110054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.552 [2024-11-27 03:25:03.119188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.552 [2024-11-27 03:25:03.119511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.119637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.552 [2024-11-27 03:25:03.119663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.552 [2024-11-27 03:25:03.119680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.552 [2024-11-27 03:25:03.119862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.552 [2024-11-27 03:25:03.120015] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.552 [2024-11-27 03:25:03.120038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.552 [2024-11-27 03:25:03.120052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.553 [2024-11-27 03:25:03.122222] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.553 [2024-11-27 03:25:03.131635] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.553 [2024-11-27 03:25:03.131918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.553 [2024-11-27 03:25:03.132037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.553 [2024-11-27 03:25:03.132063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.553 [2024-11-27 03:25:03.132078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.553 [2024-11-27 03:25:03.132212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.553 [2024-11-27 03:25:03.132366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.553 [2024-11-27 03:25:03.132387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.553 [2024-11-27 03:25:03.132402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.553 [2024-11-27 03:25:03.134373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.553 [2024-11-27 03:25:03.144053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.553 [2024-11-27 03:25:03.144364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.553 [2024-11-27 03:25:03.144488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.553 [2024-11-27 03:25:03.144519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.553 [2024-11-27 03:25:03.144546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.553 [2024-11-27 03:25:03.144680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.553 [2024-11-27 03:25:03.144819] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.553 [2024-11-27 03:25:03.144842] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.553 [2024-11-27 03:25:03.144856] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.553 [2024-11-27 03:25:03.146945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.858 [2024-11-27 03:25:03.156435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.858 [2024-11-27 03:25:03.156723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.156855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.156880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.858 [2024-11-27 03:25:03.156897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.858 [2024-11-27 03:25:03.157046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.858 [2024-11-27 03:25:03.157168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.858 [2024-11-27 03:25:03.157190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.858 [2024-11-27 03:25:03.157204] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.858 [2024-11-27 03:25:03.159334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.858 [2024-11-27 03:25:03.168746] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.858 [2024-11-27 03:25:03.169012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.169112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.169137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.858 [2024-11-27 03:25:03.169153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.858 [2024-11-27 03:25:03.169319] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.858 [2024-11-27 03:25:03.169472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.858 [2024-11-27 03:25:03.169494] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.858 [2024-11-27 03:25:03.169509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.858 [2024-11-27 03:25:03.171630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.858 [2024-11-27 03:25:03.181077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.858 [2024-11-27 03:25:03.181305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.181452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.181477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.858 [2024-11-27 03:25:03.181498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.858 [2024-11-27 03:25:03.181658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.858 [2024-11-27 03:25:03.181829] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.858 [2024-11-27 03:25:03.181851] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.858 [2024-11-27 03:25:03.181865] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.858 [2024-11-27 03:25:03.183922] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.858 [2024-11-27 03:25:03.193479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.858 [2024-11-27 03:25:03.193776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.193870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.193896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.858 [2024-11-27 03:25:03.193912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.858 [2024-11-27 03:25:03.194061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.858 [2024-11-27 03:25:03.194248] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.858 [2024-11-27 03:25:03.194270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.858 [2024-11-27 03:25:03.194284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.858 [2024-11-27 03:25:03.196444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.858 [2024-11-27 03:25:03.205741] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.858 [2024-11-27 03:25:03.206018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.206140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.206168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.858 [2024-11-27 03:25:03.206185] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.858 [2024-11-27 03:25:03.206318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.858 [2024-11-27 03:25:03.206488] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.858 [2024-11-27 03:25:03.206509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.858 [2024-11-27 03:25:03.206532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.858 [2024-11-27 03:25:03.208489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.858 [2024-11-27 03:25:03.217982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.858 [2024-11-27 03:25:03.218245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.218389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.858 [2024-11-27 03:25:03.218415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.858 [2024-11-27 03:25:03.218431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.858 [2024-11-27 03:25:03.218627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.858 [2024-11-27 03:25:03.218798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.858 [2024-11-27 03:25:03.218820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.858 [2024-11-27 03:25:03.218834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.858 [2024-11-27 03:25:03.220971] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.230330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.230644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.230740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.230767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.859 [2024-11-27 03:25:03.230783] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.859 [2024-11-27 03:25:03.230932] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.859 [2024-11-27 03:25:03.231037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.859 [2024-11-27 03:25:03.231058] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.859 [2024-11-27 03:25:03.231072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.859 [2024-11-27 03:25:03.233297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.242679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.242917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.243037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.243063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.859 [2024-11-27 03:25:03.243079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.859 [2024-11-27 03:25:03.243244] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.859 [2024-11-27 03:25:03.243382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.859 [2024-11-27 03:25:03.243403] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.859 [2024-11-27 03:25:03.243417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.859 [2024-11-27 03:25:03.245620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.255105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.255424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.255547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.255574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.859 [2024-11-27 03:25:03.255590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.859 [2024-11-27 03:25:03.255739] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.859 [2024-11-27 03:25:03.255931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.859 [2024-11-27 03:25:03.255954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.859 [2024-11-27 03:25:03.255967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.859 [2024-11-27 03:25:03.258028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.267353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.267649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.267751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.267776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.859 [2024-11-27 03:25:03.267792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.859 [2024-11-27 03:25:03.267957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.859 [2024-11-27 03:25:03.268143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.859 [2024-11-27 03:25:03.268165] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.859 [2024-11-27 03:25:03.268178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.859 [2024-11-27 03:25:03.270164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.279819] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.280080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.280204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.280232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.859 [2024-11-27 03:25:03.280247] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.859 [2024-11-27 03:25:03.280414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.859 [2024-11-27 03:25:03.280593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.859 [2024-11-27 03:25:03.280616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.859 [2024-11-27 03:25:03.280630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.859 [2024-11-27 03:25:03.282682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.292130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.292372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.292495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.292520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.859 [2024-11-27 03:25:03.292545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.859 [2024-11-27 03:25:03.292697] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.859 [2024-11-27 03:25:03.292867] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.859 [2024-11-27 03:25:03.292893] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.859 [2024-11-27 03:25:03.292909] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.859 [2024-11-27 03:25:03.294926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.304712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.304962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.305086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.305112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.859 [2024-11-27 03:25:03.305128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.859 [2024-11-27 03:25:03.305245] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.859 [2024-11-27 03:25:03.305388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.859 [2024-11-27 03:25:03.305410] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.859 [2024-11-27 03:25:03.305424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.859 [2024-11-27 03:25:03.307409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.317191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.317477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.317589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.317616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.859 [2024-11-27 03:25:03.317632] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.859 [2024-11-27 03:25:03.317765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.859 [2024-11-27 03:25:03.317902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.859 [2024-11-27 03:25:03.317924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.859 [2024-11-27 03:25:03.317938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.859 [2024-11-27 03:25:03.319948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.329479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.329769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.329893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.329919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.859 [2024-11-27 03:25:03.329935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.859 [2024-11-27 03:25:03.330068] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.859 [2024-11-27 03:25:03.330205] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.859 [2024-11-27 03:25:03.330227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.859 [2024-11-27 03:25:03.330247] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.859 [2024-11-27 03:25:03.332412] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.859 [2024-11-27 03:25:03.341979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.859 [2024-11-27 03:25:03.342245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.342372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.859 [2024-11-27 03:25:03.342397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.342413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.342570] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.342725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.860 [2024-11-27 03:25:03.342748] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.860 [2024-11-27 03:25:03.342762] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.860 [2024-11-27 03:25:03.344883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.860 [2024-11-27 03:25:03.354344] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.860 [2024-11-27 03:25:03.354623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.354748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.354774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.354790] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.354923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.355076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.860 [2024-11-27 03:25:03.355098] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.860 [2024-11-27 03:25:03.355112] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.860 [2024-11-27 03:25:03.357228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.860 [2024-11-27 03:25:03.366840] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.860 [2024-11-27 03:25:03.367084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.367172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.367199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.367215] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.367380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.367562] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.860 [2024-11-27 03:25:03.367585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.860 [2024-11-27 03:25:03.367598] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.860 [2024-11-27 03:25:03.369734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.860 [2024-11-27 03:25:03.379317] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.860 [2024-11-27 03:25:03.379579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.379675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.379701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.379717] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.379866] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.380004] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.860 [2024-11-27 03:25:03.380026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.860 [2024-11-27 03:25:03.380040] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.860 [2024-11-27 03:25:03.382178] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.860 [2024-11-27 03:25:03.391717] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.860 [2024-11-27 03:25:03.391960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.392056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.392081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.392098] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.392231] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.392384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.860 [2024-11-27 03:25:03.392406] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.860 [2024-11-27 03:25:03.392420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.860 [2024-11-27 03:25:03.394598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.860 [2024-11-27 03:25:03.404190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.860 [2024-11-27 03:25:03.404549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.404672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.404698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.404714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.404879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.405016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.860 [2024-11-27 03:25:03.405038] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.860 [2024-11-27 03:25:03.405052] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.860 [2024-11-27 03:25:03.407091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.860 [2024-11-27 03:25:03.416499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.860 [2024-11-27 03:25:03.416806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.416895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.416920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.416935] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.417084] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.417254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.860 [2024-11-27 03:25:03.417276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.860 [2024-11-27 03:25:03.417290] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.860 [2024-11-27 03:25:03.419421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.860 [2024-11-27 03:25:03.428777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.860 [2024-11-27 03:25:03.429030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.429140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.429165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.429180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.429330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.429451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.860 [2024-11-27 03:25:03.429473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.860 [2024-11-27 03:25:03.429487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.860 [2024-11-27 03:25:03.431719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.860 [2024-11-27 03:25:03.441186] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.860 [2024-11-27 03:25:03.441495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.441599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.441625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.441641] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.441757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.441910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.860 [2024-11-27 03:25:03.441932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.860 [2024-11-27 03:25:03.441947] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.860 [2024-11-27 03:25:03.443997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:00.860 [2024-11-27 03:25:03.453622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:00.860 [2024-11-27 03:25:03.453892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.453986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.860 [2024-11-27 03:25:03.454013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:00.860 [2024-11-27 03:25:03.454030] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:00.860 [2024-11-27 03:25:03.454180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:00.860 [2024-11-27 03:25:03.454366] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:00.861 [2024-11-27 03:25:03.454388] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:00.861 [2024-11-27 03:25:03.454402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:00.861 [2024-11-27 03:25:03.456435] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.120 [2024-11-27 03:25:03.465951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.466255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.466340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.466366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.121 [2024-11-27 03:25:03.466382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.121 [2024-11-27 03:25:03.466516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.121 [2024-11-27 03:25:03.466694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.121 [2024-11-27 03:25:03.466716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.121 [2024-11-27 03:25:03.466730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.121 [2024-11-27 03:25:03.468885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.121 [2024-11-27 03:25:03.478195] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.478454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.478546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.478573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.121 [2024-11-27 03:25:03.478589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.121 [2024-11-27 03:25:03.478722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.121 [2024-11-27 03:25:03.478921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.121 [2024-11-27 03:25:03.478943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.121 [2024-11-27 03:25:03.478956] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.121 [2024-11-27 03:25:03.481158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.121 [2024-11-27 03:25:03.490687] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.491014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.491138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.491169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.121 [2024-11-27 03:25:03.491186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.121 [2024-11-27 03:25:03.491368] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.121 [2024-11-27 03:25:03.491543] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.121 [2024-11-27 03:25:03.491566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.121 [2024-11-27 03:25:03.491581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.121 [2024-11-27 03:25:03.493673] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.121 [2024-11-27 03:25:03.503124] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.503417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.503534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.503561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.121 [2024-11-27 03:25:03.503577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.121 [2024-11-27 03:25:03.503743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.121 [2024-11-27 03:25:03.503878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.121 [2024-11-27 03:25:03.503900] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.121 [2024-11-27 03:25:03.503913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.121 [2024-11-27 03:25:03.505997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.121 [2024-11-27 03:25:03.515283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.515558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.515682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.515708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.121 [2024-11-27 03:25:03.515724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.121 [2024-11-27 03:25:03.515857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.121 [2024-11-27 03:25:03.516008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.121 [2024-11-27 03:25:03.516029] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.121 [2024-11-27 03:25:03.516043] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.121 [2024-11-27 03:25:03.518288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.121 [2024-11-27 03:25:03.527750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.528056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.528203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.528229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.121 [2024-11-27 03:25:03.528250] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.121 [2024-11-27 03:25:03.528400] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.121 [2024-11-27 03:25:03.528593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.121 [2024-11-27 03:25:03.528616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.121 [2024-11-27 03:25:03.528630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.121 [2024-11-27 03:25:03.530734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.121 [2024-11-27 03:25:03.540415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.540737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.540865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.540891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.121 [2024-11-27 03:25:03.540907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.121 [2024-11-27 03:25:03.541040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.121 [2024-11-27 03:25:03.541224] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.121 [2024-11-27 03:25:03.541245] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.121 [2024-11-27 03:25:03.541259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.121 [2024-11-27 03:25:03.543315] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.121 [2024-11-27 03:25:03.552755] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.553083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.553198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.553224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.121 [2024-11-27 03:25:03.553240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.121 [2024-11-27 03:25:03.553373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.121 [2024-11-27 03:25:03.553567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.121 [2024-11-27 03:25:03.553590] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.121 [2024-11-27 03:25:03.553605] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.121 [2024-11-27 03:25:03.555760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.121 [2024-11-27 03:25:03.565086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.565399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.565520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.565553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.121 [2024-11-27 03:25:03.565570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.121 [2024-11-27 03:25:03.565708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.121 [2024-11-27 03:25:03.565860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.121 [2024-11-27 03:25:03.565882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.121 [2024-11-27 03:25:03.565895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.121 [2024-11-27 03:25:03.567837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.121 [2024-11-27 03:25:03.577299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.121 [2024-11-27 03:25:03.577519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.121 [2024-11-27 03:25:03.577647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.577673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.577689] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.577887] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.122 [2024-11-27 03:25:03.578068] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.122 [2024-11-27 03:25:03.578089] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.122 [2024-11-27 03:25:03.578103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.122 [2024-11-27 03:25:03.580305] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.122 [2024-11-27 03:25:03.589724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.122 [2024-11-27 03:25:03.589931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.590014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.590039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.590055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.590188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.122 [2024-11-27 03:25:03.590342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.122 [2024-11-27 03:25:03.590364] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.122 [2024-11-27 03:25:03.590377] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.122 [2024-11-27 03:25:03.592376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.122 [2024-11-27 03:25:03.602134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.122 [2024-11-27 03:25:03.602417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.602548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.602575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.602591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.602725] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.122 [2024-11-27 03:25:03.602914] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.122 [2024-11-27 03:25:03.602936] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.122 [2024-11-27 03:25:03.602950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.122 [2024-11-27 03:25:03.605067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.122 [2024-11-27 03:25:03.614600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.122 [2024-11-27 03:25:03.614832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.614923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.614950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.614966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.615100] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.122 [2024-11-27 03:25:03.615250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.122 [2024-11-27 03:25:03.615272] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.122 [2024-11-27 03:25:03.615286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.122 [2024-11-27 03:25:03.617355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.122 [2024-11-27 03:25:03.626916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.122 [2024-11-27 03:25:03.627218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.627308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.627334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.627350] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.627499] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.122 [2024-11-27 03:25:03.627661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.122 [2024-11-27 03:25:03.627685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.122 [2024-11-27 03:25:03.627699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.122 [2024-11-27 03:25:03.629775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.122 [2024-11-27 03:25:03.639110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.122 [2024-11-27 03:25:03.639399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.639485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.639511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.639535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.639719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.122 [2024-11-27 03:25:03.639903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.122 [2024-11-27 03:25:03.639929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.122 [2024-11-27 03:25:03.639944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.122 [2024-11-27 03:25:03.641898] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.122 [2024-11-27 03:25:03.651537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.122 [2024-11-27 03:25:03.651800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.651939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.651965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.651981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.652114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.122 [2024-11-27 03:25:03.652265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.122 [2024-11-27 03:25:03.652286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.122 [2024-11-27 03:25:03.652300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.122 [2024-11-27 03:25:03.654389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.122 [2024-11-27 03:25:03.663958] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.122 [2024-11-27 03:25:03.664257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.664373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.664398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.664415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.664591] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.122 [2024-11-27 03:25:03.664762] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.122 [2024-11-27 03:25:03.664783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.122 [2024-11-27 03:25:03.664797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.122 [2024-11-27 03:25:03.666928] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.122 [2024-11-27 03:25:03.676188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.122 [2024-11-27 03:25:03.676420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.676560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.676586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.676602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.676720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.122 [2024-11-27 03:25:03.676857] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.122 [2024-11-27 03:25:03.676895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.122 [2024-11-27 03:25:03.676919] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.122 [2024-11-27 03:25:03.679015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.122 [2024-11-27 03:25:03.688473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.122 [2024-11-27 03:25:03.688729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.688842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.122 [2024-11-27 03:25:03.688868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.122 [2024-11-27 03:25:03.688884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.122 [2024-11-27 03:25:03.689034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.123 [2024-11-27 03:25:03.689217] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.123 [2024-11-27 03:25:03.689239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.123 [2024-11-27 03:25:03.689253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.123 [2024-11-27 03:25:03.691433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.123 [2024-11-27 03:25:03.700872] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.123 [2024-11-27 03:25:03.701177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.123 [2024-11-27 03:25:03.701298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.123 [2024-11-27 03:25:03.701324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.123 [2024-11-27 03:25:03.701340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.123 [2024-11-27 03:25:03.701521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.123 [2024-11-27 03:25:03.701651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.123 [2024-11-27 03:25:03.701673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.123 [2024-11-27 03:25:03.701687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.123 [2024-11-27 03:25:03.703967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.123 [2024-11-27 03:25:03.712977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.123 [2024-11-27 03:25:03.713265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.123 [2024-11-27 03:25:03.713378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.123 [2024-11-27 03:25:03.713404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.123 [2024-11-27 03:25:03.713420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.123 [2024-11-27 03:25:03.713597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.123 [2024-11-27 03:25:03.713769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.123 [2024-11-27 03:25:03.713792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.123 [2024-11-27 03:25:03.713806] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.123 [2024-11-27 03:25:03.715940] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.123 [2024-11-27 03:25:03.725401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.123 [2024-11-27 03:25:03.725689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.123 [2024-11-27 03:25:03.725777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.123 [2024-11-27 03:25:03.725803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.123 [2024-11-27 03:25:03.725819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.123 [2024-11-27 03:25:03.725936] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.123 [2024-11-27 03:25:03.726135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.123 [2024-11-27 03:25:03.726158] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.123 [2024-11-27 03:25:03.726172] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.123 [2024-11-27 03:25:03.728378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.383 [2024-11-27 03:25:03.738117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.383 [2024-11-27 03:25:03.738366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.738482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.738508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.383 [2024-11-27 03:25:03.738532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.383 [2024-11-27 03:25:03.738668] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.383 [2024-11-27 03:25:03.738854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.383 [2024-11-27 03:25:03.738876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.383 [2024-11-27 03:25:03.738889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.383 [2024-11-27 03:25:03.740787] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.383 [2024-11-27 03:25:03.750725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.383 [2024-11-27 03:25:03.751078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.751226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.751251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.383 [2024-11-27 03:25:03.751267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.383 [2024-11-27 03:25:03.751432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.383 [2024-11-27 03:25:03.751593] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.383 [2024-11-27 03:25:03.751616] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.383 [2024-11-27 03:25:03.751630] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.383 [2024-11-27 03:25:03.753587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.383 [2024-11-27 03:25:03.763047] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.383 [2024-11-27 03:25:03.763297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.763439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.763466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.383 [2024-11-27 03:25:03.763482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.383 [2024-11-27 03:25:03.763609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.383 [2024-11-27 03:25:03.763747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.383 [2024-11-27 03:25:03.763769] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.383 [2024-11-27 03:25:03.763783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.383 [2024-11-27 03:25:03.765902] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.383 [2024-11-27 03:25:03.775303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.383 [2024-11-27 03:25:03.775567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.775658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.775685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.383 [2024-11-27 03:25:03.775701] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.383 [2024-11-27 03:25:03.775852] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.383 [2024-11-27 03:25:03.775972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.383 [2024-11-27 03:25:03.775994] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.383 [2024-11-27 03:25:03.776008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.383 [2024-11-27 03:25:03.778069] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.383 [2024-11-27 03:25:03.787766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.383 [2024-11-27 03:25:03.787995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.788092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.788118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.383 [2024-11-27 03:25:03.788134] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.383 [2024-11-27 03:25:03.788283] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.383 [2024-11-27 03:25:03.788437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.383 [2024-11-27 03:25:03.788458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.383 [2024-11-27 03:25:03.788472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.383 [2024-11-27 03:25:03.790639] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.383 [2024-11-27 03:25:03.800105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.383 [2024-11-27 03:25:03.800409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.800501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.800534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.383 [2024-11-27 03:25:03.800553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.383 [2024-11-27 03:25:03.800686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.383 [2024-11-27 03:25:03.800856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.383 [2024-11-27 03:25:03.800878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.383 [2024-11-27 03:25:03.800892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.383 [2024-11-27 03:25:03.803024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.383 03:25:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:01.383 03:25:03 -- common/autotest_common.sh@862 -- # return 0 00:30:01.383 03:25:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:01.383 03:25:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:01.383 03:25:03 -- common/autotest_common.sh@10 -- # set +x 00:30:01.383 [2024-11-27 03:25:03.812370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.383 [2024-11-27 03:25:03.812670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.812769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.812794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.383 [2024-11-27 03:25:03.812809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.383 [2024-11-27 03:25:03.812959] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.383 [2024-11-27 03:25:03.813157] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.383 [2024-11-27 03:25:03.813179] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.383 [2024-11-27 03:25:03.813192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.383 [2024-11-27 03:25:03.815409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.383 [2024-11-27 03:25:03.824831] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.383 [2024-11-27 03:25:03.825097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.825223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.383 [2024-11-27 03:25:03.825249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.383 [2024-11-27 03:25:03.825265] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.383 [2024-11-27 03:25:03.825463] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.383 [2024-11-27 03:25:03.825672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.383 [2024-11-27 03:25:03.825695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.383 [2024-11-27 03:25:03.825709] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.383 [2024-11-27 03:25:03.827777] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.383 03:25:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:01.383 03:25:03 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:01.383 03:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.383 03:25:03 -- common/autotest_common.sh@10 -- # set +x 00:30:01.383 [2024-11-27 03:25:03.835599] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:01.383 [2024-11-27 03:25:03.837211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.384 [2024-11-27 03:25:03.837538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.837691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.837716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.384 [2024-11-27 03:25:03.837732] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.384 [2024-11-27 03:25:03.837881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.384 [2024-11-27 03:25:03.838031] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.384 [2024-11-27 03:25:03.838053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.384 [2024-11-27 03:25:03.838067] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.384 [2024-11-27 03:25:03.840145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.384 03:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.384 03:25:03 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:01.384 03:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.384 03:25:03 -- common/autotest_common.sh@10 -- # set +x 00:30:01.384 [2024-11-27 03:25:03.849619] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.384 [2024-11-27 03:25:03.849875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.850002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.850027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.384 [2024-11-27 03:25:03.850043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.384 [2024-11-27 03:25:03.850159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.384 [2024-11-27 03:25:03.850346] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.384 [2024-11-27 03:25:03.850368] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.384 [2024-11-27 03:25:03.850382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.384 [2024-11-27 03:25:03.852336] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.384 [2024-11-27 03:25:03.861837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.384 [2024-11-27 03:25:03.862096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.862216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.862243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.384 [2024-11-27 03:25:03.862258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.384 [2024-11-27 03:25:03.862470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.384 [2024-11-27 03:25:03.862625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.384 [2024-11-27 03:25:03.862649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.384 [2024-11-27 03:25:03.862663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.384 [2024-11-27 03:25:03.864847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.384 [2024-11-27 03:25:03.874201] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.384 [2024-11-27 03:25:03.874642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.874760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.874787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.384 [2024-11-27 03:25:03.874815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.384 [2024-11-27 03:25:03.875007] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.384 [2024-11-27 03:25:03.875209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.384 [2024-11-27 03:25:03.875232] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.384 [2024-11-27 03:25:03.875249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.384 [2024-11-27 03:25:03.877409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.384 Malloc0 00:30:01.384 03:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.384 03:25:03 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:01.384 03:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.384 03:25:03 -- common/autotest_common.sh@10 -- # set +x 00:30:01.384 [2024-11-27 03:25:03.886669] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.384 [2024-11-27 03:25:03.886970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.887074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.887100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.384 [2024-11-27 03:25:03.887118] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.384 [2024-11-27 03:25:03.887305] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.384 [2024-11-27 03:25:03.887444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.384 [2024-11-27 03:25:03.887467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.384 [2024-11-27 03:25:03.887482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.384 [2024-11-27 03:25:03.889636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.384 03:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.384 03:25:03 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:01.384 03:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.384 03:25:03 -- common/autotest_common.sh@10 -- # set +x 00:30:01.384 [2024-11-27 03:25:03.898981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.384 [2024-11-27 03:25:03.899234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.899359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.384 [2024-11-27 03:25:03.899392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129e870 with addr=10.0.0.2, port=4420 00:30:01.384 [2024-11-27 03:25:03.899410] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129e870 is same with the state(5) to be set 00:30:01.384 [2024-11-27 03:25:03.899568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129e870 (9): Bad file descriptor 00:30:01.384 [2024-11-27 03:25:03.899739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:01.384 [2024-11-27 03:25:03.899761] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:01.384 [2024-11-27 03:25:03.899777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:01.384 03:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.384 03:25:03 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:01.384 03:25:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.384 03:25:03 -- common/autotest_common.sh@10 -- # set +x 00:30:01.384 [2024-11-27 03:25:03.901944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:01.384 [2024-11-27 03:25:03.905100] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:01.384 03:25:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:01.384 03:25:03 -- host/bdevperf.sh@38 -- # wait 2583390 00:30:01.384 [2024-11-27 03:25:03.911534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:01.384 [2024-11-27 03:25:03.941163] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:11.364 00:30:11.364 Latency(us) 00:30:11.364 [2024-11-27T02:25:13.983Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:11.364 [2024-11-27T02:25:13.983Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:11.364 Verification LBA range: start 0x0 length 0x4000 00:30:11.364 Nvme1n1 : 15.00 9319.43 36.40 16093.11 0.00 5022.36 746.38 19612.25 00:30:11.364 [2024-11-27T02:25:13.983Z] =================================================================================================================== 00:30:11.364 [2024-11-27T02:25:13.983Z] Total : 9319.43 36.40 16093.11 0.00 5022.36 746.38 19612.25 00:30:11.364 03:25:12 -- host/bdevperf.sh@39 -- # sync 00:30:11.364 03:25:12 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:11.364 03:25:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:11.364 03:25:12 -- common/autotest_common.sh@10 -- # set +x 00:30:11.364 03:25:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:11.364 03:25:12 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:11.364 03:25:12 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:11.364 03:25:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:11.364 03:25:12 -- nvmf/common.sh@116 -- # sync 00:30:11.364 03:25:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:11.364 03:25:12 -- nvmf/common.sh@119 -- # set +e 00:30:11.364 03:25:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:11.364 03:25:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:11.364 rmmod nvme_tcp 00:30:11.364 rmmod nvme_fabrics 00:30:11.364 rmmod nvme_keyring 00:30:11.364 03:25:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:11.364 03:25:12 -- nvmf/common.sh@123 -- # set -e 00:30:11.364 03:25:12 -- nvmf/common.sh@124 -- # return 0 00:30:11.364 03:25:12 -- nvmf/common.sh@477 -- # '[' -n 2584085 ']' 00:30:11.364 03:25:12 -- nvmf/common.sh@478 -- # killprocess 2584085 00:30:11.364 03:25:12 -- common/autotest_common.sh@936 -- # '[' -z 2584085 ']' 00:30:11.364 03:25:12 -- common/autotest_common.sh@940 -- # kill -0 2584085 00:30:11.364 03:25:12 -- common/autotest_common.sh@941 -- # uname 00:30:11.364 03:25:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:11.364 03:25:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2584085 00:30:11.364 03:25:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:11.364 03:25:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:11.364 03:25:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2584085' 00:30:11.364 killing process with pid 2584085 00:30:11.364 03:25:12 -- common/autotest_common.sh@955 -- # kill 2584085 00:30:11.364 03:25:12 -- common/autotest_common.sh@960 -- # wait 2584085 00:30:11.364 03:25:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:11.364 03:25:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:11.364 03:25:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:11.364 03:25:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:11.364 03:25:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:11.364 03:25:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:11.364 03:25:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:11.364 03:25:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:12.300 03:25:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:12.300 00:30:12.300 real 0m23.133s 00:30:12.300 user 1m2.283s 00:30:12.300 sys 0m4.278s 00:30:12.300 03:25:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:12.300 03:25:14 -- common/autotest_common.sh@10 -- # set +x 00:30:12.300 ************************************ 00:30:12.300 END TEST nvmf_bdevperf 00:30:12.300 ************************************ 00:30:12.300 03:25:14 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:12.300 03:25:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:12.300 03:25:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:12.300 03:25:14 -- common/autotest_common.sh@10 -- # set +x 00:30:12.300 ************************************ 00:30:12.300 START TEST nvmf_target_disconnect 00:30:12.300 ************************************ 00:30:12.300 03:25:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:12.300 * Looking for test storage... 00:30:12.300 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:12.300 03:25:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:12.300 03:25:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:12.300 03:25:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:12.560 03:25:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:12.560 03:25:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:12.560 03:25:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:12.560 03:25:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:12.560 03:25:14 -- scripts/common.sh@335 -- # IFS=.-: 00:30:12.560 03:25:14 -- scripts/common.sh@335 -- # read -ra ver1 00:30:12.560 03:25:14 -- scripts/common.sh@336 -- # IFS=.-: 00:30:12.560 03:25:14 -- scripts/common.sh@336 -- # read -ra ver2 00:30:12.560 03:25:14 -- scripts/common.sh@337 -- # local 'op=<' 00:30:12.560 03:25:14 -- scripts/common.sh@339 -- # ver1_l=2 00:30:12.560 03:25:14 -- scripts/common.sh@340 -- # ver2_l=1 00:30:12.560 03:25:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:12.560 03:25:14 -- scripts/common.sh@343 -- # case "$op" in 00:30:12.560 03:25:14 -- scripts/common.sh@344 -- # : 1 00:30:12.560 03:25:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:12.560 03:25:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:12.560 03:25:14 -- scripts/common.sh@364 -- # decimal 1 00:30:12.560 03:25:14 -- scripts/common.sh@352 -- # local d=1 00:30:12.560 03:25:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:12.560 03:25:14 -- scripts/common.sh@354 -- # echo 1 00:30:12.560 03:25:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:12.560 03:25:14 -- scripts/common.sh@365 -- # decimal 2 00:30:12.560 03:25:14 -- scripts/common.sh@352 -- # local d=2 00:30:12.560 03:25:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:12.560 03:25:14 -- scripts/common.sh@354 -- # echo 2 00:30:12.560 03:25:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:12.560 03:25:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:12.560 03:25:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:12.560 03:25:14 -- scripts/common.sh@367 -- # return 0 00:30:12.560 03:25:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:12.560 03:25:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:12.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:12.560 --rc genhtml_branch_coverage=1 00:30:12.560 --rc genhtml_function_coverage=1 00:30:12.560 --rc genhtml_legend=1 00:30:12.560 --rc geninfo_all_blocks=1 00:30:12.560 --rc geninfo_unexecuted_blocks=1 00:30:12.560 00:30:12.560 ' 00:30:12.561 03:25:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:12.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:12.561 --rc genhtml_branch_coverage=1 00:30:12.561 --rc genhtml_function_coverage=1 00:30:12.561 --rc genhtml_legend=1 00:30:12.561 --rc geninfo_all_blocks=1 00:30:12.561 --rc geninfo_unexecuted_blocks=1 00:30:12.561 00:30:12.561 ' 00:30:12.561 03:25:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:12.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:12.561 --rc genhtml_branch_coverage=1 00:30:12.561 --rc genhtml_function_coverage=1 00:30:12.561 --rc genhtml_legend=1 00:30:12.561 --rc geninfo_all_blocks=1 00:30:12.561 --rc geninfo_unexecuted_blocks=1 00:30:12.561 00:30:12.561 ' 00:30:12.561 03:25:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:12.561 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:12.561 --rc genhtml_branch_coverage=1 00:30:12.561 --rc genhtml_function_coverage=1 00:30:12.561 --rc genhtml_legend=1 00:30:12.561 --rc geninfo_all_blocks=1 00:30:12.561 --rc geninfo_unexecuted_blocks=1 00:30:12.561 00:30:12.561 ' 00:30:12.561 03:25:14 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:12.561 03:25:14 -- nvmf/common.sh@7 -- # uname -s 00:30:12.561 03:25:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:12.561 03:25:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:12.561 03:25:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:12.561 03:25:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:12.561 03:25:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:12.561 03:25:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:12.561 03:25:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:12.561 03:25:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:12.561 03:25:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:12.561 03:25:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:12.561 03:25:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:12.561 03:25:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:12.561 03:25:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:12.561 03:25:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:12.561 03:25:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:12.561 03:25:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:12.561 03:25:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:12.561 03:25:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:12.561 03:25:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:12.561 03:25:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.561 03:25:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.561 03:25:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.561 03:25:15 -- paths/export.sh@5 -- # export PATH 00:30:12.561 03:25:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:12.561 03:25:15 -- nvmf/common.sh@46 -- # : 0 00:30:12.561 03:25:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:12.561 03:25:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:12.561 03:25:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:12.561 03:25:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:12.561 03:25:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:12.561 03:25:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:12.561 03:25:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:12.561 03:25:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:12.561 03:25:15 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:12.561 03:25:15 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:12.561 03:25:15 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:12.561 03:25:15 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:12.561 03:25:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:12.561 03:25:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:12.561 03:25:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:12.561 03:25:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:12.561 03:25:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:12.561 03:25:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:12.561 03:25:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:12.561 03:25:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:12.561 03:25:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:12.561 03:25:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:12.561 03:25:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:12.561 03:25:15 -- common/autotest_common.sh@10 -- # set +x 00:30:14.466 03:25:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:14.466 03:25:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:14.466 03:25:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:14.466 03:25:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:14.466 03:25:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:14.466 03:25:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:14.466 03:25:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:14.466 03:25:16 -- nvmf/common.sh@294 -- # net_devs=() 00:30:14.466 03:25:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:14.466 03:25:16 -- nvmf/common.sh@295 -- # e810=() 00:30:14.466 03:25:16 -- nvmf/common.sh@295 -- # local -ga e810 00:30:14.466 03:25:16 -- nvmf/common.sh@296 -- # x722=() 00:30:14.466 03:25:16 -- nvmf/common.sh@296 -- # local -ga x722 00:30:14.466 03:25:16 -- nvmf/common.sh@297 -- # mlx=() 00:30:14.466 03:25:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:14.466 03:25:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:14.466 03:25:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:14.466 03:25:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:14.466 03:25:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:14.466 03:25:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:14.466 03:25:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:14.466 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:14.466 03:25:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:14.466 03:25:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:14.466 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:14.466 03:25:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:14.466 03:25:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:14.466 03:25:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:14.466 03:25:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:14.466 03:25:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:14.466 03:25:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:14.466 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:14.466 03:25:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:14.466 03:25:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:14.466 03:25:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:14.466 03:25:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:14.466 03:25:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:14.466 03:25:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:14.466 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:14.466 03:25:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:14.466 03:25:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:14.466 03:25:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:14.466 03:25:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:14.466 03:25:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:14.466 03:25:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:14.466 03:25:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:14.466 03:25:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:14.466 03:25:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:14.466 03:25:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:14.466 03:25:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:14.466 03:25:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:14.466 03:25:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:14.466 03:25:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:14.466 03:25:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:14.466 03:25:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:14.466 03:25:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:14.466 03:25:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:14.466 03:25:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:14.466 03:25:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:14.466 03:25:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:14.466 03:25:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:14.466 03:25:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:14.466 03:25:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:14.466 03:25:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:14.725 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:14.725 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:30:14.725 00:30:14.725 --- 10.0.0.2 ping statistics --- 00:30:14.725 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:14.725 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:30:14.725 03:25:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:14.725 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:14.725 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.115 ms 00:30:14.725 00:30:14.725 --- 10.0.0.1 ping statistics --- 00:30:14.725 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:14.725 rtt min/avg/max/mdev = 0.115/0.115/0.115/0.000 ms 00:30:14.725 03:25:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:14.725 03:25:17 -- nvmf/common.sh@410 -- # return 0 00:30:14.725 03:25:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:14.725 03:25:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:14.725 03:25:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:14.725 03:25:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:14.725 03:25:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:14.725 03:25:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:14.725 03:25:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:14.725 03:25:17 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:14.725 03:25:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:14.725 03:25:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:14.725 03:25:17 -- common/autotest_common.sh@10 -- # set +x 00:30:14.725 ************************************ 00:30:14.725 START TEST nvmf_target_disconnect_tc1 00:30:14.725 ************************************ 00:30:14.725 03:25:17 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:14.725 03:25:17 -- host/target_disconnect.sh@32 -- # set +e 00:30:14.725 03:25:17 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:14.725 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.725 [2024-11-27 03:25:17.204807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.725 [2024-11-27 03:25:17.205017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.725 [2024-11-27 03:25:17.205048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1affdf0 with addr=10.0.0.2, port=4420 00:30:14.725 [2024-11-27 03:25:17.205085] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:14.725 [2024-11-27 03:25:17.205111] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:14.725 [2024-11-27 03:25:17.205126] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:14.725 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:14.725 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:14.726 Initializing NVMe Controllers 00:30:14.726 03:25:17 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:14.726 03:25:17 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:14.726 03:25:17 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:14.726 03:25:17 -- common/autotest_common.sh@1142 -- # return 0 00:30:14.726 03:25:17 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:14.726 03:25:17 -- host/target_disconnect.sh@41 -- # set -e 00:30:14.726 00:30:14.726 real 0m0.099s 00:30:14.726 user 0m0.040s 00:30:14.726 sys 0m0.059s 00:30:14.726 03:25:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:14.726 03:25:17 -- common/autotest_common.sh@10 -- # set +x 00:30:14.726 ************************************ 00:30:14.726 END TEST nvmf_target_disconnect_tc1 00:30:14.726 ************************************ 00:30:14.726 03:25:17 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:14.726 03:25:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:14.726 03:25:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:14.726 03:25:17 -- common/autotest_common.sh@10 -- # set +x 00:30:14.726 ************************************ 00:30:14.726 START TEST nvmf_target_disconnect_tc2 00:30:14.726 ************************************ 00:30:14.726 03:25:17 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:14.726 03:25:17 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:14.726 03:25:17 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:14.726 03:25:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:14.726 03:25:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:14.726 03:25:17 -- common/autotest_common.sh@10 -- # set +x 00:30:14.726 03:25:17 -- nvmf/common.sh@469 -- # nvmfpid=2587277 00:30:14.726 03:25:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:14.726 03:25:17 -- nvmf/common.sh@470 -- # waitforlisten 2587277 00:30:14.726 03:25:17 -- common/autotest_common.sh@829 -- # '[' -z 2587277 ']' 00:30:14.726 03:25:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:14.726 03:25:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:14.726 03:25:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:14.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:14.726 03:25:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:14.726 03:25:17 -- common/autotest_common.sh@10 -- # set +x 00:30:14.726 [2024-11-27 03:25:17.296997] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:14.726 [2024-11-27 03:25:17.297082] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:14.726 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.985 [2024-11-27 03:25:17.362143] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:14.985 [2024-11-27 03:25:17.449063] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:14.985 [2024-11-27 03:25:17.449216] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:14.985 [2024-11-27 03:25:17.449233] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:14.985 [2024-11-27 03:25:17.449245] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:14.985 [2024-11-27 03:25:17.449345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:14.985 [2024-11-27 03:25:17.449403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:14.985 [2024-11-27 03:25:17.449473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:14.985 [2024-11-27 03:25:17.449476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:15.922 03:25:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:15.922 03:25:18 -- common/autotest_common.sh@862 -- # return 0 00:30:15.922 03:25:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:15.922 03:25:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:15.922 03:25:18 -- common/autotest_common.sh@10 -- # set +x 00:30:15.922 03:25:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:15.922 03:25:18 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:15.922 03:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.922 03:25:18 -- common/autotest_common.sh@10 -- # set +x 00:30:15.922 Malloc0 00:30:15.922 03:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.922 03:25:18 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:15.922 03:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.922 03:25:18 -- common/autotest_common.sh@10 -- # set +x 00:30:15.922 [2024-11-27 03:25:18.299280] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:15.922 03:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.922 03:25:18 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:15.922 03:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.922 03:25:18 -- common/autotest_common.sh@10 -- # set +x 00:30:15.922 03:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.922 03:25:18 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:15.922 03:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.922 03:25:18 -- common/autotest_common.sh@10 -- # set +x 00:30:15.922 03:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.922 03:25:18 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:15.922 03:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.922 03:25:18 -- common/autotest_common.sh@10 -- # set +x 00:30:15.922 [2024-11-27 03:25:18.327547] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:15.922 03:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.922 03:25:18 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:15.922 03:25:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:15.922 03:25:18 -- common/autotest_common.sh@10 -- # set +x 00:30:15.922 03:25:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.922 03:25:18 -- host/target_disconnect.sh@50 -- # reconnectpid=2587434 00:30:15.922 03:25:18 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:15.922 03:25:18 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:15.922 EAL: No free 2048 kB hugepages reported on node 1 00:30:17.837 03:25:20 -- host/target_disconnect.sh@53 -- # kill -9 2587277 00:30:17.837 03:25:20 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 [2024-11-27 03:25:20.351844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Write completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 Read completed with error (sct=0, sc=8) 00:30:17.837 starting I/O failed 00:30:17.837 [2024-11-27 03:25:20.352184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:17.837 [2024-11-27 03:25:20.352326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.352452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.352479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.837 qpair failed and we were unable to recover it. 00:30:17.837 [2024-11-27 03:25:20.352596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.352693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.352718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.837 qpair failed and we were unable to recover it. 00:30:17.837 [2024-11-27 03:25:20.352800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.352904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.352930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.837 qpair failed and we were unable to recover it. 00:30:17.837 [2024-11-27 03:25:20.353024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.353148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.353173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.837 qpair failed and we were unable to recover it. 00:30:17.837 [2024-11-27 03:25:20.353270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.353393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.353418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.837 qpair failed and we were unable to recover it. 00:30:17.837 [2024-11-27 03:25:20.353549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.353638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.353663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.837 qpair failed and we were unable to recover it. 00:30:17.837 [2024-11-27 03:25:20.353756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.353855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.837 [2024-11-27 03:25:20.353880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.353993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.354090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.354134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.354235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.354366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.354407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.354594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.354683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.354708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.354797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.354925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.354949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.355045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.355180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.355207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.355333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.355454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.355479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.355586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.355676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.355701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.355792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.355905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.355946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.356052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.356234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.356277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.356380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.356472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.356499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.356630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.356723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.356748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.356861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.357014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.357039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.357131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.357238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.357263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.357406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.357566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.357591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.357712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.357843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.357867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.357984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.358103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.358146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.358245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.358342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.358370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.358539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.358625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.358651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.358732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.358820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.358845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.358950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.359062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.359105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.359294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.359443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.359470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.359590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.359693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.359718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.359806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.359917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.359941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.360050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.360158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.360198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.360302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.360425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.360452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.360618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.360704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.360730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.360874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.361013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.361040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.361194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.361304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.361331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.838 qpair failed and we were unable to recover it. 00:30:17.838 [2024-11-27 03:25:20.361439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.838 [2024-11-27 03:25:20.361520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.361561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.361641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.361736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.361761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.361883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.361995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.362020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.362135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.362304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.362336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.362447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.362540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.362565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.362652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.362730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.362755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.362902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.362985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.363010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.363126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.363238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.363263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.363358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.363462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.363487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.363603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.363729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.363760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.363897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.363983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.364010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.364133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.364251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.364278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.364398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.364483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.364510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.364665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.364787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.364812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.364950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.365041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.365067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.365184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.365293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.365319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.365399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.365516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.365551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.365644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.365730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.365759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.365886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.365976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.366001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.366118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.366242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.366267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.366349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.366459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.366486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.366616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.366730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.366756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.366902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.367044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.367069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.367245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.367372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.367400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.367521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.367683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.367709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.367806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.367922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.367949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.368069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.368181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.368207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.368318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.368440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.368466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.839 qpair failed and we were unable to recover it. 00:30:17.839 [2024-11-27 03:25:20.368562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.839 [2024-11-27 03:25:20.368650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.368676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.368759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.368846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.368871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.368979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.369095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.369121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.369265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.369388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.369414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.369506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.369591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.369617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.369715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.369797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.369823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.369969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.370087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.370114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.370207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.370292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.370318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.370431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.370582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.370608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.370694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.370803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.370829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.370922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.371036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.371062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.371186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.371301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.371327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.371417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.371542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.371569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.371687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.371826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.371851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.371943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.372088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.372113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.372253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.372397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.372423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.372533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.372678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.372704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.372792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.372881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.372908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.373021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.373165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.373192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.373310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.373430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.373456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.373558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.373650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.373676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.373757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.373848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.373874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.373998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.374092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.374118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.374233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.374346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.374371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.374453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.374582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.374609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.374726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.374870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.840 [2024-11-27 03:25:20.374896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.840 qpair failed and we were unable to recover it. 00:30:17.840 [2024-11-27 03:25:20.375044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.375157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.375183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.375324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.375465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.375491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.375612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.375723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.375749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.375869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.376018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.376043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.376140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.376249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.376275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.376389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.376507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.376540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.376659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.376739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.376764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.376917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.377030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.377056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.377138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.377254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.377280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.377429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.377580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.377607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.377703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.377824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.377850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.377962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.378046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.378072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.378187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.378331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.378357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.378490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.378646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.378673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.378787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.378872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.378898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.379009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.379148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.379173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.379290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.379403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.379428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.379549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.379626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.379652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.379740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.379847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.379872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.379959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.380069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.380095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.380236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.380322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.380347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.380461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.380580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.380606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.380720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.380811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.380838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.841 qpair failed and we were unable to recover it. 00:30:17.841 [2024-11-27 03:25:20.380932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.841 [2024-11-27 03:25:20.381051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.381077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.381158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.381247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.381272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.381357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.381471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.381497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.381626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.381744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.381770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.381920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.382061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.382086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.382203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.382292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.382318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.382423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.382560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.382602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.382747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.382842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.382868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.382979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.383089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.383115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.383225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.383311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.383336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.383425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.383536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.383561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.383671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.383758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.383783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.383924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.384149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.384371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.384618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.384875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.384989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.385109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.385224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.385249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.385363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.385505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.385536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.385679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.385785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.385810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.385933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.386010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.386035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.386150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.386259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.386284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.386371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.386514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.386558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.386673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.386792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.386818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.386933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.387041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.387067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.387214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.387328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.387354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.387473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.387615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.387641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.387782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.387903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.387929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.842 [2024-11-27 03:25:20.388021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.388108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.842 [2024-11-27 03:25:20.388134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.842 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.388245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.388334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.388360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.388443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.388557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.388584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.388665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.388785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.388811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.388919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.389025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.389051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.389169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.389288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.389314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.389423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.389562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.389588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.389677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.389789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.389815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.389904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.389998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.390024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.390115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.390205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.390230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.390320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.390436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.390463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.390555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.390668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.390694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.390813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.390926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.390951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.391036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.391147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.391172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.391285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.391398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.391424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.391547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.391628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.391653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.391768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.391874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.391900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.392041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.392154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.392179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.392271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.392357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.392383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.392474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.392616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.392647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.392765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.392884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.392911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.393027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.393106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.393132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.393242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.393385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.393411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.393498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.393589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.393620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.393736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.393841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.393866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.393974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.394056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.394086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.394171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.394320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.394346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.394488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.394645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.394672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.394809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.394928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.394954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.843 qpair failed and we were unable to recover it. 00:30:17.843 [2024-11-27 03:25:20.395037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.395118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.843 [2024-11-27 03:25:20.395148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.395276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.395369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.395396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.395513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.395634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.395660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.395782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.395866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.395891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.396006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.396096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.396121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.396205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.396348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.396374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.396462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.396543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.396570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.396660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.396780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.396805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.396916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.397011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.397035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.397121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.397238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.397264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.397346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.397489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.397522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.397633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.397725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.397752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.397869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.397983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.398009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.398093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.398182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.398207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.398320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.398431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.398456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.398600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.398687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.398712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.398855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.398972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.398997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.399080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.399224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.399250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.399364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.399448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.399473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.399588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.399729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.399754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.399843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.399934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.399964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.400047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.400162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.400187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.400305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.400421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.400447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.400555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.400702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.400728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.400870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.400983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.401008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.401126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.401237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.401262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.401369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.401458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.401487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.401658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.401776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.401801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.401919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.402037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.402063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.844 qpair failed and we were unable to recover it. 00:30:17.844 [2024-11-27 03:25:20.402188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.844 [2024-11-27 03:25:20.402302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.402328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.402471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.402586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.402613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.402734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.402828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.402854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.402965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.403073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.403100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.403182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.403304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.403329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.403449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.403537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.403562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.403646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.403760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.403787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.403929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.404018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.404044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.404164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.404282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.404308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.404455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.404596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.404623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.404712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.404827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.404853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.404934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.405016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.405042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.405191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.405305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.405331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.405419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.405502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.405535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.405649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.405762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.405787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.405878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.405995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.406023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.406164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.406306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.406332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.406500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.406639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.406665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.406751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.406895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.406921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.407042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.407132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.407159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.407279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.407390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.407415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.407533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.407654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.407679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.407771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.407862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.407887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.407999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.408087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.408112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.408253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.408335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.408360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.408469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.408562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.408588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.408702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.408794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.408820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.408905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.409019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.409046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.409131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.409276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.845 [2024-11-27 03:25:20.409302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.845 qpair failed and we were unable to recover it. 00:30:17.845 [2024-11-27 03:25:20.409380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.409471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.409497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.409634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.409754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.409779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.409892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.410158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.410386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.410643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.410841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.410986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.411066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.411203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.411228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.411304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.411400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.411425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.411535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.411617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.411642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.411789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.411901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.411927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.412015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.412161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.412186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.412297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.412437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.412463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.412549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.412662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.412689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.412776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.412887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.412914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.413023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.413168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.413194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.413308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.413393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.413418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.413533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.413645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.413671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.413752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.413829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.413854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.413934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.414043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.414069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.414181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.414296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.414322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.414447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.414562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.414588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.414704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.414817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.414843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.414965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.415044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.415069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.415153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.415302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.846 [2024-11-27 03:25:20.415329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.846 qpair failed and we were unable to recover it. 00:30:17.846 [2024-11-27 03:25:20.415445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.415535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.415560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.415679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.415758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.415783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.415883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.415993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.416019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.416100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.416214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.416240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.416351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.416460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.416485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.416584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.416697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.416722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.416870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.416963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.416988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.417111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.417253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.417279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.417429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.417550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.417577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.417668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.417804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.417830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.417948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.418061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.418087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 [2024-11-27 03:25:20.418234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.418316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.418343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:17.847 qpair failed and we were unable to recover it. 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 [2024-11-27 03:25:20.418654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Read completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 Write completed with error (sct=0, sc=8) 00:30:17.847 starting I/O failed 00:30:17.847 [2024-11-27 03:25:20.418938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:17.847 [2024-11-27 03:25:20.419128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.847 [2024-11-27 03:25:20.419324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.419377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.419541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.419641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.419667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.419763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.419878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.419903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.420017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.420129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.420171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.420275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.420415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.420440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.420562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.420675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.420700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.420812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.420918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.420944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.421060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.421193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.421221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.421320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.421458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.421499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.421592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.421685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.421711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.421808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.421939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.421967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.422160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.422304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.422329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.422437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.422583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.422609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.422695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.422778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.422803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.422914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.422991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.423016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.423101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.423269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.423297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.423393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.423507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.423538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.423630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.423716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.423757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.423913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.424016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.424043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.424140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.424240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.424269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.424419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.424515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.424552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.424684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.424824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.424849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.424966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.425077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.425102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.425243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.425357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.425382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.425552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.425655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.425680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.425762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.425839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.425864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.426005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.426151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.426176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.426295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.426384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.426409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.426534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.426613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.426638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.848 qpair failed and we were unable to recover it. 00:30:17.848 [2024-11-27 03:25:20.426723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.848 [2024-11-27 03:25:20.426803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.426829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.426917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.426992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.427017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.427133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.427244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.427269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.427382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.427523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.427554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.427694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.427840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.427865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.427954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.428060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.428088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.428223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.428308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.428333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.428449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.428529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.428559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.428670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.428768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.428796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.428936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.429016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.429041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.429122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.429262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.429290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.429420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.429561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.429587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.429726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.429872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.429897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.429978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.430124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.430149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.430265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.430350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.430375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.430557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.430633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.430658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.430800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.430889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.430915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.430997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.431111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.431137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.431235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.431365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.431392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.431512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.431653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.431678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.431798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.431915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.431940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.432016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.432125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.432149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.432263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.432404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.432429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.432557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.432684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.432725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.432807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.432914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.432939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.433030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.433134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.433166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.433296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.433455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.433480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.433603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.433690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.433715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.849 [2024-11-27 03:25:20.433806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.433923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.849 [2024-11-27 03:25:20.433952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.849 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.434045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.434198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.434225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.434393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.434537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.434563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.434681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.434799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.434824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.434924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.435023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.435051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.435158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.435271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.435296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.435389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.435506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.435536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.435652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.435765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.435790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.435908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.436024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.436049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.436192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.436316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.436344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.436460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.436576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.436602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.436714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.436790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.436815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.436905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.436988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.437012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.437088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.437202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.437226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.437312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.437445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.437473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.437606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.437701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.437725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.437818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.437926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.437951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.438029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.438141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.438166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.438247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.438331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.438356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.438500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.438594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.438619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.438760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.438872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.438897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.439015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.439148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.439176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.439311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.439424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.439449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.439564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.439660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.439685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.439800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.439887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.439912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.440079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.440209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.440237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.440352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.440491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.440516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.440615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.440700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.440724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.440813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.440923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.440947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.850 [2024-11-27 03:25:20.441064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.441150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.850 [2024-11-27 03:25:20.441175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.850 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.441329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.441421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.441452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.441581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.441708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.441732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.441848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.441961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.441986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.442098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.442181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.442206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.442291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.442379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.442403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.442500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.442591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.442615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.442726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.442814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.442839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.442920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.443136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.443334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.443609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:17.851 [2024-11-27 03:25:20.443832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.851 [2024-11-27 03:25:20.443974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:17.851 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.444054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.444141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.444167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.444287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.444396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.444420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.444506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.444603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.444628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.444744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.444881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.444905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.444995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.445151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.445175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.445301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.445389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.445413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.445594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.445710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.445735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.445867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.445992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.446019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.446129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.446209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.446233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.446320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.446436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.446460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.446599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.446688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.446712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.446800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.446915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.446939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.447024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.447154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.447181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.132 qpair failed and we were unable to recover it. 00:30:18.132 [2024-11-27 03:25:20.447270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.132 [2024-11-27 03:25:20.447428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.447452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.447545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.447689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.447714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.447848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.447956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.447982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.448099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.448205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.448246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.448358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.448472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.448497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.448651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.448769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.448793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.448942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.449072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.449096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.449237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.449348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.449371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.449457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.449570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.449596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.449738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.449862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.449889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.450060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.450179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.450203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.450319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.450402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.450426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.450541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.450616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.450640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.450750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.450831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.450855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.450967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.451130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.451156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.451274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.451397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.451425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.451591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.451686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.451710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.451839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.451936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.451978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.452091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.452170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.452194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.452313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.452448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.452472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.452558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.452703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.452727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.452844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.452960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.452984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.453126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.453235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.453259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.453348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.453464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.453489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.453577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.453686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.453711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.453795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.453870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.453894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.453987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.454102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.454130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.454211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.454350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.454375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.454457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.454544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.454570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.133 qpair failed and we were unable to recover it. 00:30:18.133 [2024-11-27 03:25:20.454692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.133 [2024-11-27 03:25:20.454805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.454830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.454915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.455026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.455051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.455166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.455255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.455279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.455434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.455538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.455563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.455651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.455738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.455763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.455915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.456033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.456057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.456168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.456254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.456278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.456364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.456562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.456587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.456670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.456760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.456784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.456897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.457044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.457068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.457191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.457302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.457326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.457419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.457538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.457563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.457674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.457791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.457815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.457901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.458239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.458456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.458663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.458837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.458939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.459060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.459142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.459166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.459275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.459401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.459428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.459565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.459656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.459682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.459796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.459886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.459911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.460019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.460107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.460132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.460247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.460392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.460416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.460558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.460693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.460718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.460857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.460995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.461020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.461134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.461245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.461270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.461389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.461517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.461555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.461654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.461815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.461839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.134 qpair failed and we were unable to recover it. 00:30:18.134 [2024-11-27 03:25:20.461986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.134 [2024-11-27 03:25:20.462098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.462122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.462236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.462375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.462399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.462515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.462633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.462675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.462792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.462905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.462929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.463034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.463151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.463175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.463306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.463426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.463467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.463609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.463730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.463754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.463842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.463935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.463959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.464037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.464194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.464220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.464359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.464485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.464510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.464610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.464696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.464720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.464832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.464975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.465014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.465127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.465243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.465267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.465384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.465477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.465501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.465589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.465729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.465753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.465858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.465943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.465967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.466051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.466163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.466187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.466278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.466420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.466464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.466578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.466690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.466715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.466806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.466917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.466945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.467067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.467151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.467176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.467258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.467369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.467393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.467536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.467626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.467650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.467814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.467939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.467968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.468133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.468281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.468306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.468420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.468558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.468583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.468673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.468787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.468829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.468968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.469057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.469082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.135 [2024-11-27 03:25:20.469179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.469274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.135 [2024-11-27 03:25:20.469302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.135 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.469405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.469563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.469593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.469676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.469757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.469783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.469898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.470021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.470047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.470177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.470273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.470318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.470458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.470580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.470605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.470760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.470892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.470916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.471033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.471122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.471161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.471277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.471465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.471490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.471659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.471749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.471774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.471885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.472027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.472052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.472150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.472253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.472278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.472382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.472475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.472517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.472648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.472739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.472781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.472889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.472979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.473004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.473116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.473192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.473217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.473333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.473417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.473441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.473536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.473646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.473671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.473784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.473904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.473928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.474037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.474135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.474178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.474268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.474387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.474412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.474496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.474591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.474616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.474735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.474869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.474894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.475009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.475097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.475121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.475237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.475315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.475339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.475428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.475540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.475584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.475697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.475835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.475860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.475951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.476135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.476159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.476272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.476362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.476389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.136 qpair failed and we were unable to recover it. 00:30:18.136 [2024-11-27 03:25:20.476563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.476699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.136 [2024-11-27 03:25:20.476723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.476846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.476961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.476985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.477069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.477234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.477262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.477365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.477484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.477509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.477639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.477722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.477747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.477864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.477951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.477976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.478094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.478236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.478261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.478398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.478549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.478575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.478739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.478862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.478886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.478970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.479079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.479103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.479216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.479335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.479359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.479445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.479556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.479585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.479719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.479840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.479864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.479974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.480109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.480134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.480245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.480364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.480389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.480482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.480563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.480589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.480728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.480840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.480865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.481006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.481143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.481168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.481286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.481376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.481401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.137 [2024-11-27 03:25:20.481539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.481641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.137 [2024-11-27 03:25:20.481667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.137 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.481756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.481878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.481919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.482058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.482165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.482190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.482345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.482506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.482537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.482639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.482746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.482775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.482863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.482973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.482998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.483086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.483177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.483201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.483333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.483503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.483534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.483647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.483763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.483787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.483895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.483983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.484010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.484147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.484251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.484275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.484364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.484507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.484538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.484625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.484762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.484786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.484870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.484984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.485008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.485129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.485246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.485271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.485435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.485555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.485581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.485678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.485765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.485789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.485882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.486001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.486027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.486146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.486264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.486289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.486421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.486568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.486597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.486724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.486819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.486844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.486954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.487100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.487125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.487207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.487320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.487347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.487476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.487567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.487592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.487686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.487763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.487787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.487937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.488048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.488072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.488189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.488303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.488327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.488422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.488500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.488529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.488630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.488732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.488759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.138 qpair failed and we were unable to recover it. 00:30:18.138 [2024-11-27 03:25:20.488866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.488981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.138 [2024-11-27 03:25:20.489006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.489092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.489203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.489227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.489343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.489439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.489463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.489578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.489667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.489691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.489810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.489942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.489969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.490085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.490230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.490254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.490376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.490464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.490488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.490638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.490718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.490742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.490856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.490983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.491010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.491142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.491227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.491251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.491367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.491491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.491518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.491664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.491778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.491802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.491913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.492028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.492052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.492231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.492345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.492369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.492498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.492668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.492694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.492813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.492953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.492978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.493081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.493218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.493242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.493350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.493499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.493522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.493621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.493706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.493730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.493820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.493894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.493918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.494010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.494122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.494161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.494293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.494400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.494425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.494595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.494729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.494754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.494869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.494986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.495011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.495103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.495222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.495247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.495373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.495561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.495587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.495703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.495841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.495888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.495974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.496090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.496114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.496203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.496315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.496340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.139 qpair failed and we were unable to recover it. 00:30:18.139 [2024-11-27 03:25:20.496425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.139 [2024-11-27 03:25:20.496565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.496607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.496717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.496811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.496835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.496933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.497048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.497075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.497246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.497330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.497355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.497446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.497540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.497564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.497681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.497839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.497866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.497984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.498098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.498125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.498250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.498335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.498359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.498483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.498658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.498683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.498774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.498902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.498929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.499067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.499181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.499205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.499288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.499391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.499417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.499546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.499672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.499698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.499842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.499963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.499987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.500122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.500221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.500245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.500362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.500472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.500497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.500638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.500763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.500787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.500877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.500995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.501019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.501150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.501305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.501331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.501475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.501564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.501588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.501706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.501832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.501859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.502019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.502141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.502169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.502282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.502426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.502451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.502574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.502659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.502686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.502812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.502904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.502930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.503062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.503172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.503197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.503290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.503370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.503394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.503510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.503600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.503625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.503725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.503802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.503826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.140 qpair failed and we were unable to recover it. 00:30:18.140 [2024-11-27 03:25:20.503943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.140 [2024-11-27 03:25:20.504022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.504046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.504163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.504244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.504268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.504393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.504475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.504500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.504607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.504693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.504719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.504836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.504921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.504945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.505036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.505126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.505149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.505261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.505385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.505412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.505541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.505648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.505672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.505793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.505904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.505928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.506021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.506152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.506180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.506296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.506392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.506419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.506536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.506620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.506644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.506757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.506876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.506901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.507009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.507127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.507152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.507245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.507329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.507353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.507469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.507634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.507660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.507754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.507856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.507883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.508032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.508114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.508138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.508221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.508333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.508360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.508486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.508648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.508677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.508766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.508879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.508903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.508991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.509073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.509115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.509238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.509322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.509349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.509477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.509600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.509624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.509713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.509806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.509848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.509953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.510070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.141 [2024-11-27 03:25:20.510097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.141 qpair failed and we were unable to recover it. 00:30:18.141 [2024-11-27 03:25:20.510250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.510370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.510396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.510504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.510601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.510625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.510746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.510858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.510881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.510996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.511088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.511116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.511224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.511378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.511405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.511540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.511660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.511687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.511818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.511933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.511957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.512072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.512210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.512238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.512341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.512473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.512515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.512645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.512733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.512757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.512894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.513028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.513056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.513151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.513274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.513302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.513444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.513552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.513577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.513707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.513807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.513834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.513962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.514088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.514128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.514273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.514350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.514374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.514488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.514609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.514637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.514786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.514881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.514909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.515018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.515104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.515129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.515236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.515344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.515368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.515484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.515606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.515651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.515759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.515873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.515898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.516012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.516138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.516166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.516294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.516432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.516457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.516558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.516645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.516670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.516824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.516981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.517006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.517138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.517304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.517328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.517448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.517554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.517580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.142 qpair failed and we were unable to recover it. 00:30:18.142 [2024-11-27 03:25:20.517665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.517764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.142 [2024-11-27 03:25:20.517792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.517925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.518145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.518393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.518613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.518842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.518982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.519062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.519171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.519199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.519323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.519444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.519473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.519623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.519713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.519738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.519852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.519928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.519952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.520041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.520173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.520200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.520356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.520462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.520487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.520607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.520696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.520720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.520827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.520950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.520977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.521145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.521283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.521324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.521445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.521598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.521626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.521748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.521905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.521933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.522022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.522109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.522136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.522267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.522404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.522429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.522560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.522684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.522711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.522815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.522909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.522937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.523044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.523207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.523232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.523351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.523460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.523485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.523621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.523780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.523805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.523951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.524102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.524126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.524268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.524439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.524465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.524581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.524693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.524722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.524853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.524983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.525024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.525121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.525234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.525259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.143 qpair failed and we were unable to recover it. 00:30:18.143 [2024-11-27 03:25:20.525380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.525545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.143 [2024-11-27 03:25:20.525571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.525690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.525803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.525827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.525951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.526115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.526142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.526267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.526366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.526393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.526534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.526652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.526677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.526758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.526848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.526873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.527014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.527165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.527193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.527341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.527492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.527518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.527658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.527750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.527777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.527930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.528042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.528066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.528210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.528329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.528356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.528539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.528633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.528657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.528767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.528896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.528922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.529030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.529102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.529127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.529239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.529365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.529391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.529550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.529664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.529688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.529820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.529950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.529975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.530092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.530227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.530252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.530418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.530520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.530553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.530680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.530793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.530821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.530946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.531066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.531093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.531237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.531378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.531402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.531540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.531669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.531695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.531806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.531935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.531962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.532057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.532148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.532191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.532272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.532389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.532414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.532553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.532654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.532681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.532846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.532956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.532981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.533092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.533224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.533267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.144 qpair failed and we were unable to recover it. 00:30:18.144 [2024-11-27 03:25:20.533354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.144 [2024-11-27 03:25:20.533471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.533496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.533599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.533741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.533765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.533907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.534058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.534085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.534213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.534304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.534330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.534437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.534548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.534573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.534733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.534828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.534854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.534983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.535086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.535110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.535221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.535322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.535349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.535480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.535595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.535620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.535760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.535911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.535938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.536029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.536162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.536186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.536302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.536389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.536413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.536522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.536674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.536698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.536834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.536936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.536963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.537093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.537214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.537240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.537394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.537515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.537557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.537674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.537790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.537813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.537909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.538043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.538070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.538169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.538294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.538320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.538408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.538534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.538581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.538660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.538778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.538802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.538914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.539027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.539052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.539190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.539315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.539342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.539469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.539599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.539634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.539723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.539868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.539893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.539984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.540095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.540120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.540235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.540351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.540376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.540502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.540617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.540643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.540755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.540863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.540888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.145 qpair failed and we were unable to recover it. 00:30:18.145 [2024-11-27 03:25:20.540982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.541094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.145 [2024-11-27 03:25:20.541119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.541205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.541364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.541391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.541490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.541588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.541616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.541761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.541878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.541902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.542041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.542164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.542191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.542290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.542414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.542442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.542536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.542654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.542682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.542850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.542943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.542967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.543106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.543203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.543232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.543376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.543475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.543501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.543643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.543782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.543806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.543903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.544018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.544044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.544184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.544322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.544346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.544465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.544582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.544607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.544733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.544867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.544910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.545000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.545108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.545132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.545223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.545306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.545331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.545447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.545585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.545613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.545740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.545893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.545920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.546050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.546166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.546190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.546302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.546411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.546436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.546530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.546608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.546633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.546750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.546864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.546891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.547014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.547132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.547157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.547300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.547378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.547403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.146 qpair failed and we were unable to recover it. 00:30:18.146 [2024-11-27 03:25:20.547515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.547595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.146 [2024-11-27 03:25:20.547619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.547763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.547886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.547914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.548047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.548135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.548160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.548270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.548354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.548381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.548484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.548601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.548629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.548758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.548860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.548887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.548982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.549103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.549128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.549267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.549379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.549403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.549513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.549637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.549664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.549758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.549842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.549868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.550008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.550117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.550141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.550261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.550411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.550436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.550581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.550694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.550722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.550866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.550980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.551004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.551118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.551209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.551235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.551369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.551460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.551488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.551588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.551721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.551750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.551890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.552058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.552082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.552201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.552321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.552345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.552474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.552571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.552599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.552775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.552892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.552916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.553052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.553181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.553205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.553323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.553434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.553458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.553648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.553764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.553788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.553944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.554066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.554093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.554183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.554312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.554339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.554447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.554557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.554583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.554728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.554806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.554830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.554924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.555078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.555106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.147 qpair failed and we were unable to recover it. 00:30:18.147 [2024-11-27 03:25:20.555236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.555343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.147 [2024-11-27 03:25:20.555368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.555460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.555607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.555632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.555719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.555867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.555894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.556024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.556148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.556175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.556301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.556463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.556489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.556627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.556708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.556734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.556872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.557033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.557058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.557208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.557345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.557373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.557504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.557648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.557673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.557790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.557905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.557929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.558034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.558160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.558188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.558309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.558434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.558462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.558606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.558736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.558761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.558900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.559015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.559040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.559144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.559304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.559332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.559454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.559581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.559609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.559735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.559890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.559918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.560083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.560198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.560223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.560366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.560487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.560533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.560626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.560713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.560737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.560861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.560971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.560995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.561113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.561196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.561219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.561346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.561439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.561465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.561624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.561707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.561731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.561818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.561934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.561959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.562137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.562284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.562308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.562451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.562615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.562640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.562744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.562897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.562955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.563078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.563203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.563230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.148 qpair failed and we were unable to recover it. 00:30:18.148 [2024-11-27 03:25:20.563393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.563510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.148 [2024-11-27 03:25:20.563540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.563632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.563736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.563776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.563903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.564015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.564042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.564139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.564252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.564280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.564395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.564478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.564502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.564627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.564733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.564763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.564917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.565051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.565076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.565192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.565316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.565342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.565428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.565547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.565574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.565686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.565833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.565863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.565992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.566147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.566175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.566295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.566399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.566424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.566535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.566648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.566673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.566789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.566923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.566950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.567046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.567140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.567166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.567285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.567412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.567438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.567568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.567654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.567679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.567767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.567940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.567964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.568051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.568137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.568161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.568253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.568339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.568367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.568529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.568653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.568678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.568793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.568908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.568931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.569014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.569128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.569171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.569258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.569421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.569446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.569535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.569649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.569672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.569787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.569896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.569924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.570009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.570142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.570167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.570280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.570419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.570462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.570602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.570690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.570715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.149 qpair failed and we were unable to recover it. 00:30:18.149 [2024-11-27 03:25:20.570856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.149 [2024-11-27 03:25:20.570944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.570968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.571059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.571143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.571167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.571307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.571433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.571461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.571569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.571681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.571707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.571817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.571956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.571999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.572119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.572264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.572291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.572384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.572554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.572599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.572721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.572845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.572870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.572978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.573145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.573168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.573257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.573376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.573400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.573485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.573612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.573637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.573784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.573924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.573964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.574116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.574238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.574282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.574396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.574537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.574566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.574700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.574791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.574817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.574961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.575046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.575071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.575187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.575277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.575303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.575447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.575558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.575584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.575714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.575883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.575908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.576021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.576136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.576160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.576264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.576361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.576388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.576490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.576635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.576661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.576752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.576841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.576866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.576976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.577088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.577112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.577242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.577370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.577399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.577495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.577616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.577641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.150 [2024-11-27 03:25:20.577727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.577804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.150 [2024-11-27 03:25:20.577829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.150 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.577907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.578047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.578072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.578218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.578314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.578339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.578460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.578558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.578583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.578694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.578837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.578865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.579009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.579100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.579125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.579242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.579377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.579404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.579511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.579653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.579678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.579765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.579854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.579879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.579995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.580103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.580128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.580236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.580339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.580366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.580521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.580668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.580693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.580784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.580879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.580904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.581053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.581128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.581153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.581273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.581444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.581469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.581591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.581706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.581738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.581858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.581984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.582011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.582118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.582257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.582282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.582429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.582515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.582545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.582636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.582733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.582757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.582845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.582961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.582986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.583078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.583164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.583190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.583273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.583381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.583406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.583582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.583688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.583716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.583841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.583978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.584003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.584080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.584184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.584213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.584349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.584518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.584548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.584658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.584769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.584794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.584884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.585033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.151 [2024-11-27 03:25:20.585058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.151 qpair failed and we were unable to recover it. 00:30:18.151 [2024-11-27 03:25:20.585138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.585281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.585306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.585418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.585511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.585547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.585718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.585832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.585874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.586024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.586118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.586147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.586267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.586353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.586378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.586494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.586627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.586653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.586769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.586873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.586915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.587031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.587142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.587167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.587309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.587389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.587413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.587510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.587638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.587665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.587806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.587935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.587963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.588050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.588175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.588203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.588343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.588428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.588453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.588564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.588711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.588738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.588888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.589009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.589036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.589130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.589282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.589323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.589436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.589552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.589577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.589725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.589809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.589834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.589946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.590120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.590145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.590288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.590400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.590425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.590540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.590665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.590690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.590827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.590915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.590940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.591028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.591135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.591162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.591285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.591418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.591443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.591517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.591675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.591700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.591809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.591933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.591975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.592093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.592236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.592260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.592342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.592522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.592552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.592646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.592766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.152 [2024-11-27 03:25:20.592791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.152 qpair failed and we were unable to recover it. 00:30:18.152 [2024-11-27 03:25:20.592972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.593084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.593109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.593245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.593365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.593393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.593481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.593631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.593656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.593739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.593864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.593889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.593963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.594102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.594127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.594258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.594379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.594407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.594570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.594688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.594716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.594833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.594951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.594976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.595092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.595221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.595249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.595421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.595543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.595568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.595663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.595772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.595796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.595949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.596025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.596050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.596171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.596304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.596331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.596452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.596582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.596608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.596723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.596832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.596860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.596992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.597099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.597123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.597225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.597374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.597402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.597504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.597611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.597639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.597777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.597894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.597923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.598031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.598115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.598139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.598255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.598408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.598436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.598564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.598685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.598729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.598847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.599011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.599038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.599203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.599317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.599342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.599479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.599593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.599624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.599750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.599908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.599936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.600101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.600175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.600200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.600289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.600405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.600430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.153 [2024-11-27 03:25:20.600563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.600698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.153 [2024-11-27 03:25:20.600723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.153 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.600876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.601166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.601408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.601638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.601861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.601993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.602078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.602196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.602221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.602303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.602412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.602437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.602600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.602695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.602722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.602856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.603007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.603035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.603155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.603276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.603304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.603423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.603518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.603547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.603672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.603763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.603788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.603873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.603977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.604005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.604110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.604197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.604221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.604308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.604428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.604453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.604541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.604674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.604702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.604796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.604914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.604942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.605079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.605195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.605221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.605305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.605409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.605434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.605555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.605662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.605690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.605843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c32980 is same with the state(5) to be set 00:30:18.154 [2024-11-27 03:25:20.606022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.606142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.606173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.606284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.606372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.606399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.606498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.606623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.606650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.606741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.606829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.606853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.606964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.607076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.607100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.607189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.607277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.607303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.607404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.607521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.607555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.607649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.607764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.607790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.154 qpair failed and we were unable to recover it. 00:30:18.154 [2024-11-27 03:25:20.607880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.154 [2024-11-27 03:25:20.607975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.608000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.608084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.608170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.608196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.608348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.608441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.608469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.608568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.608690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.608716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.608801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.608920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.608945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.609065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.609183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.609209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.609322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.609442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.609467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.609566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.609654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.609680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.609778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.609859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.609884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.610005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.610120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.610147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.610240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.610363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.610388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.610488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.610578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.610603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.610726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.610811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.610836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.610927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.611066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.611092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.611174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.611319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.611344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.611431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.611529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.611555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.611678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.611765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.611791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.611922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.612151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.612379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.612596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.612831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.612973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.613063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.613157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.613187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.613327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.613413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.613438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.613537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.613631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.613656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.155 qpair failed and we were unable to recover it. 00:30:18.155 [2024-11-27 03:25:20.613748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.613846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.155 [2024-11-27 03:25:20.613872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.613953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.614154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.614350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.614585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.614837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.614948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.615061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.615180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.615206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.615306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.615416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.615441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.615555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.615648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.615674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.615759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.615843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.615868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.616010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.616092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.616117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.616232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.616323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.616348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.616462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.616551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.616578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.616668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.616758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.616783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.616929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.617139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.617366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.617611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.617850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.617970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.618065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.618156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.618181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.618269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.618355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.618381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.618499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.618589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.618615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.618709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.618823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.618850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.618936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.619142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.619339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.619538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.619763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.619893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.619982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.620078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.620104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.156 qpair failed and we were unable to recover it. 00:30:18.156 [2024-11-27 03:25:20.620242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.156 [2024-11-27 03:25:20.620331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.620359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.620489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.620597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.620622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.620710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.620802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.620827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.620910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.621012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.621040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.621125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.621279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.621307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.621420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.621545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.621571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.621683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.621789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.621817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.621939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.622195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.622401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.622606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.622844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.622992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.623111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.623237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.623263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.623362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.623452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.623478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.623575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.623666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.623691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.623810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.623896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.623922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.624019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.624099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.624124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.624237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.624325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.624350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.624463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.624577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.624608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.624701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.624800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.624831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.624950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.625148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.625383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.625614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.625814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.625979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.626075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.626237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.626262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.626401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.626493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.626518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.626654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.626807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.626835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.627001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.627114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.627164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.157 qpair failed and we were unable to recover it. 00:30:18.157 [2024-11-27 03:25:20.627248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.157 [2024-11-27 03:25:20.627335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.627360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.627478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.627568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.627594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.627679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.627821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.627846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.627932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.628048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.628073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.628170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.628271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.628298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.628394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.628517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.628550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.628667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.628784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.628809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.628922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.629030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.629058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.629152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.629249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.629291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.629436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.629518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.629549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.629710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.629829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.629854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.629964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.630056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.630081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.630166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.630253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.630278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.630363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.630479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.630507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.630615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.630754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.630779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.630895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.630991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.631017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.631186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.631274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.631302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.631394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.631513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.631549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.631659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.631775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.631800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.631894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.631979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.632003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.632145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.632246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.632273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.632372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.632454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.632479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.632602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.632711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.632739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.632838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.632960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.632985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.633130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.633216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.633240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.633335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.633457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.633483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.633585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.633704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.633728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.633844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.633989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.634014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.634205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.634289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.634314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.158 qpair failed and we were unable to recover it. 00:30:18.158 [2024-11-27 03:25:20.634397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.158 [2024-11-27 03:25:20.634538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.634566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.634680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.634798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.634823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.634941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.635045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.635073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.635195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.635297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.635340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.635455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.635546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.635572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.635691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.635774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.635798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.635913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.635995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.636019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.636109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.636195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.636220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.636317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.636431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.636456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.636587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.636685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.636712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.636851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.636947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.636972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.637086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.637176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.637218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.637314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.637434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.637461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.637596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.637690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.637714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.637854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.637941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.637981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.638109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.638232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.638272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.638366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.638443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.638468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.638592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.638679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.638717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.638821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.638981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.639005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.639123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.639206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.639230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.639334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.639486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.639510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.639645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.639761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.639800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.639921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.640128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.640365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.640588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.640804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.640972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.641069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.641180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.641205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.641296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.641391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.159 [2024-11-27 03:25:20.641416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.159 qpair failed and we were unable to recover it. 00:30:18.159 [2024-11-27 03:25:20.641510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.641640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.641666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.641782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.641897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.641924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.642016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.642153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.642187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.642303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.642391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.642418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.642510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.642640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.642666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.642773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.642884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.642909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.642998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.643090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.643116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.643232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.643323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.643348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.643441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.643555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.643581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.643699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.643845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.643872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.643954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.644070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.644096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.644214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.644327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.644353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.644467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.644588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.644621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.644745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.644861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.644886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.644969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.645189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.645427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.645639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.645843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.645950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.646032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.646120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.646145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.646228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.646320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.646346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.646465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.646609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.646635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.646717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.646813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.646838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.646957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.647076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.647102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.647214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.647305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.647331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.160 qpair failed and we were unable to recover it. 00:30:18.160 [2024-11-27 03:25:20.647442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.160 [2024-11-27 03:25:20.647566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.647592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.647684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.647764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.647789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.647900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.647985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.648010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.648102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.648188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.648213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.648335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.648451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.648476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.648596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.648707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.648731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.648817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.648902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.648928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.649009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.649101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.649126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.649226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.649344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.649369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.649483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.649622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.649648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.649739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.649858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.649883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.649967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.650049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.650074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.650191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.650278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.650305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.650424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.650512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.650545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.650642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.650756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.650781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.650864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.650975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.651000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.651114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.651231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.651256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.651353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.651437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.651462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.651556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.651674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.651699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.651830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.651928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.651956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.652047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.652143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.652172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.652299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.652398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.652441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.652560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.652653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.652680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.652797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.652922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.652948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.653068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.653153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.653178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.653267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.653353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.653378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.653494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.653592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.653617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.653734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.653849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.653875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.653973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.654083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.654108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.161 qpair failed and we were unable to recover it. 00:30:18.161 [2024-11-27 03:25:20.654200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.161 [2024-11-27 03:25:20.654321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.654347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.654436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.654560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.654587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.654681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.654764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.654789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.654903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.654991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.655016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.655128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.655242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.655268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.655389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.655508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.655542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.655631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.655722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.655748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.655839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.655930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.655955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.656096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.656190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.656215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.656318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.656409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.656434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.656519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.656640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.656666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.656748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.656838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.656863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.656964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.657078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.657104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.657186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.657298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.657324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.657440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.657556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.657583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.657679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.657771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.657796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.657886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.657977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.658002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.658093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.658177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.658203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.658321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.658405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.658430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.658532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.658650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.658675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.658762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.658849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.658874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.658955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.659144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.659359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.659629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.659850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.659964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.660065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.660188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.660214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.660301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.660384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.660410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.162 [2024-11-27 03:25:20.660491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.660594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.162 [2024-11-27 03:25:20.660619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:18.162 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.660727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.660871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.660902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.661050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.661156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.661198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.661301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.661386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.661413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.661498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.661624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.661651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.661740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.661823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.661849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.661965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.662185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.662420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.662642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.662877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.662993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.663099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.663198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.663227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.663347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.663457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.663484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.663579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.663659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.663701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.663793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.663884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.663912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.664013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.664101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.664127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.664213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.664308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.664335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.664440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.664566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.664592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.664678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.664817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.664846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.664989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.665124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.665151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.665254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.665384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.665411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.665518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.665608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.665634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.665747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.665901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.665927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.666026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.666163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.666189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.666271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.666358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.666400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.666488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.666602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.666627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.666716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.666808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.666835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.666964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.667082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.667108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.667199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.667315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.667341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.163 qpair failed and we were unable to recover it. 00:30:18.163 [2024-11-27 03:25:20.667442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.667560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.163 [2024-11-27 03:25:20.667586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.667667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.667755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.667781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.667935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.668063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.668088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.668220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.668308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.668335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.668463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.668549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.668592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.668680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.668766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.668792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.668918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.669131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.669344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.669573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.669770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.669882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.670048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.670180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.670206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.670385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.670505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.670539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.670641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.670722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.670747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.670838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.670956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.670982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.671079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.671200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.671227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.671314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.671440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.671480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.671592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.671684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.671710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.671834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.671919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.671945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.672059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.672176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.672202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.672316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.672406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.672450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.672563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.672649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.672674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.672794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.672918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.672943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.673061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.673200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.673225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.673369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.673485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.673511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.164 [2024-11-27 03:25:20.673607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.673698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.164 [2024-11-27 03:25:20.673723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.164 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.673843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.673961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.673987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.674102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.674184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.674209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.674292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.674408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.674435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.674549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.674658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.674683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.674767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.674856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.674881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.674963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.675192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.675393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.675601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.675859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.675974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.676063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.676189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.676213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.676304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.676417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.676444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.676543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.676660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.676685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.676828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.676909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.676934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.677020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.677110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.677136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.677227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.677315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.677341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.677424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.677509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.677545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.677659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.677777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.677802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.677919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.678004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.678029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.678120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.678270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.678295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.678385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.678531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.678557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.678651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.678762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.678786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.678886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.678975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.679002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.679129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.679226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.679252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.679338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.679426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.679451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.679563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.679682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.679707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.679803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.679891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.679920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.680012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.680100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.680125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.165 qpair failed and we were unable to recover it. 00:30:18.165 [2024-11-27 03:25:20.680206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.165 [2024-11-27 03:25:20.680349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.680374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.680488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.680580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.680607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.680722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.680838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.680862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.680947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.681179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.681404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.681605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.681829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.681937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.682052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.682142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.682167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.682256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.682340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.682365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.682478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.682599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.682625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.682743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.682853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.682878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.682964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.683166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.683400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.683631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.683848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.683981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.684069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.684210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.684235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.684326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.684416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.684441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.684553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.684669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.684695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.684780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.684870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.684895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.685015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.685116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.685141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.685229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.685342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.685368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.685450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.685545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.685571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.685694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.685777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.685802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.685888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.686001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.686026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.686114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.686229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.686255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.686373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.686469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.686494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.686584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.686672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.686698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.166 qpair failed and we were unable to recover it. 00:30:18.166 [2024-11-27 03:25:20.686821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.166 [2024-11-27 03:25:20.686929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.686954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.687041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.687135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.687161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.687253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.687370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.687396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.687490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.687587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.687613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.687700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.687810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.687835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.687924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.688144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.688349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.688590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.688823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.688965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.689062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.689180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.689206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.689349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.689430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.689455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.689545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.689662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.689687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.689803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.689901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.689925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.690008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.690203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.690458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.690684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.690885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.690999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.691116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.691200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.691225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.691314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.691432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.691457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.691546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.691660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.691684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.691805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.691917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.691942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.692031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.692143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.692168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.692260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.692375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.692400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.692489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.692616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.692642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.692759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.692846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.692871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.692961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.693078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.693104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.167 [2024-11-27 03:25:20.693220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.693309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.167 [2024-11-27 03:25:20.693334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.167 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.693448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.693542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.693568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.693659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.693771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.693796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.693917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.694137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.694396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.694635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.694881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.694992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.695083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.695191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.695216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.695306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.695425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.695450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.695556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.695646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.695671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.695784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.695867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.695892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.695982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.696075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.696100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.696211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.696328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.696353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.696442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.696533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.696559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.696640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.696729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.696756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.696904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.697137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.697335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.697584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.697788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.697953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.698042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.698127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.698152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.698310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.698409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.698437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.698540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.698631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.698656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.698802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.698922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.698947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.699064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.699149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.699174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.699266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.699354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.699378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.699496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.699587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.699612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.699699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.699813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.699838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.168 qpair failed and we were unable to recover it. 00:30:18.168 [2024-11-27 03:25:20.699933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.700043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.168 [2024-11-27 03:25:20.700068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.700176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.700270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.700299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.700414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.700505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.700554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.700655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.700745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.700771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.700917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.701148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.701380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.701654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.701883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.701996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.702084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.702170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.702195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.702291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.702385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.702412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.702502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.702598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.702624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.702714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.702855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.702880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.702994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.703086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.703112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.703227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.703314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.703341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.703429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.703506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.703538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.703651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.703736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.703761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.703841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.703982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.704007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.704123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.704209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.704234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.704350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.704434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.704459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.704561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.704657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.704683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.704803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.704893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.704918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.705004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.705119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.705146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.705266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.705388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.705414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.705536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.705629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.705655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.705795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.705920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.169 [2024-11-27 03:25:20.705945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.169 qpair failed and we were unable to recover it. 00:30:18.169 [2024-11-27 03:25:20.706030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.706112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.706137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.706227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.706314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.706340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.706458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.706553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.706578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.706663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.706774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.706799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.706882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.706993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.707019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.707134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.707245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.707270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.707396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.707508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.707538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.707623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.707736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.707765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.707858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.707978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.708002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.708092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.708205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.708231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.708345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.708432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.708458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.708553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.708671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.708697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.708783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.708901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.708928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.709043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.709162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.709187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.709310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.709430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.709455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.709542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.709631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.709656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.709741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.709860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.709885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.709974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.710064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.710095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.710244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.710332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.710357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.710440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.710531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.710557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.710640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.710754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.710780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.710870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.710986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.711013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.711104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.711216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.711241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.711332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.711429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.711454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.711573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.711694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.711719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.711809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.711901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.711926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.712036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.712152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.712177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.712262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.712375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.712404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.170 [2024-11-27 03:25:20.712493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.712586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.170 [2024-11-27 03:25:20.712613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.170 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.712696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.712812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.712838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.712925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.713156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.713409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.713652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.713844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.713954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.714073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.714165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.714190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.714280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.714363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.714388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.714469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.714559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.714589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.714708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.714822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.714847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.714961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.715054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.715080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.715199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.715309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.715334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.715446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.715538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.715565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.715656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.715745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.715770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.715862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.716143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.716420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.716686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.716882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.716983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.717078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.717187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.717212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.717288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.717379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.717405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.717488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.717602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.717628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.717724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.717804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.717829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.717948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.718128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.718348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.718609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.718871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.718974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.171 qpair failed and we were unable to recover it. 00:30:18.171 [2024-11-27 03:25:20.719091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.171 [2024-11-27 03:25:20.719177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.719203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.719351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.719439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.719464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.719553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.719642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.719667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.719779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.719869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.719895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.719981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.720067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.720092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.720243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.720357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.720382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.720494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.720609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.720634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.720746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.720833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.720858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.720950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.721040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.721065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.721149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.721265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.721291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.721397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.721480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.721506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.721655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.721796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.721821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.721909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.722186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.722406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.722636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.722831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.722945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.723036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.723124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.723150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.723301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.723409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.723434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.723531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.723615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.723640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.723725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.723817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.723842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.723940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.724056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.724082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.724177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.724290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.724315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.724414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.724565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.724591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.724704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.724802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.724827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.724939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.725052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.725076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.725186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.725275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.725301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.725381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.725497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.725522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.725674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.725759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.725785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.172 qpair failed and we were unable to recover it. 00:30:18.172 [2024-11-27 03:25:20.725883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.172 [2024-11-27 03:25:20.725973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.725999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.726119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.726205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.726230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.726349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.726462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.726487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.726569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.726657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.726683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.726800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.726893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.726918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.727033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.727153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.727178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.727265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.727375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.727401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.727498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.727601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.727626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.727715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.727802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.727829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.727972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.728054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.728080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.173 qpair failed and we were unable to recover it. 00:30:18.173 [2024-11-27 03:25:20.728203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.173 [2024-11-27 03:25:20.728317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.728344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.459 qpair failed and we were unable to recover it. 00:30:18.459 [2024-11-27 03:25:20.728441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.728553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.728581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.459 qpair failed and we were unable to recover it. 00:30:18.459 [2024-11-27 03:25:20.728701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.728820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.728847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.459 qpair failed and we were unable to recover it. 00:30:18.459 [2024-11-27 03:25:20.728932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.729021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.729046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.459 qpair failed and we were unable to recover it. 00:30:18.459 [2024-11-27 03:25:20.729158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.729273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.729299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.459 qpair failed and we were unable to recover it. 00:30:18.459 [2024-11-27 03:25:20.729438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.729557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.729583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.459 qpair failed and we were unable to recover it. 00:30:18.459 [2024-11-27 03:25:20.729729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.729841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.729867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.459 qpair failed and we were unable to recover it. 00:30:18.459 [2024-11-27 03:25:20.729953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.730034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.459 [2024-11-27 03:25:20.730060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.459 qpair failed and we were unable to recover it. 00:30:18.459 [2024-11-27 03:25:20.730145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.730228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.730253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.730371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.730458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.730484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.730631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.730761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.730789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.730961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.731054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.731079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.731179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.731300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.731326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.731471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.731571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.731599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.731697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.731783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.731808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.731921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.732153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.732375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.732588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.732816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.732954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.733039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.733152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.733177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.733292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.733402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.733427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.733513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.733640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.733665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.733764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.733853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.733878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.733972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.734065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.734090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.734238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.734327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.734351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.734471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.734566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.734591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.734712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.734833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.734858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.734975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.735099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.735124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.735245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.735337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.735362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.735450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.735560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.735586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.735678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.735758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.735782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.735901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.736011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.736040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.736153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.736268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.736293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.736380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.736468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.736493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.736594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.736684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.736709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.460 qpair failed and we were unable to recover it. 00:30:18.460 [2024-11-27 03:25:20.736795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.460 [2024-11-27 03:25:20.736931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.736955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.737071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.737159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.737184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.737307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.737426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.737451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.737568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.737660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.737685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.737775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.737890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.737914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.738004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.738212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.738458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.738662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.738881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.738993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.739082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.739201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.739226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.739320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.739415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.739439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.739534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.739647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.739672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.739768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.739911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.739936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.740051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.740136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.740161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.740274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.740388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.740414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.740498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.740599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.740624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.740750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.740837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.740861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.740976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.741094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.741118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.741201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.741289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.741313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.741404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.741484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.741508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.741604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.741724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.741749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.741872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.742012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.742036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.742146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.742289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.742314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.742445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.742541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.742568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.742660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.742773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.742797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.742908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.742993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.743018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.743112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.743196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.743222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.743370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.743463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.743488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.461 qpair failed and we were unable to recover it. 00:30:18.461 [2024-11-27 03:25:20.743580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.461 [2024-11-27 03:25:20.743667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.743693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.743779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.743891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.743916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.744006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.744116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.744141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.744231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.744324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.744348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.744438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.744553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.744579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.744671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.744753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.744778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.744862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.744979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.745004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.745096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.745188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.745213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.745327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.745450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.745475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.745571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.745660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.745692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.745788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.745907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.745931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.746010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.746120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.746144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.746255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.746408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.746432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.746531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.746645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.746669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.746790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.746878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.746903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.746990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.747097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.747122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.747214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.747327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.747352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.747446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.747573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.747598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.747680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.747770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.747795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.747890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.747999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.748023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.748137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.748252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.748277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.748370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.748455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.748480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.748608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.748750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.748774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.748888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.749140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.749357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.749588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.749782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.749895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.749984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.750098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.462 [2024-11-27 03:25:20.750128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.462 qpair failed and we were unable to recover it. 00:30:18.462 [2024-11-27 03:25:20.750216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.750330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.750355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.750505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.750601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.750628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.750720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.750805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.750830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.750947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.751088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.751113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.751229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.751370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.751395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.751484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.751610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.751635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.751750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.751871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.751896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.751981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.752097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.752121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.752210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.752318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.752342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.752429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.752545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.752571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.752716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.752800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.752825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.752912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.752998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.753022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.753116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.753226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.753251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.753339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.753427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.753451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.753536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.753650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.753675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.753768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.753874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.753899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.754019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.754141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.754165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.754258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.754375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.754399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.754496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.754587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.754612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.754707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.754823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.754848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.754946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.755163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.755392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.755625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.755844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.755982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.756098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.756208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.756233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.756315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.756431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.756455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.756546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.756655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.756680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.463 [2024-11-27 03:25:20.756759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.756883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.463 [2024-11-27 03:25:20.756908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.463 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.757016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.757127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.757151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.757281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.757367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.757393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.757508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.757594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.757620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.757711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.757823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.757848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.757937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.758164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.758411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.758637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.758837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.758940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.759030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.759122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.759147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.759234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.759324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.759349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.759435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.759532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.759557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.759653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.759769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.759794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.759931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.760216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.760420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.760664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.760871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.760976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.761094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.761175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.761201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.761291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.761403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.761428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.761550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.761662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.761687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.761771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.761868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.761896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.762011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.762099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.762124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.464 [2024-11-27 03:25:20.762251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.762340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.464 [2024-11-27 03:25:20.762365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.464 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.762518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.762615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.762641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.762738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.762861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.762886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.762970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.763211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.763408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.763619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.763843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.763982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.764070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.764214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.764239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.764352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.764440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.764465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.764555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.764670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.764695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.764784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.764862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.764887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.764988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.765109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.765133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.765243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.765328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.765353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.765466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.765555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.765581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.765697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.765784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.765811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.765904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.766133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.766327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.766555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.766775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.766893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.767039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.767120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.767146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.767261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.767372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.767396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.767483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.767604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.767629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.767753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.767840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.767866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.767978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.768088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.768113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.768200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.768287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.768311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.768418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.768561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.768587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.768672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.768761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.768785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.465 [2024-11-27 03:25:20.768878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.768985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.465 [2024-11-27 03:25:20.769009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.465 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.769104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.769222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.769246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.769357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.769495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.769519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.769621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.769704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.769729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.769857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.769945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.769972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.770058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.770142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.770165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.770276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.770354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.770379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.770495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.770644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.770670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.770761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.770856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.770881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.770974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.771198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.771396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.771633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.771851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.771993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.772076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.772220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.772245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.772322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.772428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.772453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.772572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.772657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.772681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.772794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.772933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.772957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.773046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.773159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.773183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.773296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.773411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.773435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.773588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.773702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.773731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.773816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.773955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.773980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.774068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.774198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.774223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.774309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.774406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.774431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.774580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.774666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.774690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.774806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.774918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.774942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.775022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.775135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.775159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.775256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.775397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.775421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.775538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.775658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.775684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.466 qpair failed and we were unable to recover it. 00:30:18.466 [2024-11-27 03:25:20.775827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.466 [2024-11-27 03:25:20.775936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.775960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.776081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.776167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.776192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.776307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.776426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.776451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.776548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.776643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.776668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.776760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.776871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.776896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.777015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.777128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.777152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.777248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.777386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.777410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.777498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.777645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.777670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.777781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.777868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.777893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.777985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.778206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.778461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.778659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.778877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.778990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.779080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.779157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.779182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.779267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.779348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.779374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.779492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.779609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.779634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.779722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.779808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.779832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.779972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.780177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.780406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.780655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.780857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.780988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.781081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.781170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.781195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.781283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.781399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.781424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.781539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.781651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.781675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.781761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.781844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.781869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.781953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.782046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.782070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.782162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.782241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.782266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.467 qpair failed and we were unable to recover it. 00:30:18.467 [2024-11-27 03:25:20.782385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.467 [2024-11-27 03:25:20.782504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.782534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.782623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.782741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.782766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.782857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.782947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.782971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.783091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.783212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.783238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.783323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.783401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.783425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.783511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.783605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.783630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.783719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.783833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.783858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.783970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.784063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.784087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.784195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.784314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.784339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.784464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.784547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.784573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.784687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.784795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.784819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.784932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.785191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.785396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.785646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.785850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.785952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.786044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.786162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.786187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.786300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.786387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.786412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.786531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.786631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.786660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.786750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.786860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.786885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.787000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.787083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.787107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.787202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.787288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.787312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.787424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.787505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.787537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.787629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.787716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.787745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.787895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.788011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.788036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.468 qpair failed and we were unable to recover it. 00:30:18.468 [2024-11-27 03:25:20.788153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.468 [2024-11-27 03:25:20.788240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.788265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.788352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.788459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.788484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.788593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.788680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.788705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.788820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.788961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.788987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.789103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.789218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.789243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.789336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.789421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.789446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.789553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.789673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.789698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.789782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.789897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.789922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.790003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.790116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.790141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.790238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.790324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.790348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.790436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.790550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.790576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.790668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.790747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.790772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.790858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.790975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.791001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.791091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.791198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.791226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.791342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.791479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.791504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.791591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.791680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.791705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.791788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.791877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.791903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.791984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.792077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.792110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.792269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.792388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.792414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.792534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.792657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.792682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.792766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.792849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.792874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.792991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.793079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.793105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.793200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.793319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.793346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.793465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.793549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.793576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.793667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.793761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.793786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.793901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.793995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.794023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.794163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.794311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.794337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.794476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.794594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.794622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.794731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.794824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.794849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.469 qpair failed and we were unable to recover it. 00:30:18.469 [2024-11-27 03:25:20.794972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.469 [2024-11-27 03:25:20.795065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.795090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.795234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.795325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.795350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.795434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.795514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.795571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.795692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.795786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.795812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.795906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.796006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.796035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.796194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.796282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.796307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.796425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.796515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.796548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.796636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.796750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.796775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.796864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.797008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.797033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.797125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.797215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.797241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.797325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.797521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.797554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.797674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.797783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.797812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.797976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.798073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.798100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.798200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.798286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.798311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.798422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.798515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.798550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.798637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.798782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.798807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.798953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.799066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.799091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.799179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.799317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.799360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.799472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.799591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.799616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.799727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.799822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.799847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.799936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.800026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.800055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.800148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.800285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.800310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.800471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.800612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.800638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.800734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.800878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.800903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.800995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.801091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.801116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.801229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.801313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.801337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.801429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.801555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.801581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.801676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.801763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.801789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.801868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.802030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.470 [2024-11-27 03:25:20.802058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.470 qpair failed and we were unable to recover it. 00:30:18.470 [2024-11-27 03:25:20.802184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.802344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.802370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.802485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.802607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.802633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.802750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.802844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.802870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.802986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.803098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.803124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.803216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.803333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.803357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.803476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.803554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.803579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.803689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.803803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.803829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.803946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.804030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.804055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.804147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.804235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.804261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.804444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.804563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.804588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.804679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.804773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.804798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.804911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.805145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.805373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.805635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.805855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.805962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.806105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.806184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.806210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.806306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.806472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.806500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.806629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.806729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.806754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.806844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.806957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.806982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.807094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.807204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.807229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.807338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.807455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.807480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.807586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.807715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.807740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.807827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.807912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.807937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.808028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.808251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.808479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.808704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.471 [2024-11-27 03:25:20.808889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.471 [2024-11-27 03:25:20.808999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.471 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.809105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.809223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.809248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.809329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.809445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.809469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.809556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.809633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.809658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.809741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.809826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.809851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.809958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.810074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.810100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.810204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.810296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.810321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.810407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.810498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.810523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.810622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.810744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.810783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.810923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.811038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.811062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.811154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.811268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.811310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.811431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.811556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.811584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.811721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.811810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.811834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.811956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.812128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.812156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.812246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.812410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.812457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.812569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.812682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.812707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.812792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.812881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.812905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.812997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.813084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.813109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.813229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.813314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.813339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.813430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.813569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.813594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.813682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.813798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.813823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.813919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.814009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.814033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.814164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.814249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.814293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.814423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.814562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.814587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.814672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.814771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.814796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.814911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.815115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.815310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.815496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.472 qpair failed and we were unable to recover it. 00:30:18.472 [2024-11-27 03:25:20.815735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.472 [2024-11-27 03:25:20.815904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.815998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.816080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.816104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.816250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.816379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.816405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.816520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.816684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.816710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.816829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.816907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.816932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.817044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.817162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.817188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.817313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.817402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.817428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.817515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.817650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.817676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.817796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.817910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.817936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.818058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.818193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.818242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.818327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.818453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.818478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.818599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.818677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.818702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.818822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.818935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.818960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.819100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.819217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.819242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.819353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.819440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.819466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.819575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.819686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.819712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.819813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.819903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.819928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.820026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.820108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.820134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.820226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.820369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.820397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.820507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.820601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.820626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.820722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.820836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.820860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.820970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.821078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.821102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.821199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.821340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.821364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.821451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.821563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.821589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.821675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.821769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.821794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.821885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.822001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.473 [2024-11-27 03:25:20.822025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.473 qpair failed and we were unable to recover it. 00:30:18.473 [2024-11-27 03:25:20.822171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.823029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.823064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.823205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.823335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.823375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.823470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.823571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.823597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.823694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.823781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.823807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.823900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.823989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.824014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.824110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.824192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.824216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.824311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.824426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.824452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.824592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.824708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.824734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.824851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.824965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.824990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.825087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.825198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.825224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.825338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.825422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.825452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.825599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.825690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.825715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.825806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.825914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.825940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.826060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.826199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.826224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.826342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.826460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.826484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.826592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.826670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.826695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.826806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.826885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.826909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.826997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.827109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.827135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.827276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.827380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.827407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.827539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.827647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.827672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.827819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.827930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.827960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.828100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.828197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.828241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.828361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.828451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.828492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.828635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.828777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.828802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.828953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.829047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.829072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.829157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.829263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.829288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.829412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.829557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.829582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.829708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.829846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.829870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.829966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.830076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.474 [2024-11-27 03:25:20.830101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.474 qpair failed and we were unable to recover it. 00:30:18.474 [2024-11-27 03:25:20.830178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.830287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.830312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.830401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.830511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.830558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.830688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.830833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.830859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.830971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.831058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.831082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.831198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.831311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.831336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.831420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.831559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.831586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.831716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.831838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.831864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.831983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.832098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.832124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.832218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.832326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.832351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.832484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.832602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.832628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.832759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.832855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.832897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.833040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.833140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.833166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.833331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.833445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.833469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.833666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.833783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.833809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.833976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.834112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.834137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.834282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.834397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.834422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.834532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.834668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.834710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.834832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.834915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.834940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.835031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.835114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.835139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.835250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.835336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.835378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.835496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.835642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.835666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.835753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.835869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.835893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.836004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.836141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.836166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.836296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.836435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.836459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.836575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.836674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.836699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.836813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.836932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.836956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.837039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.837145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.837169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.837313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.837420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.837444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.837539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.837630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.475 [2024-11-27 03:25:20.837654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.475 qpair failed and we were unable to recover it. 00:30:18.475 [2024-11-27 03:25:20.837737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.837828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.837853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.837984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.838069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.838093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.838184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.838299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.838341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.838438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.838623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.838650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.838761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.838917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.838941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.839021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.839108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.839149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.839264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.839362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.839386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.839503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.839626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.839651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.839759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.839878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.839918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.840007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.840096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.840137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.840276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.840391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.840415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.840505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.840635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.840662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.840754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.840869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.840895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.840995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.841078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.841106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.841199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.841298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.841324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.841458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.841589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.841614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.841741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.841821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.841845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.841961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.842153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.842343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.842566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.842773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.842883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.842975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.843214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.843476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.843680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.843882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.843998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.844090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.844179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.844202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.476 [2024-11-27 03:25:20.844322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.844431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.476 [2024-11-27 03:25:20.844455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.476 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.844549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.844647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.844673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.844792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.844881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.844905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.844999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.845115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.845140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.845229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.845405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.845429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.845522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.845637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.845665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.845826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.845917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.845943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.846036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.846157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.846199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.846326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.846475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.846502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.846681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.846777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.846801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.846896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.847011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.847035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.847153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.847236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.847260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.847383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.847498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.847522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.847645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.847777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.847802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.847893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.847991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.848032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.848146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.848267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.848291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.848460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.848625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.848652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.848788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.848879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.848904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.849022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.849140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.849165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.849272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.849397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.849426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.849558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.849685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.849727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.849807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.849892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.849916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.850003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.850220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.850412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.850620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.850848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.850952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.851073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.851151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.851176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.851256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.851342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.477 [2024-11-27 03:25:20.851366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.477 qpair failed and we were unable to recover it. 00:30:18.477 [2024-11-27 03:25:20.851461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.851569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.851594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.851697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.851791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.851815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.851899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.852042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.852067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.852183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.852260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.852285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.852369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.852487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.852512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.852618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.852757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.852780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.852894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.852984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.853008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.853122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.853230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.853258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.853353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.853493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.853517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.853619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.853748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.853773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.853886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.853976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.854000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.854113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.854241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.854266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.854364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.854467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.854491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.854589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.854677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.854701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.854796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.854911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.854936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.855051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.855129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.855153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.855294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.855370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.855395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.855488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.855583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.855609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.855741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.855827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.855851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.855948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.856139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.856391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.856615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.856842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.856952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.857048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.857167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.857191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.478 [2024-11-27 03:25:20.857275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.857416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.478 [2024-11-27 03:25:20.857441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.478 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.857537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.857683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.857709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.857795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.857884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.857909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.858010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.858118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.858142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.858233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.858324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.858349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.858438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.858587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.858613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.858707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.858796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.858820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.858901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.858991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.859017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.859140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.859250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.859278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.859443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.859592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.859617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.859700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.859814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.859838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.859928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.860180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.860436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.860663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.860884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.860983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.861059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.861180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.861208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.861303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.861467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.861491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.861650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.861768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.861802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.861969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.862105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.862129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.862241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.862333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.862358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.862504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.862631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.862656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.862765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.862849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.862873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.862958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.863173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.863394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.863602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.863792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.863907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.863998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.864076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.864101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.479 [2024-11-27 03:25:20.864221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.864300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.479 [2024-11-27 03:25:20.864325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.479 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.864410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.864515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.864546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.864678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.864788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.864812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.864940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.865053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.865078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.865170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.865266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.865295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.865423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.865561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.865588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.865679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.865788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.865813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.865958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.866046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.866072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.866173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.866315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.866341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.866472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.866565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.866592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.866702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.866790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.866816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.866970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.867093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.867135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.867257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.867421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.867446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.867586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.867665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.867690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.867774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.867862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.867904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.868038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.868162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.868190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.868300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.868394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.868419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.868535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.868648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.868683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.868799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.868920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.868944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.869057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.869169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.869194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.869290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.869387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.869413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.869543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.869641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.869666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.869751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.869898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.869923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.870043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.870157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.870183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.870265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.870356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.870381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.870478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.870569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.870595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.870715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.870855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.870880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.870972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.871063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.871088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.871267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.871408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.871448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.480 qpair failed and we were unable to recover it. 00:30:18.480 [2024-11-27 03:25:20.871609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.871707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.480 [2024-11-27 03:25:20.871732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.871842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.871953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.871978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.872068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.872159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.872185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.872334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.872466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.872491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.872611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.872711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.872737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.872853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.872948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.872973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.873062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.873223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.873249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.873364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.873501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.873536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.873672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.873760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.873784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.873871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.873981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.874008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.874092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.874173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.874199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.874308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.874397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.874422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.874544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.874656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.874699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.874843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.874933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.874958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.875073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.875188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.875213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.875321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.875432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.875457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.875589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.875722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.875766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.875905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.875993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.876017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.876133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.876304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.876329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.876472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.876587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.876614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.876751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.876858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.876882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.877002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.877086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.877110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.877227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.877303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.877327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.877412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.877500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.877530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.877663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.877752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.877778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.877873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.878009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.878036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.878172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.878280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.878308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.878400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.878503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.878548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.878672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.878767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.878794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.481 qpair failed and we were unable to recover it. 00:30:18.481 [2024-11-27 03:25:20.878902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.481 [2024-11-27 03:25:20.878987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.879011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.879125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.879271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.879299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.879399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.879504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.879576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.879688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.879775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.879800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.879897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.879988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.880013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.880127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.880211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.880235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.880324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.880433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.880459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.880559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.880684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.880717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.880843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.880964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.880992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.881097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.881209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.881234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.881352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.881450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.881478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.881621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.881736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.881761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.881854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.881941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.881966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.882051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.882163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.882188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.882282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.882380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.882407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.882528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.882609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.882634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.882714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.882846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.882873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.882976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.883095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.883122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.883257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.883342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.883366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.883477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.883624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.883649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.883740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.883862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.883886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.883996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.884073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.884098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.884215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.884355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.884382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.884481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.884610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.884638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.884790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.884899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.884924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.482 [2024-11-27 03:25:20.885033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.885128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.482 [2024-11-27 03:25:20.885156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.482 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.885246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.885341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.885369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.885474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.885592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.885617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.885785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.885931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.885955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.886044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.886136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.886175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.886282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.886393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.886417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.886501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.886660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.886687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.886806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.886926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.886954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.887053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.887197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.887221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.887325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.887462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.887486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.887608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.887701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.887725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.887861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.887975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.887999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.888131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.888258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.888285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.888394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.888517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.888552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.888666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.888749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.888773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.888856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.888944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.888969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.889063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.889173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.889200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.889304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.889432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.889457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.889565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.889655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.889680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.889770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.889886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.889910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.889998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.890080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.890105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.890228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.890320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.890345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.890438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.890557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.890599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.890676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.890795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.890819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.890987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.891080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.891107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.891229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.891324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.891351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.891460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.891543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.891568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.891660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.891746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.891770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.891900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.892038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.892065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.483 [2024-11-27 03:25:20.892175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.892248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.483 [2024-11-27 03:25:20.892272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.483 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.892381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.892467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.892491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.892614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.892700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.892725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.892844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.892966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.892991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.893124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.893256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.893285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.893377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.893493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.893521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.893674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.893765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.893790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.893935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.894026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.894053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.894182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.894277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.894305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.894454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.894562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.894587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.894681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.894833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.894858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.894978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.895066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.895091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.895202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.895290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.895314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.895407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.895504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.895536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.895634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.895737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.895761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.895920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.896009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.896033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.896119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.896226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.896253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.896375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.896499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.896532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.896686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.896777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.896801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.896957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.897081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.897121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.897212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.897325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.897348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.897463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.897559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.897584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.897720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.897816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.897842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.897940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.898037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.898064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.898211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.898306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.898330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.898475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.898579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.898621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.898715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.898800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.898824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.898959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.899047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.899071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.899155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.899280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.899322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.484 qpair failed and we were unable to recover it. 00:30:18.484 [2024-11-27 03:25:20.899449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.899581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.484 [2024-11-27 03:25:20.899606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.899694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.899810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.899836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.899950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.900073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.900100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.900188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.900284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.900311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.900452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.900564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.900590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.900730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.900819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.900863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.900982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.901091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.901116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.901210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.901296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.901319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.901407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.901529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.901554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.901688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.901781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.901806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.901955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.902039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.902063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.902181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.902280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.902303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.902436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.902573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.902601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.902706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.902817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.902842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.902931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.903191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.903380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.903614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.903830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.903943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.904054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.904143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.904168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.904278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.904391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.904433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.904516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.904642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.904683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.904815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.904905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.904930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.905050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.905156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.905182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.905271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.905382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.905409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.905533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.905619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.905645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.905760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.905878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.905919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.906050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.906145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.906172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.906318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.906405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.906429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.485 qpair failed and we were unable to recover it. 00:30:18.485 [2024-11-27 03:25:20.906511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.906647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.485 [2024-11-27 03:25:20.906673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.906767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.906848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.906873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.906971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.907058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.907082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.907223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.907357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.907383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.907499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.907602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.907628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.907735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.907854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.907879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.907974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.908095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.908121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.908218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.908346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.908371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.908459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.908556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.908582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.908671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.908804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.908829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.908929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.909212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.909415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.909614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.909840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.909952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.910057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.910175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.910218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.910312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.910396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.910422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.910558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.910641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.910672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.910804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.910922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.910948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.911037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.911157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.911198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.911290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.911405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.911429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.911557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.911716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.911740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.911830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.911909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.911933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.912051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.912133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.912157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.912342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.912452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.912477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.912564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.912652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.912677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.912791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.912902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.912927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.913033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.913142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.913167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.913290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.913401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.913426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.486 qpair failed and we were unable to recover it. 00:30:18.486 [2024-11-27 03:25:20.913512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.913643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.486 [2024-11-27 03:25:20.913669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.913748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.913887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.913911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.914025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.914219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.914452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.914661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.914852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.914953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.915039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.915152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.915177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.915297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.915407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.915432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.915547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.915649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.915674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.915755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.915841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.915865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.915954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.916182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.916405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.916654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.916848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.916952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.917032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.917123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.917147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.917254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.917370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.917394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.917486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.917591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.917615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.917710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.917799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.917828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.917926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.918020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.918045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.918138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.918278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.918303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.918386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.918503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.918534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.918623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.918767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.918792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.918934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.919023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.919047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.487 [2024-11-27 03:25:20.919128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.919238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.487 [2024-11-27 03:25:20.919262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.487 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.919349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.919434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.919458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.919559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.919682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.919707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.919793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.919913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.919938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.920052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.920129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.920157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.920245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.920335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.920360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.920450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.920567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.920592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.920711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.920805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.920829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.920940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.921165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.921358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.921559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.921751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.921860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.921981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.922196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.922404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.922658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.922850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.922959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.923078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.923189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.923214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.923328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.923421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.923446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.923561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.923673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.923697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.923816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.923898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.923923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.924039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.924178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.924202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.924319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.924402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.924426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.924514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.924623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.924649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.924741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.924861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.924885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.924977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.925064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.925089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.925206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.925289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.925314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.925406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.925499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.925530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.488 [2024-11-27 03:25:20.925625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.925739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.488 [2024-11-27 03:25:20.925765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.488 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.925905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.926058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.926086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.926221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.926309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.926338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.926440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.926536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.926566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.926655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.926774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.926798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.926909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.926994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.927019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.927109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.927254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.927280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.927416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.927552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.927589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.927747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.927845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.927872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.928028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.928108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.928132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.928215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.928324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.928349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.928458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.928564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.928591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.928696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.928813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.928837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.928929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.929043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.929067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.929207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.929293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.929319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.929435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.929528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.929554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.929642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.929737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.929761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.929868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.929987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.930012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.930088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.930196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.930220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.930308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.930425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.930449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.930572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.930689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.930713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.930788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.930908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.930932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.931026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.931116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.931140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.931254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.931367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.931393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.931509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.931604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.931629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.931749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.931866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.931892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.931999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.932078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.932108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.932222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.932307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.932331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.932449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.932540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.932565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.489 [2024-11-27 03:25:20.932650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.932763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.489 [2024-11-27 03:25:20.932787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.489 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.932873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.933131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.933353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.933586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.933807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.933907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.934026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.934139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.934164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.934248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.934330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.934354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.934460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.934563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.934593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.934700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.934789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.934815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.934906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.934998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.935024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.935120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.935207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.935231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.935322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.935437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.935463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.935560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.935681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.935708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.935792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.935905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.935930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.936019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.936136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.936161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.936254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.936347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.936373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.936486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.936667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.936693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.936787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.936874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.936899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.936980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.937197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.937445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.937682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.937885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.937992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.938104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.938221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.938245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.938362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.938474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.938499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.938595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.938687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.938711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.938802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.938894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.938918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.939048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.939135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.939159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.490 [2024-11-27 03:25:20.939267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.939349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.490 [2024-11-27 03:25:20.939373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.490 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.939460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.939547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.939572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.939688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.939794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.939819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.939937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.940141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.940336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.940556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.940754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.940854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.940946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.941134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.941358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.941628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.941842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.941976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.942063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.942141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.942166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.942249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.942342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.942366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.942459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.942541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.942566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.942652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.942750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.942775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.942922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.943119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.943314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.943531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.943805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.943913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.944029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.944119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.944143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.944227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.944314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.944338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.944413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.944539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.944564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.944678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.944761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.944786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.491 qpair failed and we were unable to recover it. 00:30:18.491 [2024-11-27 03:25:20.944874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.491 [2024-11-27 03:25:20.944983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.945008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.945092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.945173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.945197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.945281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.945366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.945391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.945486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.945612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.945641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.945766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.945852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.945876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.945989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.946079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.946103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.946222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.946298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.946323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.946404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.946536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.946561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.946651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.946737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.946762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.946873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.946984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.947010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.947101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.947185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.947210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.947329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.947410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.947435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.947535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.947623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.947647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.947756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.947841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.947866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.947990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.948212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.948404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.948628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.948856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.948966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.949079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.949198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.949223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.949301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.949386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.949410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.949491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.949579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.949604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.949718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.949829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.949854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.949942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.950055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.950079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.950169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.950279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.950304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.950424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.950511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.950543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.950656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.950765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.950790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.950885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.951002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.951026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.951113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.951196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.492 [2024-11-27 03:25:20.951220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.492 qpair failed and we were unable to recover it. 00:30:18.492 [2024-11-27 03:25:20.951332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.951446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.951469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.951544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.951654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.951678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.951791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.951869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.951892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.951974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.952182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.952417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.952652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.952851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.952985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.953100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.953187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.953211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.953354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.953437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.953461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.953608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.953698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.953722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.953858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.953972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.953999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.954086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.954212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.954240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.954409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.954502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.954533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.954627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.954742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.954767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.954876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.954967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.954992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.955102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.955212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.955237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.955322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.955398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.955423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.955502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.955620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.955646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.955729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.955818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.955843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.955936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.956077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.956101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.956217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.956330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.956354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.956471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.956550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.956576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.956673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.956789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.956815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.956933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.957047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.957072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.957193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.957289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.957318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.957429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.957512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.957542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.493 [2024-11-27 03:25:20.957702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.957807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.493 [2024-11-27 03:25:20.957833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.493 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.957913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.958051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.958076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.958192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.958304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.958328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.958441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.958582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.958608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.958696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.958806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.958831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.958926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.959037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.959077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.959238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.959321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.959346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.959484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.959607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.959632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.959737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.959830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.959858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.960003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.960088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.960113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.960232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.960316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.960341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.960426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.960517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.960549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.960708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.960799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.960826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.960947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.961065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.961090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.961200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.961342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.961386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.961506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.961727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.961753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.961873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.962015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.962040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.962126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.962240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.962265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.962386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.962469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.962494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.962601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.962686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.962711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.962826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.962992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.963020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.963127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.963254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.963282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.963437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.963580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.963606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.963691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.963808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.963833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.964000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.964093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.964120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.964256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.964376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.964400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.964518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.964665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.964691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.964794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.964923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.964948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.965024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.965143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.965168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.494 [2024-11-27 03:25:20.965288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.965378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.494 [2024-11-27 03:25:20.965403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.494 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.965517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.965604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.965647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.965778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.965859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.965883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.965992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.966190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.966381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.966610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.966823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.966992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.967084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.967198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.967223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.967340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.967480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.967505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.967643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.967777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.967801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.967937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.968019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.968044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.968153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.968266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.968308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.968454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.968577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.968603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.968694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.968809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.968835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.968953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.969066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.969092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.969207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.969293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.969318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.969407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.969515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.969546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.969630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.969736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.969761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.969894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.970018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.970046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.970154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.970243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.970271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.970422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.970535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.970560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.970635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.970722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.495 [2024-11-27 03:25:20.970746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.495 qpair failed and we were unable to recover it. 00:30:18.495 [2024-11-27 03:25:20.970852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.970941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.970965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.971093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.971189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.971216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.971350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.971463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.971488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.971646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.971756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.971780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.971893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.971979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.972004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.972143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.972230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.972254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.972335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.972414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.972439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.972552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.972671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.972696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.972784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.972895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.972920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.973032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.973112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.973137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.973228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.973409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.973434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.973548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.973636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.973661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.973754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.973863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.973888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.973996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.974089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.974113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.974245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.974362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.974388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.974552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.974637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.974662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.496 qpair failed and we were unable to recover it. 00:30:18.496 [2024-11-27 03:25:20.974777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.974904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.496 [2024-11-27 03:25:20.974933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.975051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.975149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.975176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.975316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.975458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.975483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.975578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.975694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.975719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.975839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.975950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.975975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.976099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.976190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.976215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.976353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.976496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.976521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.976644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.976727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.976752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.976862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.976974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.976999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.977154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.977244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.977269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.977351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.977455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.977482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.977601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.977708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.977732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.977886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.978041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.978073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.978248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.978364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.978389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.978508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.978618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.978646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.978825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.978938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.978963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.979048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.979178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.979205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.979335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.979452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.979477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.979600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.979725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.979751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.979859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.979966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.979991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.497 [2024-11-27 03:25:20.980136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.980220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.497 [2024-11-27 03:25:20.980245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.497 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.980362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.980449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.980473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.980612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.980705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.980730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.980815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.980931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.980956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.981035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.981134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.981162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.981259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.981376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.981418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.981507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.981621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.981646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.981734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.981869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.981893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.982037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.982124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.982149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.982233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.982343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.982368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.982505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.982643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.982670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.982762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.982877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.982903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.982998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.983150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.983176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.983268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.983439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.983464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.983572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.983665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.983692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.983839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.983948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.983974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.984114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.984256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.984281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.984392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.984510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.984543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.984634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.984781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.984806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.984899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.985037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.985063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.498 [2024-11-27 03:25:20.985146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.985229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.498 [2024-11-27 03:25:20.985255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.498 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.985342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.985416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.985441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.985565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.985739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.985765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.985877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.986067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.986093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.986177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.986268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.986293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.986437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.986569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.986597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.986734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.986816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.986840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.986931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.987039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.987064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.987179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.987285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.987310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.987451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.987580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.987609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.987728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.987869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.987894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.988022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.988112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.988141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.988242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.988348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.988380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.988490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.988602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.988628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.988750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.988890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.988915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.989002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.989091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.989116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.989208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.989321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.989346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.989448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.989603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.989631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.989757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.989890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.989915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.990063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.990184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.990209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.990294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.990432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.499 [2024-11-27 03:25:20.990457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.499 qpair failed and we were unable to recover it. 00:30:18.499 [2024-11-27 03:25:20.990581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.990676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.990704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.990836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.990978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.991003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.991151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.991244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.991269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.991387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.991481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.991505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.991631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.991712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.991736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.991818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.991922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.991963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.992055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.992167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.992191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.992332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.992415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.992439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.992554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.992681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.992708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.992843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.992971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.992998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.993122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.993229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.993254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.993383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.993544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.993570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.993719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.993808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.993833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.993942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.994028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.994053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.994194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.994338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.994362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.994464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.994606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.994632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.994724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.994848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.994873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.994972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.995095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.995122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.995258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.995336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.995361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.995479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.995554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.995579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.500 qpair failed and we were unable to recover it. 00:30:18.500 [2024-11-27 03:25:20.995669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.500 [2024-11-27 03:25:20.995786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.995811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.995899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.996068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.996093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.996206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.996311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.996336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.996515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.996621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.996646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.996765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.996842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.996867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.996985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.997121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.997146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.997255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.997378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.997405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.997545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.997623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.997648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.997756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.997867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.997892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.998036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.998158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.998186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.998284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.998411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.998439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.998546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.998664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.998689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.998817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.998952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.998977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.999066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.999206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.999231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.999348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.999494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.999520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.999605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.999717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.999743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:20.999834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:20.999988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:21.000014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:21.000153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:21.000268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:21.000292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:21.000426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:21.000521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:21.000556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:21.000685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:21.000805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:21.000832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.501 qpair failed and we were unable to recover it. 00:30:18.501 [2024-11-27 03:25:21.000967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.501 [2024-11-27 03:25:21.001051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.001076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.001237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.001342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.001366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.001484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.001610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.001642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.001786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.001938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.001962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.002082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.002206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.002233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.002330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.002492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.002517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.002620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.002729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.002753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.002842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.002975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.003002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.003171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.003324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.003349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.003466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.003585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.003612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.003727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.003880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.003921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.004013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.004125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.004149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.004236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.004321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.004346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.004487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.004636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.004662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.004798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.004935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.004959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.005096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.005207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.005231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.005390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.005544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.005572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.005701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.005838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.005863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.005979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.006092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.006117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.006252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.006349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.006373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.006459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.006621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.006650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.502 [2024-11-27 03:25:21.006776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.006916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.502 [2024-11-27 03:25:21.006941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.502 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.007081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.007226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.007254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.007391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.007545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.007573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.007685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.007768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.007793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.007890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.008014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.008041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.008197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.008325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.008352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.008481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.008570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.008594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.008685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.008824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.008849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.008953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.009077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.009105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.009217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.009337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.009362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.009477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.009561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.009586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.009688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.009785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.009813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.009950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.010033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.010058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.010139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.010242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.010271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.010396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.010492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.010542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.010666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.010776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.010801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.010951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.011029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.011054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.011171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.011261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.011286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.503 [2024-11-27 03:25:21.011428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.011569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.503 [2024-11-27 03:25:21.011611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.503 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.011703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.011800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.011828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.011977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.012057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.012081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.012197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.012276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.012300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.012421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.012544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.012569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.012675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.012766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.012794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.012932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.013045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.013069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.013207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.013336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.013363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.013454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.013577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.013605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.013741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.013826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.013851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.013955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.014076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.014118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.014207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.014323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.014362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.014506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.014622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.014646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.014735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.014888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.014915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.015095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.015181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.015209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.015355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.015457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.015481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.015598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.015720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.015762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.015850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.015935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.015959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.016077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.016191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.016216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.016346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.016430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.016458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.016591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.016687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.016711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.016842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.016992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.017018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.504 [2024-11-27 03:25:21.017102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.017237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.504 [2024-11-27 03:25:21.017282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.504 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.017394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.017565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.017594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.017712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.017827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.017851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.018014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.018131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.018159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.018293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.018382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.018407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.018497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.018624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.018649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.018783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.018877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.018918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.019065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.019149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.019173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.019265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.019376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.019400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.019485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.019578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.019620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.019740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.019897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.019922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.020045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.020156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.020181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.020296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.020422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.020448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.020565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.020677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.020702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.020785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.020873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.020898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.021016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.021102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.021127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.021242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.021336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.021360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.021475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.021591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.021615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.021733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.021811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.021836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.021957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.022069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.022093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.022185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.022325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.022350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.022456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.022568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.022595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.022734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.022861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.022889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.023001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.023113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.023137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.505 qpair failed and we were unable to recover it. 00:30:18.505 [2024-11-27 03:25:21.023220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.023310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.505 [2024-11-27 03:25:21.023337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.023480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.023579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.023607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.023723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.023809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.023834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.023984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.024108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.024136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.024255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.024373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.024401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.024540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.024646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.024671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.024830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.024973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.024997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.025115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.025232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.025256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.025394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.025481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.025506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.025656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.025798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.025840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.025934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.026058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.026100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.026239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.026352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.026376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.026545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.026634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.026659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.026780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.026894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.026918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.027074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.027185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.027211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.027373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.027503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.027538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.027645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.027789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.027813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.027930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.028046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.028070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.028177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.028273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.028300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.028438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.028553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.028585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.028732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.028818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.028843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.028935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.029052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.029077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.029160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.029247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.029272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.029358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.029471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.029495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.506 [2024-11-27 03:25:21.029615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.029730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.506 [2024-11-27 03:25:21.029755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.506 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.029877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.030010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.030038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.030139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.030277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.030302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.030419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.030537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.030564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.030656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.030771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.030799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.030909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.031017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.031045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.031134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.031248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.031273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.031411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.031503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.031532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.031616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.031755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.031780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.031902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.032055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.032082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.032207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.032334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.032360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.032477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.032557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.032582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.032693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.032854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.032881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.032976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.033080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.033105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.033222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.033334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.033358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.033477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.033613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.033656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.033809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.033940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.033967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.034110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.034209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.034233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.034371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.034508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.034539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.034654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.034748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.034773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.034881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.035024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.035048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.035190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.035320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.035347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.035520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.035642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.035667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.035811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.035951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.035975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.036114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.036229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.036253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.036365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.036483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.036507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.036635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.036745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.036769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.036872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.036988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.037015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.037190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.037308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.037332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.037442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.037580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.037605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.037681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.037794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.037818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.037977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.038078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.507 [2024-11-27 03:25:21.038105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.507 qpair failed and we were unable to recover it. 00:30:18.507 [2024-11-27 03:25:21.038247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.038386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.038411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.038553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.038636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.038663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.038785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.038919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.038943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.039064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.039203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.039228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.039306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.039439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.039466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.039632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.039746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.039771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.039855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.039992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.040016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.040148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.040306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.040346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.040456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.040542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.040568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.040685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.040774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.040799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.040915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.041023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.041047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.041161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.041273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.041314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.041431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.041553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.041579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.041696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.041812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.041837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.041935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.042062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.042090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.042227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.042339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.042364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.042465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.042630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.042656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.042794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.042912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.042936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.043027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.043114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.043139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.043260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.043439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.043464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.043604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.043739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.043767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.043944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.044058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.044082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.044192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.044302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.044326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.044412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.044504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.044534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.044664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.044752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.044781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.508 qpair failed and we were unable to recover it. 00:30:18.508 [2024-11-27 03:25:21.044863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.044979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.508 [2024-11-27 03:25:21.045005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.045133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.045249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.045275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.045412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.045567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.045592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.045722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.045866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.045890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.046001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.046116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.046141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.046262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.046348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.046372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.046457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.046543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.046570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.046708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.046811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.046838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.046951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.047043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.047068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.047147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.047231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.047255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.047375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.047508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.047544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.047683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.047764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.047789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.047917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.048038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.048065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.048222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.048394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.509 [2024-11-27 03:25:21.048418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.509 qpair failed and we were unable to recover it. 00:30:18.509 [2024-11-27 03:25:21.048507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.048625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.048650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.048732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.048870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.048913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.049017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.049157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.049182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.049272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.049386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.049412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.049544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.049642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.049669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.049762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.049928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.049953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.050068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.050211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.050235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.050370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.050469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.050496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.050625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.050712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.050740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.050839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.050926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.050950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.051043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.051123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.051149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.051265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.051405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.051447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.510 qpair failed and we were unable to recover it. 00:30:18.510 [2024-11-27 03:25:21.051563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.051647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.510 [2024-11-27 03:25:21.051672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.792 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.051813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.051981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.052007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.052096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.052182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.052207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.052348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.052434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.052459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.052564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.052686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.052714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.052801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.052948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.052973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.053091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.053171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.053196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.053328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.053421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.053448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.053554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.053681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.053709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.053840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.053956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.053981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.054086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.054186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.054214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.054384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.054501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.054533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.054648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.054761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.054787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.054865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.054978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.055003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.055097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.055251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.055279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.055415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.055538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.055564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.055722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.055839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.055866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.056023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.056124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.056151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.056286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.056378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.056402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.056488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.056605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.056647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.056767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.056924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.056948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.057089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.057178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.057202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.057289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.057406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.057430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.793 qpair failed and we were unable to recover it. 00:30:18.793 [2024-11-27 03:25:21.057518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.057636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.793 [2024-11-27 03:25:21.057663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.057762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.057848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.057877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.057963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.058055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.058080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.058191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.058278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.058303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.058436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.058545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.058571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.058649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.058778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.058805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.058903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.059025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.059053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.059188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.059331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.059356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.059490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.059622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.059647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.059802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.059938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.059965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.060099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.060245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.060269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.060381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.060512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.060546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.060645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.060747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.060772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.060914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.061005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.061030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.061170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.061293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.061321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.061442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.061551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.061580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.061719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.061841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.061866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.061955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.062034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.062074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.062207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.062292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.062318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.062437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.062579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.062605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.062763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.062884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.062909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.063068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.063183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.063211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.063362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.063483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.063508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.063631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.063769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.063811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.794 qpair failed and we were unable to recover it. 00:30:18.794 [2024-11-27 03:25:21.063900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.794 [2024-11-27 03:25:21.064056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.064083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.064220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.064338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.064363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.064459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.064584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.064613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.064773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.064874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.064902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.065033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.065117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.065142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.065251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.065370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.065398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.065520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.065658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.065686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.065828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.065915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.065941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.066085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.066196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.066221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.066339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.066464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.066492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.066661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.066749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.066774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.066876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.066997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.067026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.067122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.067211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.067236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.067314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.067395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.067420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.067574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.067692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.067719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.067850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.067979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.068007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.068097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.068203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.068228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.068349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.068463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.068489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.068630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.068736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.068764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.068880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.069006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.069031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.069116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.069259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.069300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.069410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.069556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.069583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.069695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.069775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.069799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.069937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.070062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.070089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.070189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.070314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.070342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.795 qpair failed and we were unable to recover it. 00:30:18.795 [2024-11-27 03:25:21.070482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.795 [2024-11-27 03:25:21.070631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.070656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.070792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.070890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.070917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.071085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.071225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.071250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.071340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.071476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.071506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.071674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.071803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.071831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.072002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.072117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.072141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.072258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.072343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.072369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.072483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.072590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.072619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.072744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.072867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.072895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.073004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.073118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.073142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.073234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.073354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.073378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.073460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.073600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.073628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.073770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.073883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.073908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.074052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.074165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.074195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.074329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.074433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.074457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.074554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.074652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.074676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.074785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.074894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.074918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.075008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.075110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.075137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.075299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.075415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.075439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.075571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.075704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.075730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.075845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.075925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.075949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.076074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.076190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.076214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.076325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.076425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.076452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.076622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.076740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.076765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.076859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.076950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.796 [2024-11-27 03:25:21.076974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.796 qpair failed and we were unable to recover it. 00:30:18.796 [2024-11-27 03:25:21.077089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.077217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.077244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.077369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.077457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.077484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.077613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.077704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.077729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.077850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.078003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.078030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.078160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.078285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.078327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.078419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.078508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.078540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.078661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.078774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.078801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.078900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.079000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.079041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.079139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.079217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.079241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.079382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.079485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.079513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.079680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.079776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.079801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.079946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.080065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.080090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.080229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.080368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.080393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.080506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.080674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.080703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.080864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.080951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.080976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.081098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.081211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.081253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.081421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.081570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.081599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.081721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.081860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.081885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.082013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.082106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.082133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.082220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.082312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.082339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.082445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.082597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.082623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.082741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.082857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.082882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.082971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.083066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.083093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.797 [2024-11-27 03:25:21.083202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.083314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.797 [2024-11-27 03:25:21.083340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.797 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.083457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.083613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.083641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.083739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.083848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.083873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.084016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.084101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.084126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.084291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.084412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.084440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.084558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.084669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.084694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.084822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.084940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.084966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.085078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.085160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.085185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.085296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.085379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.085403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.085516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.085673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.085698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.085866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.086020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.086048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.086171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.086313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.086338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.086450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.086557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.086583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.086725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.086888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.086913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.087031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.087142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.087171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.087330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.087450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.087474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.087619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.087721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.087754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.087839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.087961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.087989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.088095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.088247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.088272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.088384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.088480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.088508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.798 [2024-11-27 03:25:21.088621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.088772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.798 [2024-11-27 03:25:21.088800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.798 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.088936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.089041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.089065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.089155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.089268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.089308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.089425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.089551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.089579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.089684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.089832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.089856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.089985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.090079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.090107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.090234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.090369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.090393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.090514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.090611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.090635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.090753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.090899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.090923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.091096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.091220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.091248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.091388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.091469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.091493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.091625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.091711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.091736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.091873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.091996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.092024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.092182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.092289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.092314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.092476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.092599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.092627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.092717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.092856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.092881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.092998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.093138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.093163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.093281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.093410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.093438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.093573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.093678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.093703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.093856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.093938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.093962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.094092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.094186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.094210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.094298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.094386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.094410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.094490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.094583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.094609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.094764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.094862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.094903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.095009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.095114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.095139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.799 [2024-11-27 03:25:21.095219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.095338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.799 [2024-11-27 03:25:21.095363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.799 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.095523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.095650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.095679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.095815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.095950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.095976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.096091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.096200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.096225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.096352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.096470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.096497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.096597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.096754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.096782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.096911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.097026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.097051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.097187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.097287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.097314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.097472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.097599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.097626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.097731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.097871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.097896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.098000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.098090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.098117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.098247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.098364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.098391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.098492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.098651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.098676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.098813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.098934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.098961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.099062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.099179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.099205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.099384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.099493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.099518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.099666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.099816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.099843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.099997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.100117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.100141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.100229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.100369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.100393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.100503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.100646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.100671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.100812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.100893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.100934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.101078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.101198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.101222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.101362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.101475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.101520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.101645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.101740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.101768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.101872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.102015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.102040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.800 qpair failed and we were unable to recover it. 00:30:18.800 [2024-11-27 03:25:21.102145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.102278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.800 [2024-11-27 03:25:21.102303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.102399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.102482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.102506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.102635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.102725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.102749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.102863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.102952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.102979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.103069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.103178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.103202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.103318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.103433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.103457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.103573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.103689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.103713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.103848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.104016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.104040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.104166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.104307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.104331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.104484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.104571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.104596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.104735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.104812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.104836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.104923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.105012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.105036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.105157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.105288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.105315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.105440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.105567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.105595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.105714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.105859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.105883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.105989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.106088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.106133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.106220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.106300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.106325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.106465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.106653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.106680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.106780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.106884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.106911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.107035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.107127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.107153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.107297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.107407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.107431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.107560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.107680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.107707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.107815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.107941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.107967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.108076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.108183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.108206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.801 [2024-11-27 03:25:21.108295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.108431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.801 [2024-11-27 03:25:21.108458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.801 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.108580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.108743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.108767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.108886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.108969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.108993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.109126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.109292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.109317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.109459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.109578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.109605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.109747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.109821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.109845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.109933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.110043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.110068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.110161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.110288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.110316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.110423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.110542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.110567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.110650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.110759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.110783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.110907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.111046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.111070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.111159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.111270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.111294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.111386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.111479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.111503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.111630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.111737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.111762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.111878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.112000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.112025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.112197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.112308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.112332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.112415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.112549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.112592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.112683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.112773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.112797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.112909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.113104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.113321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.113567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.113797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.113902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.113991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.114071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.114095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.114210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.114297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.114327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.802 qpair failed and we were unable to recover it. 00:30:18.802 [2024-11-27 03:25:21.114464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.114592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.802 [2024-11-27 03:25:21.114635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.114721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.114865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.114890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.115025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.115127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.115156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.115315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.115454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.115478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.115562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.115678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.115702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.115816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.115929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.115954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.116077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.116195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.116219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.116362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.116448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.116473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.116563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.116660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.116685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.116772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.116871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.116899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.117008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.117092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.117117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.117228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.117311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.117336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.117512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.117627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.117652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.117742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.117861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.117887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.117992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.118115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.118142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.118269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.118406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.118431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.118576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.118657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.118682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.118785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.118886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.118911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.119016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.119123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.119150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.119285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.119396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.119422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.119521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.119668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.119693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.119834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.119944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.119972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.803 qpair failed and we were unable to recover it. 00:30:18.803 [2024-11-27 03:25:21.120073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.120164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.803 [2024-11-27 03:25:21.120190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.120275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.120390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.120417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.120548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.120719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.120744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.120885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.120979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.121004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.121083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.121167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.121192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.121312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.121469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.121503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.121672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.121781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.121807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.121940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.122064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.122092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.122257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.122344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.122369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.122488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.122590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.122615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.122727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.122859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.122888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.123013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.123160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.123185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.123325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.123435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.123461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.123541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.123660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.123685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.123762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.123898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.123942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.124063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.124183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.124208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.124321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.124432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.124458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.124539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.124644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.124670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.124762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.124876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.124901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.124988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.125069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.125093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.125216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.125322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.125347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.125487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.125582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.125607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.125695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.125770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.125796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.125886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.126006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.126050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.126183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.126291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.126316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.804 [2024-11-27 03:25:21.126460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.126549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.804 [2024-11-27 03:25:21.126593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.804 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.126689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.126814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.126859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.127001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.127115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.127141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.127222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.127335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.127367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.127508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.127600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.127625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.127740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.127853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.127879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.128050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.128161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.128186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.128315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.128472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.128500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.128614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.128695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.128721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.128863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.128984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.129011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.129128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.129271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.129297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.129384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.129497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.129521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.129660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.129783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.129810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.129961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.130080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.130112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.130237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.130385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.130411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.130538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.130655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.130681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.130800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.130909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.130934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.131046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.131163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.131188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.131282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.131403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.131430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.131580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.131680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.131734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.131848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.131954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.131979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.132117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.132277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.132305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.132413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.132542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.132568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.132651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.132765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.132790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.132884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.132996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.133021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.133100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.133242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.805 [2024-11-27 03:25:21.133267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.805 qpair failed and we were unable to recover it. 00:30:18.805 [2024-11-27 03:25:21.133407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.133497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.133546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.133694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.133846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.133875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.134016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.134108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.134133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.134271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.134352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.134377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.134507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.134625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.134649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.134768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.134921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.134947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.135051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.135170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.135194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.135339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.135437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.135463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.135575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.135672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.135699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.135809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.135925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.135951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.136059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.136178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.136206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.136365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.136447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.136472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.136581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.136721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.136745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.136909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.137029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.137076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.137160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.137271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.137296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.137381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.137496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.137520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.137707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.137846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.137871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.137973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.138061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.138088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.138233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.138351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.138377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.138507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.138666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.138695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.138816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.142714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.142759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.142920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.143035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.143062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.143202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.143300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.143327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.143427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.143564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.143590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.806 qpair failed and we were unable to recover it. 00:30:18.806 [2024-11-27 03:25:21.143705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.806 [2024-11-27 03:25:21.143822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.143847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.143958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.144075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.144101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.144238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.144365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.144392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.144484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.144592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.144617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.144702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.144819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.144847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.144939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.145064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.145091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.145239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.145356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.145380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.145459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.145550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.145575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.145657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.145747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.145771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.145881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.145990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.146015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.146122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.146261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.146286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.146399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.146493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.146517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.146681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.146802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.146828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.146913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.147015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.147043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.147141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.147259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.147292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.147422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.147518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.147552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.147727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.147841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.147867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.147950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.148110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.148135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.148250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.148340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.148365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.148511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.148615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.148644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.148775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.148900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.148928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.149067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.149162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.149187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.149326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.149460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.149488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.149667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.149777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.149803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.149919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.150013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.150037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.807 qpair failed and we were unable to recover it. 00:30:18.807 [2024-11-27 03:25:21.150159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.807 [2024-11-27 03:25:21.150318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.150347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.150478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.150570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.150596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.150715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.150824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.150850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.150973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.151098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.151142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.151259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.151343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.151368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.151453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.151570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.151596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.151701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.151846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.151871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.152013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.152155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.152180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.152266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.152374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.152398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.152546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.152640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.152667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.152780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.152937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.152965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.153095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.153181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.153207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.153323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.153420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.153450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.153594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.153739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.153765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.153911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.154021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.154046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.154191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.154324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.154349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.154463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.154556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.154599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.154742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.154838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.154863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.154976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.155182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.155418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.155617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.155843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.155987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.156131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.156217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.156242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.808 qpair failed and we were unable to recover it. 00:30:18.808 [2024-11-27 03:25:21.156405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.156564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.808 [2024-11-27 03:25:21.156592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.156746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.156875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.156905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.157011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.157098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.157124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.157281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.157407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.157450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.157589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.157748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.157776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.157944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.158067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.158092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.158259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.158383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.158411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.158571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.158669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.158698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.158811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.158897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.158922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.159021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.159110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.159135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.159225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.159325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.159353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.159452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.159577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.159603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.159778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.159871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.159899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.160022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.160154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.160181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.160316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.160429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.160455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.160595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.160718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.160746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.160874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.161006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.161035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.161180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.161319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.161360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.161453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.161567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.161594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.161734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.161839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.161866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.161971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.162093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.162119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.162239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.162354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.162395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.809 qpair failed and we were unable to recover it. 00:30:18.809 [2024-11-27 03:25:21.162490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.809 [2024-11-27 03:25:21.162621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.162650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.162785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.162895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.162921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.163053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.163184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.163212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.163335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.163463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.163508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.163621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.163734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.163761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.163915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.164092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.164118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.164261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.164404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.164432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.164542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.164665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.164690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.164813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.164895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.164920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.165067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.165149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.165193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.165300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.165416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.165441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.165551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.165654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.165683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.165814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.165919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.165945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.166038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.166151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.166177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.166290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.166427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.166453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.166607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.166761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.166790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.166933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.167072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.167097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.167244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.167381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.167406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.167505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.167708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.167734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.167853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.167992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.168017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.168182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.168307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.168336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.168437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.168578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.168604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.168719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.168836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.168861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.168980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.169108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.169133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.810 [2024-11-27 03:25:21.169229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.169343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.810 [2024-11-27 03:25:21.169369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.810 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.169474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.169552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.169579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.169670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.169759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.169785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.169929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.170091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.170120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.170288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.170431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.170471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.170614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.170759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.170785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.170939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.171021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.171046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.171164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.171271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.171297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.171462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.171635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.171661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.171783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.171884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.171912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.172042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.172156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.172182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.172280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.172453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.172478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.172594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.172680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.172705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.172788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.172867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.172893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.173034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.173111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.173136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.173246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.173337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.173363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.173573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.173688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.173714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.173805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.173927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.173969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.174074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.174228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.174256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.174396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.174482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.174508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.174639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.174789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.174830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.174956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.175119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.175148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.175263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.175374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.175400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.175494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.175613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.175639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.175724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.175857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.175884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.176050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.176168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.811 [2024-11-27 03:25:21.176193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.811 qpair failed and we were unable to recover it. 00:30:18.811 [2024-11-27 03:25:21.176311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.176400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.176426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.176513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.176605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.176631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.176755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.176874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.176900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.177029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.177132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.177162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.177258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.177357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.177385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.177550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.177662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.177692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.177854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.177977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.178005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.178109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.178219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.178245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.178361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.178513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.178561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.178691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.178790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.178818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.178907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.179013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.179041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.179153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.179267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.179293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.179425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.179588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.179613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.179730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.179864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.179892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.180055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.180143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.180168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.180300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.180394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.180423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.180554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.180641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.180670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.180797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.180942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.180967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.181126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.181221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.181250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.181342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.181506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.181539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.181627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.181717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.181742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.181826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.181965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.181992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.182092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.182175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.182202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.182309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.182417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.182442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.182558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.182710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.182738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.812 qpair failed and we were unable to recover it. 00:30:18.812 [2024-11-27 03:25:21.182824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.812 [2024-11-27 03:25:21.182917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.182945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.183081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.183225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.183251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.183400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.183558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.183588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.183734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.183851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.183877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.183966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.184085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.184110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.184227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.184324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.184352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.184460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.184576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.184618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.184762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.184904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.184930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.185059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.185214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.185244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.185372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.185569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.185596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.185717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.185860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.185886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.186028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.186160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.186188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.186314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.186465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.186494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.186662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.186781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.186806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.186950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.187097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.187122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.187208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.187299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.187325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.187468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.187607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.187634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.187751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.187880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.187922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.188006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.188093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.188119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.188260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.188345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.188370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.188533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.188657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.188685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.188786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.188932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.188957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.189067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.189211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.189236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.189340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.189500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.189531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.813 [2024-11-27 03:25:21.189651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.189737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.813 [2024-11-27 03:25:21.189763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.813 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.189853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.189966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.189991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.190125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.190279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.190306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.190425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.190545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.190575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.190716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.190808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.190833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.190964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.191092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.191120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.191258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.191351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.191377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.191522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.191634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.191665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.191764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.191896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.191923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.192027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.192124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.192151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.192292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.192434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.192460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.192626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.192724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.192751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.192844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.193014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.193039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.193158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.193301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.193325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.193485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.193620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.193663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.193744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.193836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.193862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.193945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.194062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.194088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.194185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.194323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.194348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.194515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.194648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.194673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.194819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.194930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.194955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.195127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.195252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.195279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.814 qpair failed and we were unable to recover it. 00:30:18.814 [2024-11-27 03:25:21.195420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.195541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.814 [2024-11-27 03:25:21.195567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.195653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.195792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.195816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.195920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.196041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.196068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.196162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.196261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.196289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.196456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.196563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.196589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.196749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.196847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.196874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.196993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.197145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.197173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.197269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.197399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.197425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.197510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.197651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.197680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.197817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.197942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.197968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.198088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.198174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.198199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.198291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.198431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.198456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.198545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.198662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.198690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.198803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.198916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.198940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.199078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.199211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.199235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.199319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.199453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.199480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.199589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.199703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.199727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.199878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.200059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.200088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.200220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.200353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.200382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.200486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.200606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.200633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.200718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.200860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.200905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.201017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.201098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.201124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.201274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.201393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.201418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.201552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.201693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.201717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.201835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.201991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.202019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.815 qpair failed and we were unable to recover it. 00:30:18.815 [2024-11-27 03:25:21.202125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.815 [2024-11-27 03:25:21.202240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.202265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.202402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.202531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.202560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.202667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.202763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.202789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.202929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.203082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.203133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.203243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.203336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.203364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.203491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.203600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.203625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.203708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.203849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.203874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.203994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.204067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.204092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.204180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.204256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.204281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.204422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.204537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.204562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.204651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.204764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.204790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.204898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.204983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.205009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.205116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.205230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.205261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.205353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.205489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.205546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.205639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.205732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.205757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.205850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.205939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.205963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.206107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.206232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.206260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.206346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.206434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.206461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.206602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.206725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.206749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.206860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.207016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.207043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.207145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.207262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.207289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.207446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.207587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.207613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.207705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.207849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.207878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.208042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.208137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.208163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.816 [2024-11-27 03:25:21.208301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.208380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.816 [2024-11-27 03:25:21.208405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.816 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.208522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.208673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.208699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.208780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.208885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.208910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.209024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.209134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.209159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.209289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.209390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.209418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.209546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.209677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.209702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.209817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.209928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.209953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.210073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.210203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.210231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.210356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.210465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.210492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.210605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.210698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.210723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.210813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.210926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.210950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.211093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.211206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.211234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.211372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.211479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.211505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.211608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.211718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.211743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.211857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.211949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.211976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.212089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.212202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.212227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.212322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.212439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.212463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.212554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.212667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.212695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.212833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.212981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.213006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.213184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.213323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.213349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.213468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.213641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.213683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.213802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.213897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.213922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.214020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.214156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.214183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.214344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.214439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.214467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.214637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.214754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.214780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.817 qpair failed and we were unable to recover it. 00:30:18.817 [2024-11-27 03:25:21.214926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.215038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.817 [2024-11-27 03:25:21.215064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.215198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.215343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.215371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.215481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.215638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.215664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.215759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.215847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.215872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.215980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.216097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.216122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.216233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.216379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.216404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.216515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.216620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.216648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.216749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.216836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.216865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.217008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.217151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.217177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.217318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.217490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.217515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.217607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.217717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.217759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.217866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.217952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.217978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.218111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.218205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.218249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.218371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.218482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.218507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.218600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.218723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.218748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.218882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.219001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.219030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.219199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.219313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.219339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.219489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.219651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.219680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.219805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.219960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.219987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.220109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.220252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.220277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.220365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.220488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.220513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.220633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.220802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.220828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.220915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.221054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.221097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.221233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.221348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.221373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.221451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.221572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.818 [2024-11-27 03:25:21.221619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.818 qpair failed and we were unable to recover it. 00:30:18.818 [2024-11-27 03:25:21.221725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.221849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.221894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.222035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.222151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.222176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.222325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.222456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.222497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.222599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.222706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.222731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.222849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.222969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.222994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.223081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.223249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.223277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.223378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.223508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.223542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.223687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.223776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.223801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.223888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.223978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.224002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.224123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.224261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.224288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.224427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.224537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.224563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.224726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.224828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.224856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.224997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.225126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.225151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.225265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.225350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.225374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.225493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.225584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.225609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.225693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.225809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.225833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.225915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.226055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.226080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.226188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.226297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.226322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.226408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.226521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.226559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.226675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.226785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.226809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.226899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.227042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.819 [2024-11-27 03:25:21.227067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.819 qpair failed and we were unable to recover it. 00:30:18.819 [2024-11-27 03:25:21.227176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.227264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.227289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.227399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.227532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.227575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.227691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.227831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.227859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.228017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.228134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.228159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.228247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.228360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.228385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.228514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.228621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.228650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.228745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.228869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.228898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.229040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.229194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.229220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.229319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.229449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.229474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.229606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.229751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.229776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.229862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.230001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.230027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.230111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.230227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.230271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.230421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.230570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.230599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.230736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.230854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.230879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.230994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.231070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.231095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.231212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.231295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.231336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.231480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.231577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.231603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.231769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.231864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.231892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.231998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.232121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.232163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.232277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.232428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.232453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.232605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.232700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.232726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.232891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.232992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.233020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.233157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.233247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.233288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.233415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.233503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.233540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.820 [2024-11-27 03:25:21.233644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.233730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.820 [2024-11-27 03:25:21.233754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.820 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.233841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.233979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.234004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.234088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.234275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.234300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.234398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.234488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.234590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.234731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.234851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.234876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.234996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.235100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.235135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.235222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.235324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.235351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.235514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.235633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.235659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.235802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.235905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.235933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.236033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.236134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.236160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.236275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.236383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.236407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.236536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.236669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.236697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.236792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.236911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.236939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.237109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.237204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.237229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.237368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.237465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.237489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.237582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.237699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.237727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.237827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.237984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.238010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.238123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.238294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.238319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.238438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.238556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.238599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.238714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.238811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.238836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.239009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.239137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.239164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.239253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.239390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.239418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.239531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.239612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.239637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.239722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.239848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.239877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.240003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.240121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.240149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.240293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.240435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.821 [2024-11-27 03:25:21.240460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.821 qpair failed and we were unable to recover it. 00:30:18.821 [2024-11-27 03:25:21.240618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.240784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.240809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.240947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.241104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.241129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.241242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.241354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.241379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.241468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.241619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.241647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.241774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.241875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.241918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.242062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.242181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.242207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.242325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.242413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.242442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.242538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.242661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.242690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.242817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.242959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.242984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.243126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.243266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.243291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.243412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.243574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.243603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.243718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.243805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.243830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.243912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.244051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.244079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.244246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.244387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.244411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.244498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.244646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.244671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.244762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.244846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.244872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.244984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.245099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.245142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.245278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.245420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.245445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.245577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.245719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.245744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.245861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.245973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.245998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.246080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.246195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.246221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.246309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.246448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.246473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.246636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.246810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.246835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.246952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.247067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.247092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.247263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.247358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.247387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.822 qpair failed and we were unable to recover it. 00:30:18.822 [2024-11-27 03:25:21.247544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.822 [2024-11-27 03:25:21.247646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.247674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.247810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.247953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.247978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.248136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.248259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.248287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.248384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.248537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.248566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.248694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.248808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.248834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.248943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.249049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.249081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.249208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.249339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.249367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.249480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.249580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.249605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.249743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.249859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.249885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.250047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.250140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.250169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.250309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.250387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.250412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.250520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.250650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.250678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.250829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.250984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.251011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.251121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.251207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.251233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.251396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.251521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.251567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.251688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.251853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.251878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.252002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.252114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.252138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.252272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.252374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.252403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.252496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.252609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.252638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.252777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.252918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.252944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.253057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.253184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.253211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.253384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.253496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.253522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.253677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.253792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.253817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.253957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.254052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.254079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.823 qpair failed and we were unable to recover it. 00:30:18.823 [2024-11-27 03:25:21.254210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.254332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.823 [2024-11-27 03:25:21.254359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.254491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.254580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.254607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.254778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.254890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.254933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.255029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.255142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.255185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.255310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.255443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.255471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.255584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.255705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.255730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.255844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.256006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.256034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.256197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.256315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.256340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.256470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.256592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.256620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.256721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.256836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.256862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.256984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.257069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.257095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.257185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.257327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.257356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.257517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.257642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.257667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.257787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.257903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.257928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.258076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.258158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.258202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.258358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.258481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.258508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.258682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.258773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.258797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.258897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.259005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.259030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.259190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.259313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.259341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.259490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.259639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.259666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.259756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.259900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.259925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.260069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.260164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.260193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.260324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.260443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.260469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.260631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.260734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.260762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.260918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.261013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.261041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.824 qpair failed and we were unable to recover it. 00:30:18.824 [2024-11-27 03:25:21.261204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.824 [2024-11-27 03:25:21.261311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.261335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.261453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.261564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.261589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.261725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.261841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.261869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.262032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.262189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.262217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.262333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.262451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.262492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.262612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.262742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.262770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.262912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.263020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.263046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.263133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.263252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.263285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.263437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.263578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.263605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.263695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.263806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.263831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.263975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.264052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.264092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.264192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.264342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.264371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.264506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.264663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.264690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.264870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.265013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.265039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.265212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.265372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.265397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.265485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.265618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.265644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.265776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.265891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.265919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.266086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.266228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.266258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.266376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.266490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.266515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.266651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.266748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.266791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.266904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.267013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.267057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.825 [2024-11-27 03:25:21.267192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.267330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.825 [2024-11-27 03:25:21.267356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.825 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.267447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.267575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.267605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.267734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.267826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.267854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.267984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.268066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.268091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.268211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.268342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.268370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.268470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.268597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.268625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.268725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.268839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.268864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.269006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.269093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.269122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.269207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.269340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.269367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.269476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.269611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.269638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.269752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.269890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.269915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.270031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.270155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.270181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.270264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.270377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.270405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.270539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.270674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.270700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.270779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.270889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.270915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.271006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.271139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.271164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.271303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.271398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.271426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.271571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.271681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.271708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.271801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.271940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.271965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.272095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.272228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.272256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.272380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.272513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.272550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.272654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.272772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.272798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.272885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.273019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.273046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.273146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.273298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.273326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.273494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.273608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.273633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.826 [2024-11-27 03:25:21.273755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.273839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.826 [2024-11-27 03:25:21.273884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.826 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.273986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.274136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.274164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.274301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.274447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.274472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.274649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.274774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.274802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.274960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.275084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.275112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.275225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.275338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.275363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.275459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.275627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.275656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.275773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.275901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.275928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.276052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.276171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.276196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.276329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.276484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.276512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.276648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.276770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.276799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.276934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.277075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.277100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.277236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.277394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.277422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.277577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.277741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.277767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.277882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.278024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.278048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.278220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.278369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.278395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.278536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.278628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.278654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.278734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.278844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.278869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.278957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.279047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.279072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.279182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.279285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.279313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.279471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.279612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.279638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.279721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.279897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.279923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.280012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.280102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.280148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.280292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.280408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.280433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.280576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.280661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.280689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.827 qpair failed and we were unable to recover it. 00:30:18.827 [2024-11-27 03:25:21.280815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.827 [2024-11-27 03:25:21.280908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.280937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.281049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.281168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.281193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.281332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.281446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.281473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.281596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.281716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.281743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.281879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.281967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.281993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.282077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.282244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.282272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.282396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.282552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.282580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.282740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.282833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.282858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.282996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.283152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.283181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.283283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.283413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.283438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.283514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.283640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.283665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.283783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.283920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.283947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.284037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.284168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.284193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.284311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.284398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.284424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.284509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.284631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.284660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.284814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.284966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.284993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.285156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.285277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.285302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.285447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.285578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.285607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.285778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.285918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.285943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.286061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.286176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.286202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.286363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.286498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.286530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.286702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.286816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.286844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.286959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.287100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.287126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.287222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.287345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.287372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.287477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.287612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.828 [2024-11-27 03:25:21.287638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.828 qpair failed and we were unable to recover it. 00:30:18.828 [2024-11-27 03:25:21.287726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.287841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.287868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.287970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.288057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.288085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.288172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.288265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.288292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.288437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.288552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.288576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.288723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.288809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.288836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.289001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.289093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.289118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.289232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.289371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.289397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.289510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.289610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.289636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.289727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.289867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.289895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.290057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.290202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.290227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.290373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.290488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.290516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.290699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.290824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.290849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.290958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.291071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.291096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.291236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.291366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.291396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.291496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.291605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.291634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.291764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.291877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.291903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.292073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.292164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.292191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.292344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.292436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.292464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.292601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.292697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.292722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.292852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.293011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.293035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.293163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.293321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.293348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.293478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.293588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.293615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.293726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.293847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.293874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.294005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.294108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.294140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.829 [2024-11-27 03:25:21.294282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.294389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.829 [2024-11-27 03:25:21.294414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.829 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.294591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.294707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.294733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.294828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.294907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.294933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.295073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.295163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.295188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.295277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.295420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.295464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.295629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.295716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.295742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.295851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.295935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.295960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.296062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.296148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.296175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.296304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.296389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.296417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.296558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.296672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.296697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.296804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.296920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.296945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.297033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.297193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.297235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.297342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.297420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.297445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.297561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.297651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.297676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.297755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.297870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.297915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.298082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.298176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.298202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.298291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.298400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.298425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.298510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.298622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.298648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.298788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.298941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.298965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.299099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.299214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.299256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.299345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.299505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.299541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.299716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.299804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.299829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.830 qpair failed and we were unable to recover it. 00:30:18.830 [2024-11-27 03:25:21.299952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.300070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.830 [2024-11-27 03:25:21.300099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.300212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.300366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.300394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.300541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.300660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.300686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.300844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.300966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.300995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.301086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.301227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.301253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.301372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.301488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.301514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.301662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.301764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.301792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.301951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.302078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.302107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.302256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.302368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.302394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.302500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.302628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.302657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.302787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.302933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.302960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.303107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.303247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.303272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.303361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.303478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.303503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.303664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.303810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.303836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.303987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.304123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.304165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.304335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.304448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.304474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.304570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.304652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.304677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.304760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.304873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.304899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.305012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.305102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.305127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.305269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.305371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.305398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.305534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.305652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.305677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.305861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.306001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.306026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.306140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.306267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.306308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.306420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.306548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.306592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.831 qpair failed and we were unable to recover it. 00:30:18.831 [2024-11-27 03:25:21.306735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.306845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.831 [2024-11-27 03:25:21.306872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.307009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.307183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.307208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.307330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.307448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.307474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.307635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.307757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.307785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.307915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.308005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.308037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.308149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.308288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.308314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.308468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.308618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.308647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.308771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.308906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.308931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.309049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.309195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.309219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.309357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.309514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.309584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.309720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.309836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.309862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.309976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.310061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.310087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.310195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.310304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.310329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.310462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.310569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.310595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.310689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.310799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.310828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.310959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.311064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.311093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.311201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.311288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.311316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.311425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.311539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.311564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.311651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.311785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.311814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.311936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.312078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.312103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.312219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.312326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.312351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.312440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.312560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.312602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.832 [2024-11-27 03:25:21.312752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.312866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.832 [2024-11-27 03:25:21.312892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.832 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.313010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.313126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.313151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.313283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.313420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.313462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.313582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.313702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.313728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.313812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.313926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.313952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.314067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.314200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.314229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.314382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.314508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.314543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.314679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.314768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.314792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.314926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.315053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.315078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.315156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.315239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.315265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.315371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.315522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.315554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.315729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.315815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.315840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.315933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.316041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.316067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.316211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.316295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.316320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.316432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.316522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.316573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.316702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.316826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.316850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.316972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.317107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.317131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.317249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.317353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.317383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.317507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.317669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.317696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.317812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.317931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.317956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.318049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.318162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.318190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.318292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.318425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.318450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.318616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.318732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.318758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.318875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.318971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.318996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.319111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.319248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.319275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.319413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.319522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.833 [2024-11-27 03:25:21.319553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.833 qpair failed and we were unable to recover it. 00:30:18.833 [2024-11-27 03:25:21.319669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.319781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.319808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.319927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.320045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.320073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.320183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.320291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.320316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.320403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.320539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.320567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.320723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.320825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.320855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.320991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.321098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.321124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.321221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.321350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.321379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.321515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.321682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.321711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.321845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.321923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.321948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.322092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.322186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.322214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.322364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.322506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.322540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.322664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.322746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.322772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.322919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.323048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.323075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.323253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.323337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.323362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.323480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.323588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.323614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.323731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.323888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.323916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.324013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.324135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.324163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.324274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.324352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.324382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.324520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.324652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.324682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.324802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.324935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.324962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.325095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.325212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.325237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.325353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.325442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.325467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.834 [2024-11-27 03:25:21.325555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.325639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.834 [2024-11-27 03:25:21.325665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.834 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.325848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.325966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.325992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.326125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.326248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.326276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.326407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.326492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.326520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.326660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.326744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.326769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.326887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.327003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.327028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.327205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.327295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.327321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.327428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.327574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.327599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.327712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.327871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.327899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.328018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.328143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.328172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.328307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.328394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.328420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.328583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.328678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.328706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.328848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.328934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.328961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.329102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.329214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.329240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.329330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.329415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.329440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.329532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.329648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.329691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.329858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.329975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.330000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.330112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.330237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.330266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.330363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.330480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.330508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.330638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.330726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.330751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.330836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.330941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.330967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.331099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.331216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.331245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.835 qpair failed and we were unable to recover it. 00:30:18.835 [2024-11-27 03:25:21.331362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.835 [2024-11-27 03:25:21.331445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.331470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.331555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.331689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.331718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.331821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.331945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.331973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.332090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.332167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.332192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.332336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.332425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.332451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.332568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.332702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.332730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.332843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.332921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.332946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.333055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.333174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.333200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.333284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.333423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.333451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.333557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.333642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.333668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.333747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.333845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.333874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.334027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.334155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.334183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.334295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.334449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.334474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.334568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.334710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.334737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.334884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.334985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.335014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.335151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.335247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.335272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.335390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.335465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.335490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.335596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.335688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.335713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.335832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.335970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.335995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.336138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.336250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.336276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.336372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.336482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.336507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.336625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.336743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.336769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.336915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.337004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.337048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.836 qpair failed and we were unable to recover it. 00:30:18.836 [2024-11-27 03:25:21.337170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.836 [2024-11-27 03:25:21.337296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.337325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.337492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.337647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.337697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.337848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.338000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.338028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.338156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.339254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.339289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.339461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.339587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.339613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.339701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.339833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.339862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.339961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.340061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.340090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.340206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.340323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.340348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.340482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.340601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.340628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.340719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.340851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.340879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.341044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.341133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.341160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.341296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.341407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.341433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.341521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.341647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.341673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.341787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.341882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.341907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.342020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.342152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.342180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.342300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.342447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.342474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.342630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.342749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.342774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.342917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.343022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.343049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.343207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.343296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.343325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.343429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.343520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.343556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.343680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.343807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.343835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.343995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.344118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.344148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.344280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.344369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.344395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.344476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.344592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.344617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.344739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.344857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.344885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.345057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.345161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.345187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.837 qpair failed and we were unable to recover it. 00:30:18.837 [2024-11-27 03:25:21.345306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.837 [2024-11-27 03:25:21.345425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.345466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.345543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.345641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.345666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.345756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.345851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.345875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.345984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.346074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.346099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.346185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.346317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.346346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.346485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.346616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.346642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.346761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.346866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.346894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.347023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.347115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.347143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.347286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.347414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.347439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.347621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.347733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.347758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.347850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.347935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.347961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.348053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.348169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.348194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.348322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.348444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.348472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.348614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.348760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.348785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.348928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.349069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.349109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.349203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.349323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.349366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.349491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.349632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.349659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.349750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.349838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.349864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.349982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.350068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.350093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.350175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.350319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.350344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.350437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.350551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.350593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.350680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.350771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.350796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.350917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.351057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.351085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.351193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.351309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.351334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.351498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.351633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.351658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.351778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.351910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.351935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.352046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.352188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.352217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.838 [2024-11-27 03:25:21.352370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.352497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.838 [2024-11-27 03:25:21.352560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.838 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.352675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.352812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.352842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.352956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.353058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.353083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.353206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.353325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.353353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.353446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.353577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.353603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.353729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.353827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.353852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.353986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.354082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.354111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.354212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.354318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.354347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.354456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.354596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.354622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.354735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.354864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.354907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.355026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.355140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.355166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.355282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.355362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.355386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.355508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.355613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.355639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.355722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.355813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.355846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.355960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.356068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.356093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.356253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.356350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.356378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.356479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.356586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.356612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.356725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.356828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.356854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.356965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.357092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.357119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.357257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.357403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.357428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.357590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.357678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.357704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.357820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.357921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.357949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.358049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.358171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.358198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.358308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.358418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.358445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.358536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.358658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.358683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.839 qpair failed and we were unable to recover it. 00:30:18.839 [2024-11-27 03:25:21.358770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.839 [2024-11-27 03:25:21.358954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.358979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.359071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.359192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.359217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.359335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.359476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.359518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.359630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.359742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.359767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.359857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.359981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.360006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.360125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.360243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.360285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.360441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.360535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.360589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.360705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.360786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.360816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.360928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.361060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.361087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.361240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.361378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.361404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.361516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.361639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.361664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.361749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.361866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.361891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.361966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.362080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.362105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.362218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.362335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.362361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.362441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.362583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.362610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.362700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.362841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.362869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.363013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.363127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.363152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.363242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.363357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.363398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.363520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.363661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.363687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.363778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.363923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.363947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.364085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.364219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.364245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.364387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.364532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.364560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.364678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.364761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.364787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.364880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.364994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.365022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.365131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.365249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.365295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.365437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.365550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.365587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.840 qpair failed and we were unable to recover it. 00:30:18.840 [2024-11-27 03:25:21.365724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.365821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.840 [2024-11-27 03:25:21.365849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.365978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.366145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.366170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.366287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.366403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.366428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.366540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.366636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.366678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.366769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.366889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.366930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.367048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.367130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.367156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.367277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.367372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.367397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.367482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.367620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.367646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.367758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.367852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.367877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.367989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.368076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.368105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.368230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.368312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.368337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.368425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.368564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.368590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.368686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.368776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.368816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.368922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.369052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.369077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.369165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.369281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.369306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.369485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.369644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.369671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.369810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.369906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.369934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.370041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.370157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.370183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.370309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.370462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.370490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.370604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.370704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.370731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.370859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.370998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.371023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.371172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.371259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.371283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.371367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.371474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.371500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.371640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.371738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.371764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.371864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.371950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.371978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.372097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.372228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.372255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.372389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.372474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.372499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.372612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.372736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.372760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.372853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.372991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.841 [2024-11-27 03:25:21.373032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.841 qpair failed and we were unable to recover it. 00:30:18.841 [2024-11-27 03:25:21.373179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.373275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.373300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.373426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.373578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.373607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.373759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.373882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.373911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.374012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.374150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.374175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.374277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.374396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.374421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.374500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.374609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.374635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.374727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.374827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.374852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.374938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.375028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.375053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.375167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.375275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.375302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.375496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.375632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.375657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.375776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.375889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.375917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.376045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.376153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.376182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.376305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.376382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.376407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.376485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.376573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.376599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.376710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.376791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.376819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.376922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.377129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.377379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.377616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.377804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.377977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.378090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.378209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.378252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.378371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.378463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.378488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.378639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.378727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.378753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.378844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.379033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.379058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.379174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.379260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.379285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.379381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.379459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.379483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.379612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.379706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.379748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.379881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.379990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.380015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.380116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.380233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.380258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.842 qpair failed and we were unable to recover it. 00:30:18.842 [2024-11-27 03:25:21.380362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.380491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.842 [2024-11-27 03:25:21.380532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.380673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.380786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.380813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.380898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.381012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.381058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.381158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.381256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.381284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.381462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.381582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.381608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.381697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.381811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.381836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.381976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.382132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.382160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.382272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.382415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.382440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.382548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.382678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.382710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.382814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.382929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.382957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.383057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.383141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.383167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.383255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.383363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.383394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.383501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.383641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.383666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.383789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.383875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.383900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.384011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.384158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.384182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.384302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.384420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.384445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.384538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.385566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.385603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.385745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.385870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.385912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.386059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.386192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.386219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.386361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.386442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.386468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.386554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.386695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.386725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.386887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.386983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.387016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.387135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.387260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.387287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:18.843 [2024-11-27 03:25:21.387398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.387507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:18.843 [2024-11-27 03:25:21.387544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:18.843 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.387647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.387744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.387772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.387882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.388123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.388352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.388572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.388808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.388946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.389048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.389173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.389200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.389301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.389429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.389457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.389551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.389678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.389704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.389820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.389906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.389949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.390127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.390229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.390259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.126 [2024-11-27 03:25:21.390351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.390440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.126 [2024-11-27 03:25:21.390468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.126 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.390619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.390737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.390763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.390852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.390971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.390997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.391081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.391189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.391219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.391330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.391422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.391450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.391549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.391655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.391680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.391794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.391902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.391928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.392071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.392153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.392195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.392282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.392390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.392418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.392532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.392620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.392646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.392727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.392817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.392843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.392957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.393069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.393094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.393198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.393290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.393331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.393440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.393595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.393621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.393712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.393799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.393825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.393981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.394070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.394095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.394253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.394361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.394390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.394493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.394654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.394681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.394805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.394960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.395007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.395137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.395230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.395257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.395386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.395510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.395549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.395664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.395782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.395808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.395919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.396028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.396070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.396181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.396342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.396371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.396540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.396638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.396664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.396756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.396910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.396938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.397092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.397236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.397261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.397472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.397572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.397615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.397705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.397821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.397846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.127 qpair failed and we were unable to recover it. 00:30:19.127 [2024-11-27 03:25:21.397971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.398106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.127 [2024-11-27 03:25:21.398134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.398237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.398356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.398384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.398515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.398685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.398710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.398800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.398928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.398955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.399053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.399135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.399163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.399284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.399387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.399416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.399559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.399644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.399669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.399774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.399872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.399902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.400024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.400145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.400173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.400295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.400388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.400430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.400550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.400631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.400656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.400765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.400852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.400895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.401021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.401138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.401166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.401297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.401425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.401453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.401582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.401723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.401748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.401867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.401959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.401987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.402122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.402263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.402291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.402393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.402519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.402571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.402666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.402754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.402778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.402892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.403017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.403046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.403155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.403252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.403279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.403388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.403500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.403550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.403663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.403753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.403778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.403918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.404156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.404380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.404597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.404823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.404944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.405062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.405169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.405194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.405311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.405400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.405425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.405520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.405609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.405635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.405755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.405910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.128 [2024-11-27 03:25:21.405938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.128 qpair failed and we were unable to recover it. 00:30:19.128 [2024-11-27 03:25:21.406040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.406166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.406194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.406330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.406449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.406474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.406593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.406705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.406730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.406846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.406939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.406967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.407087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.407183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.407211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.407411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.407519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.407552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.407637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.407729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.407754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.407844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.407983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.408011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.408113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.408204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.408251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.408372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.408485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.408510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.408602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.408687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.408712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.408837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.408943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.408968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.409134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.409285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.409313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.409423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.409544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.409570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.409650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.409734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.409759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.409871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.409999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.410027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.410119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.410245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.410270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.410355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.410438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.410462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.410574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.410667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.410697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.410835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.411002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.411028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.411170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.411264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.411307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.411386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.411502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.411558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.411678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.411800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.411826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.411944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.412172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.412363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.412587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.412796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.412934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.413072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.413182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.413208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.413300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.413392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.413416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.413507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.413614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.129 [2024-11-27 03:25:21.413639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.129 qpair failed and we were unable to recover it. 00:30:19.129 [2024-11-27 03:25:21.413723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.413809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.413836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.413963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.414148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.414384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.414594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.414864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.414976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.415088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.415217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.415243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.415366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.415481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.415506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.415618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.415712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.415737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.415856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.415965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.415990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.416101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.416231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.416257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.416351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.416437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.416462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.416553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.416640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.416666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.416754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.416867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.416893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.417008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.417123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.417148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.417264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.417374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.417399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.417534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.417627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.417652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.417731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.417860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.417885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.418001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.418268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.418463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.418671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.418890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.418998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.419087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.419175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.419199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.419284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.419372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.419396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.419501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.419617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.419647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.130 [2024-11-27 03:25:21.419735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.419818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.130 [2024-11-27 03:25:21.419844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.130 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.419963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.420055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.420082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.420173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.420290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.420317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.420434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.420533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.420560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.420650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.420737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.420763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.420913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.421122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.421367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.421562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.421762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.421869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.421957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.422222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.422406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.422644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.422877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.422991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.423067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.423154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.423179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.423309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.423385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.423410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.423501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.423593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.423619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.423714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.423803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.423828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.423948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.424054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.424079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.424193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.424276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.424301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.424396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.424476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.424501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.424639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.424727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.424753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.424880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.424973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.425000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.425085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.425169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.425194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.425308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.425395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.425421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.425500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.425586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.425612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.425702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.425794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.425819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.425912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.426000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.426025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.426116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.426259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.426284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.426368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.426449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.131 [2024-11-27 03:25:21.426474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.131 qpair failed and we were unable to recover it. 00:30:19.131 [2024-11-27 03:25:21.426567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.426656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.426681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.426768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.426881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.426907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.427032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.427226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.427252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.427370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.427477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.427502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.427607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.427718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.427747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.427848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.427989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.428016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.428171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.428287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.428312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.428437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.428530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.428557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.428639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.428721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.428746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.428834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.428977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.429002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.429124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.429212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.429239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.429327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.429412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.429438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.429564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.429648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.429675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.429766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.429888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.429914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.430000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.430222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.430422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.430627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.430870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.430985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.431080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.431195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.431221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.431336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.431418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.431444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.431559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.431648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.431675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.431797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.431906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.431932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.432044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.432135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.432161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.432247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.432362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.432389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.432482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.432569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.432596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.432692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.432788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.432814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.432928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.433043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.433069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.433148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.433233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.433260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.433384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.433481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.433507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.433610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.433692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.433718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.132 qpair failed and we were unable to recover it. 00:30:19.132 [2024-11-27 03:25:21.433838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.132 [2024-11-27 03:25:21.433929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.433960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.434077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.434241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.434270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.434384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.434509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.434548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.434641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.434731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.434756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.434841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.434957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.434983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.435078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.435156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.435182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.435295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.435401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.435427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.435551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.435640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.435667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.435761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.435851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.435877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.435959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.436094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.436121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.436203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.436355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.436380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.436469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.436565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.436591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.436682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.436761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.436786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.436862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.436978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.437003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.437082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.437192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.437217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.437332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.437455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.437480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.437569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.437687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.437713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.437828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.437944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.437970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.438070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.438183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.438208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.438328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.438412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.438437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.438557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.438639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.438664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.438783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.438901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.438928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.439017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.439140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.439165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.439283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.439397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.439422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.439505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.439598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.439625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.439738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.439900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.439928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.440040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.440153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.440179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.440293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.440412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.440437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.440532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.440630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.440656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.440772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.440895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.440921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.441045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.441131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.441156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.133 [2024-11-27 03:25:21.441238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.441333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.133 [2024-11-27 03:25:21.441359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.133 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.441502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.441597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.441622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.441711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.441800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.441825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.441920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.442033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.442059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.442170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.442257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.442283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.442403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.442520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.442560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.442657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.442766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.442793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.442906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.442991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.443028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.443128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.443236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.443261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.443348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.443464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.443490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.443587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.443686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.443712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.443825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.443944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.443970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.444048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.444135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.444160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.444254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.444397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.444422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.444545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.444641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.444666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.444753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.444834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.444861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.444970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.445057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.445083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.445172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.445291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.445317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.445437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.445576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.445602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.445760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.445876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.445901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.445992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.446105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.446137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.446282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.446397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.446422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.446506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.446635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.446661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.446749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.446889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.446918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.447051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.447165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.447191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.447274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.447479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.447507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.447621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.447766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.447791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.447875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.448015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.448041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.448125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.448241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.448266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.448395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.448505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.448541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.448658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.448772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.448803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.448915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.449056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.449081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.134 qpair failed and we were unable to recover it. 00:30:19.134 [2024-11-27 03:25:21.449171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.134 [2024-11-27 03:25:21.449359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.449385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.449507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.449627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.449653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.449803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.449958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.449987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.450089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.450225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.450250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.450360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.450469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.450495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.450612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.450724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.450753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.450856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.450976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.451005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.451166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.451257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.451282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.451417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.451551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.451582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.451664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.451810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.451836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.451982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.452185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.452398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.452645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.452824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.452956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.453095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.453215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.453243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.453385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.453537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.453564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.453646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.453739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.453765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.453876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.454005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.454038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.454175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.454256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.454282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.454381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.454523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.454576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.454665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.454781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.454807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.454898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.454985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.455011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.455119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.455235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.455261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.455377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.455507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.455544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.455668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.455749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.455776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.455883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.455980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.456007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.456094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.456227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.135 [2024-11-27 03:25:21.456253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.135 qpair failed and we were unable to recover it. 00:30:19.135 [2024-11-27 03:25:21.456362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.456447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.456473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.456676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.456794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.456819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.456941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.457170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.457382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.457621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.457875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.457991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.458087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.458174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.458203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.458297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.458408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.458434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.458566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.458678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.458703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.458789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.458975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.459000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.459123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.459217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.459242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.459385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.459499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.459531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.459636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.459726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.459751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.459879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.459964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.459989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.460125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.460224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.460250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.460362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.460449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.460474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.460572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.460655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.460681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.460774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.460858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.460883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.460994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.461076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.461107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.461193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.461300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.461325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.461422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.461521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.461559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.461679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.461757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.461785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.461917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.462022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.462058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.462162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.462276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.462301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.462436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.462606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.462639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.462741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.462876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.462904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.463057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.463147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.463173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.463286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.463371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.463398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.463517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.463609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.463636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.463727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.463842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.463869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.136 qpair failed and we were unable to recover it. 00:30:19.136 [2024-11-27 03:25:21.463987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.136 [2024-11-27 03:25:21.464104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.464130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.464213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.464298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.464324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.464413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.464531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.464558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.464648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.464738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.464765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.464918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.465175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.465409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.465616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.465825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.465939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.466038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.466133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.466159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.466281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.466364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.466390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.466509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.466610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.466639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.466728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.466856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.466882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.467006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.467097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.467124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.467242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.467384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.467410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.467521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.467622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.467648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.467741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.467823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.467850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.467976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.468118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.468145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.468292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.468436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.468462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.468565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.468658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.468684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.468798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.468922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.468949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.469038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.469128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.469155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.469305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.469392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.469420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.469542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.469627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.469654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.469741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.469859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.469885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.469972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.470235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.470461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.470680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.470874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.470995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.471107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.471201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.471228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.137 [2024-11-27 03:25:21.471308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.471383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.137 [2024-11-27 03:25:21.471410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:19.137 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.471513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.471629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.471657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.471751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.471836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.471864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.471980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.472087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.472113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.472255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.472338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.472364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.472462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.472566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.472595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.472698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.472781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.472807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.472892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.472984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.473010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.473096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.473239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.473265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.473403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.473523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.473560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.473645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.473775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.473809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.473898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.474102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.474142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.474281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.474430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.474459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.474561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.474644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.474670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.474781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.474888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.474916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.475046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.475187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.475212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.475339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.475453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.475478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.475595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.475685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.475711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.475795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.475936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.475966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.476087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.476211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.476239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.476399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.476491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.476539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.476665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.476778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.476819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.476936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.477059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.477084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.477255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.477383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.477423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.477510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.477634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.477659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.477772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.477898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.477927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.478025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.478131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.478161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.478265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.478387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.478416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.478553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.478640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.478665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.478777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.478950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.478978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.479115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.479247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.479275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.479512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.479636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.479661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.138 qpair failed and we were unable to recover it. 00:30:19.138 [2024-11-27 03:25:21.479740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.138 [2024-11-27 03:25:21.479905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.479942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.480087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.480230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.480275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.480445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.480588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.480614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.480708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.480822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.480847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.480955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.481062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.481090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.481214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.481338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.481379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.481501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.481587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.481613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.481723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.481857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.481885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.482073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.482189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.482217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.482310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.482455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.482480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.482645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.482726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.482752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.482872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.482984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.483010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.483102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.483242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.483285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.483439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.483578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.483604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.483721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.483833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.483861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.483965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.484096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.484124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.484248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.484397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.484425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.484535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.484626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.484651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.484770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.484939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.484968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.485099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.485226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.485253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.485402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.485518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.485551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.485692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.485777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.485802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.485920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.485999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.486025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.486155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.486264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.486292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.486418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.486582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.486608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.486704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.486797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.486839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.139 qpair failed and we were unable to recover it. 00:30:19.139 [2024-11-27 03:25:21.486972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.139 [2024-11-27 03:25:21.487111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.487139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.487244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.487366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.487393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.487502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.487642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.487671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.487781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.487871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.487896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.488042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.488170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.488198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.488327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.488445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.488472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.488609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.488706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.488731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.488854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.488960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.488985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.489098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.489201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.489243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.489433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.489533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.489561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.489717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.489805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.489849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.489969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.490066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.490093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.490198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.490306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.490338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.490448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.490538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.490564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.490649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.490810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.490853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.490988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.491111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.491155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.491244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.491329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.491357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.491476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.491599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.491625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.491769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.491881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.491905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.492030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.492134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.492161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.492296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.492399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.492426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.492537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.492627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.492652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.492796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.492943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.492983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.493104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.493221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.493246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.493335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.493422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.493447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.493614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.493717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.493744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.493862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.494000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.494024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.494167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.494256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.494282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.494417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.494510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.494546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.494634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.494728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.140 [2024-11-27 03:25:21.494755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.140 qpair failed and we were unable to recover it. 00:30:19.140 [2024-11-27 03:25:21.494887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.494976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.495001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.495113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.495226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.495250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.495332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.495471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.495496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.495618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.495734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.495758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.495847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.495940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.495966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.496080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.496167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.496210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.496311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.496444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.496472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.496639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.496754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.496779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.496891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.497026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.497051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.497172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.497287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.497313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.497444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.497586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.497612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.497726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.497834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.497859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.497964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.498113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.498138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.498251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.498383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.498411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.498567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.498696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.498723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.498835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.498947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.498971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.499065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.499205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.499230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.499313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.499457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.499485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.499624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.499741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.499767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.499897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.500029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.500057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.500181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.500285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.500326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.500411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.500530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.500555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.500660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.500778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.500805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.500905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.501007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.501034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.501147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.501257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.501282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.501422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.501555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.501584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.501683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.501817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.501842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.501960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.502079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.502104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.502249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.502364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.502389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.502477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.502637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.502663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.502779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.502859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.502884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.141 qpair failed and we were unable to recover it. 00:30:19.141 [2024-11-27 03:25:21.502972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.503059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.141 [2024-11-27 03:25:21.503083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.503204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.503381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.503406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.503519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.503634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.503663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.503777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.503887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.503915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.504018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.504135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.504180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.504271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.504412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.504436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.504531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.504669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.504696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.504821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.504977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.505004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.505168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.505289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.505313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.505433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.505564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.505593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.505712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.505871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.505899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.506061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.506151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.506176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.506263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.506368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.506393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.506519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.506642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.506668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.506780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.506866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.506890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.506985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.507077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.507104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.507202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.507338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.507366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.507485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.507623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.507648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.507735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.507898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.507926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.508096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.508185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.508210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.508348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.508487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.508514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.508615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.508731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.508756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.508873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.509013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.509038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.509185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.509291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.509315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.509475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.509567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.509595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.509686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.509773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.509802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.509944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.510041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.510066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.510210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.510386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.510411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.510530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.510634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.510659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.510779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.510869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.510894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.510994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.511127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.511155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.511286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.511414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.511438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.142 qpair failed and we were unable to recover it. 00:30:19.142 [2024-11-27 03:25:21.511588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.142 [2024-11-27 03:25:21.511683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.511708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.511796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.511982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.512010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.512141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.512259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.512286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.512393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.512481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.512506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.512633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.512720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.512744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.512844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.512941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.512965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.513096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.513176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.513201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.513314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.513402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.513442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.513575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.513694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.513719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.513836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.513918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.513944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.514054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.514162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.514186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.514304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.514411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.514438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.514595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.514680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.514705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.514828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.515000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.515025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.515121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.515200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.515225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.515340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.515454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.515478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.515650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.515741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.515767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.515880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.516048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.516073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.516186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.516303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.516328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.516437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.516563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.516591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.516723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.516846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.516874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.517033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.517178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.517207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.517326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.517511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.517543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.517660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.517796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.517822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.517963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.518103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.518128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.518271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.518396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.518423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.518589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.518701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.518726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.518847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.518964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.518989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.143 qpair failed and we were unable to recover it. 00:30:19.143 [2024-11-27 03:25:21.519093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.519218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.143 [2024-11-27 03:25:21.519260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.519339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.519457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.519483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.519640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.519734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.519759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.519897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.520016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.520044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.520147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.520285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.520311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.520426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.520544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.520570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.520713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.520843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.520871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.521001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.521096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.521124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.521268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.521377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.521401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.521517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.521692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.521717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.521796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.521915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.521939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.522049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.522141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.522166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.522294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.522385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.522414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.522505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.522645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.522671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.522795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.522905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.522930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.523086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.523204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.523232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.523335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.523455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.523483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.523644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.523787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.523813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.523952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.524076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.524103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.524266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.524406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.524431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.524542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.524634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.524658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.524756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.524885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.524920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.525043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.525164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.525192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.525333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.525412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.525437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.525603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.525757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.525785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.525876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.525969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.526011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.526119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.526207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.526232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.526310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.526398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.526423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.526506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.526627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.526661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.526772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.526851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.526877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.526989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.527130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.527158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.527248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.527362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.144 [2024-11-27 03:25:21.527389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.144 qpair failed and we were unable to recover it. 00:30:19.144 [2024-11-27 03:25:21.527520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.527669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.527693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.527827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.528006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.528031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.528149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.528266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.528291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.528404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.528494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.528518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.528627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.528721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.528765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.528898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.529037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.529061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.529178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.529293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.529317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.529458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.529626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.529652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.529741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.529827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.529852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.530007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.530120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.530145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.530291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.530452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.530480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.530620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.530712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.530737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.530850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.530997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.531026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.531135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.531262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.531289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.531411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.531556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.531584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.531692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.531844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.531869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.531982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.532087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.532113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.532201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.532294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.532318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.532410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.532531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.532556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.532684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.532852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.532877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.532961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.533075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.533099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.145 qpair failed and we were unable to recover it. 00:30:19.145 [2024-11-27 03:25:21.533192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.533306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.145 [2024-11-27 03:25:21.533331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.146 [2024-11-27 03:25:21.533450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.533589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.533619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.146 [2024-11-27 03:25:21.533725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.533822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.533849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.146 [2024-11-27 03:25:21.533960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.534053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.534077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.146 [2024-11-27 03:25:21.534212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.534300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.534328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.146 [2024-11-27 03:25:21.534453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.534566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.534608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.146 [2024-11-27 03:25:21.534725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.534837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.534871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.146 [2024-11-27 03:25:21.534972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.535088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.535115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.146 [2024-11-27 03:25:21.535211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.535339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.535363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.146 [2024-11-27 03:25:21.535515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.535651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.146 [2024-11-27 03:25:21.535675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.146 qpair failed and we were unable to recover it. 00:30:19.147 [2024-11-27 03:25:21.535793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.535904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.535931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.147 qpair failed and we were unable to recover it. 00:30:19.147 [2024-11-27 03:25:21.536056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.536150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.536177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.147 qpair failed and we were unable to recover it. 00:30:19.147 [2024-11-27 03:25:21.536327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.536423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.536448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.147 qpair failed and we were unable to recover it. 00:30:19.147 [2024-11-27 03:25:21.536552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.536678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.536705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.147 qpair failed and we were unable to recover it. 00:30:19.147 [2024-11-27 03:25:21.536834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.536957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.536984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.147 qpair failed and we were unable to recover it. 00:30:19.147 [2024-11-27 03:25:21.537125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.537211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.537235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.147 qpair failed and we were unable to recover it. 00:30:19.147 [2024-11-27 03:25:21.537354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.537485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.537512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.147 qpair failed and we were unable to recover it. 00:30:19.147 [2024-11-27 03:25:21.537654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.537759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.147 [2024-11-27 03:25:21.537788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.148 qpair failed and we were unable to recover it. 00:30:19.148 [2024-11-27 03:25:21.537918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.538033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.538059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.148 qpair failed and we were unable to recover it. 00:30:19.148 [2024-11-27 03:25:21.538168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.538328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.538353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.148 qpair failed and we were unable to recover it. 00:30:19.148 [2024-11-27 03:25:21.538480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.538591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.538620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.148 qpair failed and we were unable to recover it. 00:30:19.148 [2024-11-27 03:25:21.538721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.538835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.538861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.148 qpair failed and we were unable to recover it. 00:30:19.148 [2024-11-27 03:25:21.539012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.539168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.539192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.148 qpair failed and we were unable to recover it. 00:30:19.148 [2024-11-27 03:25:21.539356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.539479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.539506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.148 qpair failed and we were unable to recover it. 00:30:19.148 [2024-11-27 03:25:21.539700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.539814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.539839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.148 qpair failed and we were unable to recover it. 00:30:19.148 [2024-11-27 03:25:21.539973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.148 [2024-11-27 03:25:21.540076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.540103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.149 qpair failed and we were unable to recover it. 00:30:19.149 [2024-11-27 03:25:21.540238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.540354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.540379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.149 qpair failed and we were unable to recover it. 00:30:19.149 [2024-11-27 03:25:21.540494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.540594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.540621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.149 qpair failed and we were unable to recover it. 00:30:19.149 [2024-11-27 03:25:21.540732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.540816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.540856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.149 qpair failed and we were unable to recover it. 00:30:19.149 [2024-11-27 03:25:21.540988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.541109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.541138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.149 qpair failed and we were unable to recover it. 00:30:19.149 [2024-11-27 03:25:21.541276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.541365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.541389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.149 qpair failed and we were unable to recover it. 00:30:19.149 [2024-11-27 03:25:21.541503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.541635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.541675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.149 qpair failed and we were unable to recover it. 00:30:19.149 [2024-11-27 03:25:21.541802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.541937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.541965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.149 qpair failed and we were unable to recover it. 00:30:19.149 [2024-11-27 03:25:21.542075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.542164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.542188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.149 qpair failed and we were unable to recover it. 00:30:19.149 [2024-11-27 03:25:21.542277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.149 [2024-11-27 03:25:21.542388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.542413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.150 qpair failed and we were unable to recover it. 00:30:19.150 [2024-11-27 03:25:21.542552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.542663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.542689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.150 qpair failed and we were unable to recover it. 00:30:19.150 [2024-11-27 03:25:21.542824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.542911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.542935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.150 qpair failed and we were unable to recover it. 00:30:19.150 [2024-11-27 03:25:21.543014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.543130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.543154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.150 qpair failed and we were unable to recover it. 00:30:19.150 [2024-11-27 03:25:21.543271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.543383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.543408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.150 qpair failed and we were unable to recover it. 00:30:19.150 [2024-11-27 03:25:21.543521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.543653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.543677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.150 qpair failed and we were unable to recover it. 00:30:19.150 [2024-11-27 03:25:21.543796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.543949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.543979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.150 qpair failed and we were unable to recover it. 00:30:19.150 [2024-11-27 03:25:21.544142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.544283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.544308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.150 qpair failed and we were unable to recover it. 00:30:19.150 [2024-11-27 03:25:21.544424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.544546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.150 [2024-11-27 03:25:21.544572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.150 qpair failed and we were unable to recover it. 00:30:19.151 [2024-11-27 03:25:21.544664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.544754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.544798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.151 qpair failed and we were unable to recover it. 00:30:19.151 [2024-11-27 03:25:21.544919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.545020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.545048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.151 qpair failed and we were unable to recover it. 00:30:19.151 [2024-11-27 03:25:21.545192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.545303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.545328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.151 qpair failed and we were unable to recover it. 00:30:19.151 [2024-11-27 03:25:21.545464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.545563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.545597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.151 qpair failed and we were unable to recover it. 00:30:19.151 [2024-11-27 03:25:21.545717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.545843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.545871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.151 qpair failed and we were unable to recover it. 00:30:19.151 [2024-11-27 03:25:21.545991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.546107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.546133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.151 qpair failed and we were unable to recover it. 00:30:19.151 [2024-11-27 03:25:21.546262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.546352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.546395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.151 qpair failed and we were unable to recover it. 00:30:19.151 [2024-11-27 03:25:21.546547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.151 [2024-11-27 03:25:21.546637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.546662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.152 qpair failed and we were unable to recover it. 00:30:19.152 [2024-11-27 03:25:21.546752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.546892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.546918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.152 qpair failed and we were unable to recover it. 00:30:19.152 [2024-11-27 03:25:21.547058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.547182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.547213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.152 qpair failed and we were unable to recover it. 00:30:19.152 [2024-11-27 03:25:21.547368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.547468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.547493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.152 qpair failed and we were unable to recover it. 00:30:19.152 [2024-11-27 03:25:21.547596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.547710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.547736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.152 qpair failed and we were unable to recover it. 00:30:19.152 [2024-11-27 03:25:21.547852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.547940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.547984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.152 qpair failed and we were unable to recover it. 00:30:19.152 [2024-11-27 03:25:21.548085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.548205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.548234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.152 qpair failed and we were unable to recover it. 00:30:19.152 [2024-11-27 03:25:21.548394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.548505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.152 [2024-11-27 03:25:21.548537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.153 qpair failed and we were unable to recover it. 00:30:19.153 [2024-11-27 03:25:21.548656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.548792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.548817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.153 qpair failed and we were unable to recover it. 00:30:19.153 [2024-11-27 03:25:21.548909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.549023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.549048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.153 qpair failed and we were unable to recover it. 00:30:19.153 [2024-11-27 03:25:21.549163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.549287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.549311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.153 qpair failed and we were unable to recover it. 00:30:19.153 [2024-11-27 03:25:21.549427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.549572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.549613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.153 qpair failed and we were unable to recover it. 00:30:19.153 [2024-11-27 03:25:21.549709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.549794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.549836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.153 qpair failed and we were unable to recover it. 00:30:19.153 [2024-11-27 03:25:21.549950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.550063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.550087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.153 qpair failed and we were unable to recover it. 00:30:19.153 [2024-11-27 03:25:21.550181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.550295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.153 [2024-11-27 03:25:21.550321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.154 qpair failed and we were unable to recover it. 00:30:19.154 [2024-11-27 03:25:21.550413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.154 [2024-11-27 03:25:21.550533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.154 [2024-11-27 03:25:21.550578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.154 qpair failed and we were unable to recover it. 00:30:19.154 [2024-11-27 03:25:21.550723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.154 [2024-11-27 03:25:21.550838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.550863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.155 qpair failed and we were unable to recover it. 00:30:19.155 [2024-11-27 03:25:21.551002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.551171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.551195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.155 qpair failed and we were unable to recover it. 00:30:19.155 [2024-11-27 03:25:21.551286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.551375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.551400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.155 qpair failed and we were unable to recover it. 00:30:19.155 [2024-11-27 03:25:21.551488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.551599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.551625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.155 qpair failed and we were unable to recover it. 00:30:19.155 [2024-11-27 03:25:21.551723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.551811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.551836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.155 qpair failed and we were unable to recover it. 00:30:19.155 [2024-11-27 03:25:21.551975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.552130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.552159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.155 qpair failed and we were unable to recover it. 00:30:19.155 [2024-11-27 03:25:21.552294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.552437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.552462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.155 qpair failed and we were unable to recover it. 00:30:19.155 [2024-11-27 03:25:21.552594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.552695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.155 [2024-11-27 03:25:21.552722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.155 qpair failed and we were unable to recover it. 00:30:19.156 [2024-11-27 03:25:21.552822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.552977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.553004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.156 qpair failed and we were unable to recover it. 00:30:19.156 [2024-11-27 03:25:21.553118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.553230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.553254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.156 qpair failed and we were unable to recover it. 00:30:19.156 [2024-11-27 03:25:21.553376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.553464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.553488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.156 qpair failed and we were unable to recover it. 00:30:19.156 [2024-11-27 03:25:21.553630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.553769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.553795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.156 qpair failed and we were unable to recover it. 00:30:19.156 [2024-11-27 03:25:21.553920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.554034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.554058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.156 qpair failed and we were unable to recover it. 00:30:19.156 [2024-11-27 03:25:21.554203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.554319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.554347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.156 qpair failed and we were unable to recover it. 00:30:19.156 [2024-11-27 03:25:21.554476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.554583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.554610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.156 qpair failed and we were unable to recover it. 00:30:19.156 [2024-11-27 03:25:21.554747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.554886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.554911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.156 qpair failed and we were unable to recover it. 00:30:19.156 [2024-11-27 03:25:21.555044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.555136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.156 [2024-11-27 03:25:21.555163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.555325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.555433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.555461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.555605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.555701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.555726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.555815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.555905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.555929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.556078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.556208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.556232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.556348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.556501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.556536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.556672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.556835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.556863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.556966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.557095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.557123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.557224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.557318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.557343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.557477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.557573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.557601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.557691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.557784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.557826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.557966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.558053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.558078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.157 [2024-11-27 03:25:21.558203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.558342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.157 [2024-11-27 03:25:21.558370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.157 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.558500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.558635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.558660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.158 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.558747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.558838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.558862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.158 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.558944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.559115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.559143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.158 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.559269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.559369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.559397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.158 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.559552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.559649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.559674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.158 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.559760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.559844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.559868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.158 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.559959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.560062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.560089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.158 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.560198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.560288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.560313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.158 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.560462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.560559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.158 [2024-11-27 03:25:21.560591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.158 qpair failed and we were unable to recover it. 00:30:19.158 [2024-11-27 03:25:21.560715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.560840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.560865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.159 qpair failed and we were unable to recover it. 00:30:19.159 [2024-11-27 03:25:21.560976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.561051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.561076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.159 qpair failed and we were unable to recover it. 00:30:19.159 [2024-11-27 03:25:21.561164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.561318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.561342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.159 qpair failed and we were unable to recover it. 00:30:19.159 [2024-11-27 03:25:21.561443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.561541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.561570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.159 qpair failed and we were unable to recover it. 00:30:19.159 [2024-11-27 03:25:21.561687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.561779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.561803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.159 qpair failed and we were unable to recover it. 00:30:19.159 [2024-11-27 03:25:21.561893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.562031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.562074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.159 qpair failed and we were unable to recover it. 00:30:19.159 [2024-11-27 03:25:21.562185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.562349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.562376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.159 qpair failed and we were unable to recover it. 00:30:19.159 [2024-11-27 03:25:21.562507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.562648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.562673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.159 qpair failed and we were unable to recover it. 00:30:19.159 [2024-11-27 03:25:21.562763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.562905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.562929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.159 qpair failed and we were unable to recover it. 00:30:19.159 [2024-11-27 03:25:21.563050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.563201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.159 [2024-11-27 03:25:21.563226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.563346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.563422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.563447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.563556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.563671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.563696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.563809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.563917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.563945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.564087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.564182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.564206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.564353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.564444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.564472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.564581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.564686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.564714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.564832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.564947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.564972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.565087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.565191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.565233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.565354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.565479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.565507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.565670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.565790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.565814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.160 qpair failed and we were unable to recover it. 00:30:19.160 [2024-11-27 03:25:21.565959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.160 [2024-11-27 03:25:21.566100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.566127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.161 qpair failed and we were unable to recover it. 00:30:19.161 [2024-11-27 03:25:21.566252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.566411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.566435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.161 qpair failed and we were unable to recover it. 00:30:19.161 [2024-11-27 03:25:21.566563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.566683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.566707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.161 qpair failed and we were unable to recover it. 00:30:19.161 [2024-11-27 03:25:21.566794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.566910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.566934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.161 qpair failed and we were unable to recover it. 00:30:19.161 [2024-11-27 03:25:21.567083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.567172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.567199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.161 qpair failed and we were unable to recover it. 00:30:19.161 [2024-11-27 03:25:21.567314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.567403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.567427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.161 qpair failed and we were unable to recover it. 00:30:19.161 [2024-11-27 03:25:21.567515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.567661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.567689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.161 qpair failed and we were unable to recover it. 00:30:19.161 [2024-11-27 03:25:21.567824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.567920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.567947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.161 qpair failed and we were unable to recover it. 00:30:19.161 [2024-11-27 03:25:21.568106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.568200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.568225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.161 qpair failed and we were unable to recover it. 00:30:19.161 [2024-11-27 03:25:21.568344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.161 [2024-11-27 03:25:21.568431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.568473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.162 qpair failed and we were unable to recover it. 00:30:19.162 [2024-11-27 03:25:21.568614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.568779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.568804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.162 qpair failed and we were unable to recover it. 00:30:19.162 [2024-11-27 03:25:21.568919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.569008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.569033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.162 qpair failed and we were unable to recover it. 00:30:19.162 [2024-11-27 03:25:21.569167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.569284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.569310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.162 qpair failed and we were unable to recover it. 00:30:19.162 [2024-11-27 03:25:21.569436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.569537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.569581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.162 qpair failed and we were unable to recover it. 00:30:19.162 [2024-11-27 03:25:21.569699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.569787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.569811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.162 qpair failed and we were unable to recover it. 00:30:19.162 [2024-11-27 03:25:21.569927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.570007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.570033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.162 qpair failed and we were unable to recover it. 00:30:19.162 [2024-11-27 03:25:21.570197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.570327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.570355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.162 qpair failed and we were unable to recover it. 00:30:19.162 [2024-11-27 03:25:21.570464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.162 [2024-11-27 03:25:21.570578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.570604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-11-27 03:25:21.570696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.570783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.570808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-11-27 03:25:21.570925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.571042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.571070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-11-27 03:25:21.571211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.571308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.571334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-11-27 03:25:21.571445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.571556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.571582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-11-27 03:25:21.571665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.571745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.163 [2024-11-27 03:25:21.571769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.163 qpair failed and we were unable to recover it. 00:30:19.163 [2024-11-27 03:25:21.571890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.571969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.571993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-11-27 03:25:21.572140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.572252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.572280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-11-27 03:25:21.572441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.572556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.572582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-11-27 03:25:21.572681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.572768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.572794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-11-27 03:25:21.572906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.573010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.573038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-11-27 03:25:21.573140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.573256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.573281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-11-27 03:25:21.573418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.573496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.573521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.164 qpair failed and we were unable to recover it. 00:30:19.164 [2024-11-27 03:25:21.573659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.164 [2024-11-27 03:25:21.573771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.573805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-11-27 03:25:21.573940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.574047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.574072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-11-27 03:25:21.574164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.574278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.574302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-11-27 03:25:21.574402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.574561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.574587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-11-27 03:25:21.574727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.574884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.574912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-11-27 03:25:21.575051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.575171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.575196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-11-27 03:25:21.575312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.575398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.575423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-11-27 03:25:21.575556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.575710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.165 [2024-11-27 03:25:21.575736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.165 qpair failed and we were unable to recover it. 00:30:19.165 [2024-11-27 03:25:21.575825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.575968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.575994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-11-27 03:25:21.576103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.576225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.576253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-11-27 03:25:21.576348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.576446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.576475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-11-27 03:25:21.576624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.576712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.576737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-11-27 03:25:21.576819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.576957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.576999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-11-27 03:25:21.577115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.577242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.577269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-11-27 03:25:21.577399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.577488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.577514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-11-27 03:25:21.577630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.577755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.577782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.166 qpair failed and we were unable to recover it. 00:30:19.166 [2024-11-27 03:25:21.577907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.578046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.166 [2024-11-27 03:25:21.578070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.578183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.578295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.578319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.578483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.578621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.578651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.578742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.578870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.578898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.579017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.579102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.579127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.579216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.579293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.579317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.579396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.579548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.579583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.579718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.579833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.579859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.580022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.580147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.580175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.580265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.580378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.580406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.580539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.580656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.167 [2024-11-27 03:25:21.580681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.167 qpair failed and we were unable to recover it. 00:30:19.167 [2024-11-27 03:25:21.580797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.580901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.580941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-11-27 03:25:21.581057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.581168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.581210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-11-27 03:25:21.581317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.581458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.581483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-11-27 03:25:21.581629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.581731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.581759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-11-27 03:25:21.581916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.582048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.582075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-11-27 03:25:21.582193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.582284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.582309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-11-27 03:25:21.582442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.582570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.582598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.168 qpair failed and we were unable to recover it. 00:30:19.168 [2024-11-27 03:25:21.582727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.168 [2024-11-27 03:25:21.582858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-11-27 03:25:21.582887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-11-27 03:25:21.583054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-11-27 03:25:21.583161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-11-27 03:25:21.583188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-11-27 03:25:21.583277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-11-27 03:25:21.583375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-11-27 03:25:21.583400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-11-27 03:25:21.583514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-11-27 03:25:21.583655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-11-27 03:25:21.583683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-11-27 03:25:21.583797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-11-27 03:25:21.583877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.169 [2024-11-27 03:25:21.583902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.169 qpair failed and we were unable to recover it. 00:30:19.169 [2024-11-27 03:25:21.583988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-11-27 03:25:21.584129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.170 [2024-11-27 03:25:21.584154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.170 qpair failed and we were unable to recover it. 00:30:19.171 [2024-11-27 03:25:21.584288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.584414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.584441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-11-27 03:25:21.584578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.584671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.584697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-11-27 03:25:21.584821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.584903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.584949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-11-27 03:25:21.585052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.585170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.585197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-11-27 03:25:21.585302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.585457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.585482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-11-27 03:25:21.585655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.585778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.585805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-11-27 03:25:21.585945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.586053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.586077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.171 qpair failed and we were unable to recover it. 00:30:19.171 [2024-11-27 03:25:21.586160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.171 [2024-11-27 03:25:21.586272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.586296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.586390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.586491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.586519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.586699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.586803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.586831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.586974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.587063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.587088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.587226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.587338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.587370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.587547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.587696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.587721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.587885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.587965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.587990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.588102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.588241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.588266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.588392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.588502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.588555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.588677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.588762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.588787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.172 qpair failed and we were unable to recover it. 00:30:19.172 [2024-11-27 03:25:21.588898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.172 [2024-11-27 03:25:21.589051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.589079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-11-27 03:25:21.589177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.589314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.589339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-11-27 03:25:21.589454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.589551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.589577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-11-27 03:25:21.589743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.589895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.589923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-11-27 03:25:21.590013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.590149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.590178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.173 qpair failed and we were unable to recover it. 00:30:19.173 [2024-11-27 03:25:21.590300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.173 [2024-11-27 03:25:21.590385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.590410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-11-27 03:25:21.590501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.590623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.590649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-11-27 03:25:21.590751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.590878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.590906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-11-27 03:25:21.591048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.591162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.591187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-11-27 03:25:21.591304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.591430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.591459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-11-27 03:25:21.591594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.591681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.591706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-11-27 03:25:21.591829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.591951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.591976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-11-27 03:25:21.592158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.592278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.174 [2024-11-27 03:25:21.592303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.174 qpair failed and we were unable to recover it. 00:30:19.174 [2024-11-27 03:25:21.592414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.592551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.592581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-11-27 03:25:21.592714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.592802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.592828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-11-27 03:25:21.592922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.593056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.593083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-11-27 03:25:21.593181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.593329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.593356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-11-27 03:25:21.593499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.593598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.593624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-11-27 03:25:21.593787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.593930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.593956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-11-27 03:25:21.594082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.594175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.594203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-11-27 03:25:21.594339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.594422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.594446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.175 qpair failed and we were unable to recover it. 00:30:19.175 [2024-11-27 03:25:21.594564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.175 [2024-11-27 03:25:21.594714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.594739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-11-27 03:25:21.594851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.594979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.595019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-11-27 03:25:21.595134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.595247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.595272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-11-27 03:25:21.595403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.595558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.595586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-11-27 03:25:21.595691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.595810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.595853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-11-27 03:25:21.595944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.596053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.596077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-11-27 03:25:21.596219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.596330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.596354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.176 qpair failed and we were unable to recover it. 00:30:19.176 [2024-11-27 03:25:21.596483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.596632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.176 [2024-11-27 03:25:21.596657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.596767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.596871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.596896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.597008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.597237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.597468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.597665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.597855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.597993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.598130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.598212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.598237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.598369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.598464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.598492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.598614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.598724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.598749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.598858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.598966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.598991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.177 qpair failed and we were unable to recover it. 00:30:19.177 [2024-11-27 03:25:21.599103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.599182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.177 [2024-11-27 03:25:21.599207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.599297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.599385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.599410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.599596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.599686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.599710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.599857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.599982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.600011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.600111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.600260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.600288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.600402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.600487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.600514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.600627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.600770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.600798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.600898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.601009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.601034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.601147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.601253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.601278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.601439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.601577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.601603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.601720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.601830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.601858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.601999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.602084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.602109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.602227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.602319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.602361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.178 [2024-11-27 03:25:21.602458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.602553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.178 [2024-11-27 03:25:21.602585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.178 qpair failed and we were unable to recover it. 00:30:19.179 [2024-11-27 03:25:21.602718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.602831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.602856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-11-27 03:25:21.603027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.603150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.603192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-11-27 03:25:21.603283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.603395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.603440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-11-27 03:25:21.603590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.603702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.603727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-11-27 03:25:21.603855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.603955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.603983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-11-27 03:25:21.604080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.604181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.604206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.179 [2024-11-27 03:25:21.604317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.604438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.179 [2024-11-27 03:25:21.604467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.179 qpair failed and we were unable to recover it. 00:30:19.180 [2024-11-27 03:25:21.604583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.604667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.604692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-11-27 03:25:21.604811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.604942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.604970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-11-27 03:25:21.605077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.605160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.605186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-11-27 03:25:21.605281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.605381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.605408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-11-27 03:25:21.605502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.605644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.605670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-11-27 03:25:21.605788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.605900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.605925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-11-27 03:25:21.606040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.606139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.606166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.180 qpair failed and we were unable to recover it. 00:30:19.180 [2024-11-27 03:25:21.606264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.606380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.180 [2024-11-27 03:25:21.606407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.606541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.606657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.606681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.606792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.606965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.606990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.607133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.607250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.607274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.607374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.607477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.607501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.607621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.607714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.607739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.607850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.608015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.608041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.608148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.608244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.608271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.608362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.608485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.608513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.608676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.608788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.608813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.608951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.609146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.609405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.609687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.609881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.609994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.610108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.610247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.610271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.610359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.610520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.610558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.610659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.610801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.610826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.610957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.611086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.611113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.611215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.611310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.611339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.611483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.611645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.611671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.611786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.611894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.611919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.612055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.612157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.612184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.612306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.612438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.612462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.612540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.612627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.612652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.612745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.612861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.612885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.181 qpair failed and we were unable to recover it. 00:30:19.181 [2024-11-27 03:25:21.612970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.181 [2024-11-27 03:25:21.613062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.613103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.613191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.613325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.613350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.613467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.613558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.613604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.613721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.613842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.613867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.613998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.614132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.614157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.614249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.614356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.614381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.614552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.614682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.614708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.614821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.614907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.614932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.615018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.615201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.615227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.615313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.615426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.615451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.615548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.615694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.615723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.182 [2024-11-27 03:25:21.615865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.615974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.182 [2024-11-27 03:25:21.615999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.182 qpair failed and we were unable to recover it. 00:30:19.183 [2024-11-27 03:25:21.616118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.616229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.616254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-11-27 03:25:21.616348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.616493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.616537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-11-27 03:25:21.616675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.616782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.616823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-11-27 03:25:21.616960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.617043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.617067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-11-27 03:25:21.617162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.617338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.617363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.183 qpair failed and we were unable to recover it. 00:30:19.183 [2024-11-27 03:25:21.617458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.617597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.183 [2024-11-27 03:25:21.617625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-11-27 03:25:21.617754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-11-27 03:25:21.617887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-11-27 03:25:21.617913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-11-27 03:25:21.618027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-11-27 03:25:21.618167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-11-27 03:25:21.618192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-11-27 03:25:21.618304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-11-27 03:25:21.618413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.184 [2024-11-27 03:25:21.618439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.184 qpair failed and we were unable to recover it. 00:30:19.184 [2024-11-27 03:25:21.618520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.618618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.618661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-11-27 03:25:21.618754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.618896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.618924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-11-27 03:25:21.619084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.619175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.619200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-11-27 03:25:21.619317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.619439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.619463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-11-27 03:25:21.619552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.619689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.619717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-11-27 03:25:21.619856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.619936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.619961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-11-27 03:25:21.620071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.620188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.620213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.185 qpair failed and we were unable to recover it. 00:30:19.185 [2024-11-27 03:25:21.620353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.185 [2024-11-27 03:25:21.620451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.620478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-11-27 03:25:21.620624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.620738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.620763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-11-27 03:25:21.620907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.621038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.621065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-11-27 03:25:21.621191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.621307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.621331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-11-27 03:25:21.621443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.621537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.621562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-11-27 03:25:21.621693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.621785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.621825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-11-27 03:25:21.621957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.622084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.622111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-11-27 03:25:21.622221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.622337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.622361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.186 [2024-11-27 03:25:21.622480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.622693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.186 [2024-11-27 03:25:21.622720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.186 qpair failed and we were unable to recover it. 00:30:19.187 [2024-11-27 03:25:21.622863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.622975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.623000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-11-27 03:25:21.623138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.623259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.623287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-11-27 03:25:21.623399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.623512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.623570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-11-27 03:25:21.623658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.623768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.623794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-11-27 03:25:21.623935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.624090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.624117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-11-27 03:25:21.624241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.624364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.624392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-11-27 03:25:21.624495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.624594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.624619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.187 qpair failed and we were unable to recover it. 00:30:19.187 [2024-11-27 03:25:21.624717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.187 [2024-11-27 03:25:21.624831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.624856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-11-27 03:25:21.624990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.625113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.625142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-11-27 03:25:21.625290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.625413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.625440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-11-27 03:25:21.625571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.625697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.625721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-11-27 03:25:21.625856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.625983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.626010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.188 qpair failed and we were unable to recover it. 00:30:19.188 [2024-11-27 03:25:21.626114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.188 [2024-11-27 03:25:21.626214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.626243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-11-27 03:25:21.626375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.626461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.626489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-11-27 03:25:21.626604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.626719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.626744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-11-27 03:25:21.626823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.626932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.626960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-11-27 03:25:21.627111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.627233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.627273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-11-27 03:25:21.627362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.627485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.627537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-11-27 03:25:21.627677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.627766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.627791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-11-27 03:25:21.627876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.627981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.628008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.189 [2024-11-27 03:25:21.628102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.628207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.189 [2024-11-27 03:25:21.628234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.189 qpair failed and we were unable to recover it. 00:30:19.190 [2024-11-27 03:25:21.628357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.628460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.628488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-11-27 03:25:21.628598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.628736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.628761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-11-27 03:25:21.628898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.629051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.629080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-11-27 03:25:21.629189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.629305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.629330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-11-27 03:25:21.629448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.629541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.629567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-11-27 03:25:21.629708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.629823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.629848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-11-27 03:25:21.629925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.630013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.630042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.190 qpair failed and we were unable to recover it. 00:30:19.190 [2024-11-27 03:25:21.630139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.190 [2024-11-27 03:25:21.630275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.630303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-11-27 03:25:21.630430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.630560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.630589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-11-27 03:25:21.630708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.630818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.630843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-11-27 03:25:21.630934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.631019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.631044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-11-27 03:25:21.631195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.631292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.631320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.191 [2024-11-27 03:25:21.631445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.631571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.191 [2024-11-27 03:25:21.631600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.191 qpair failed and we were unable to recover it. 00:30:19.192 [2024-11-27 03:25:21.631746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.631857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.631882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-11-27 03:25:21.631994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.632118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.632147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-11-27 03:25:21.632243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.632327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.632355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-11-27 03:25:21.632499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.632624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.632654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-11-27 03:25:21.632743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.632824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.632848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-11-27 03:25:21.632957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.633074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.633099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.192 qpair failed and we were unable to recover it. 00:30:19.192 [2024-11-27 03:25:21.633210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.633319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.192 [2024-11-27 03:25:21.633343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-11-27 03:25:21.633424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.633536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.633565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-11-27 03:25:21.633662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.633778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.633803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-11-27 03:25:21.633905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.633992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.634020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-11-27 03:25:21.634118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.634246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.634274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-11-27 03:25:21.634377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.634469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.634496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-11-27 03:25:21.634690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.634780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.193 [2024-11-27 03:25:21.634805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.193 qpair failed and we were unable to recover it. 00:30:19.193 [2024-11-27 03:25:21.634953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.635063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.635088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-11-27 03:25:21.635209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.635296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.635340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-11-27 03:25:21.635460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.635595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.635619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-11-27 03:25:21.635714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.635795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.635820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-11-27 03:25:21.635902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.635981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.636005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-11-27 03:25:21.636113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.636228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.194 [2024-11-27 03:25:21.636271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.194 qpair failed and we were unable to recover it. 00:30:19.194 [2024-11-27 03:25:21.636423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-11-27 03:25:21.636579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-11-27 03:25:21.636607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-11-27 03:25:21.636773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-11-27 03:25:21.636861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-11-27 03:25:21.636885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-11-27 03:25:21.637007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-11-27 03:25:21.637102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-11-27 03:25:21.637142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.195 [2024-11-27 03:25:21.637243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-11-27 03:25:21.637343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.195 [2024-11-27 03:25:21.637372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.195 qpair failed and we were unable to recover it. 00:30:19.196 [2024-11-27 03:25:21.637473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.637627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.637655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-11-27 03:25:21.637769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.637888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.637912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-11-27 03:25:21.638028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.638190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.638218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-11-27 03:25:21.638362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.638441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.638465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-11-27 03:25:21.638566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.638673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.638701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.196 qpair failed and we were unable to recover it. 00:30:19.196 [2024-11-27 03:25:21.638843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.196 [2024-11-27 03:25:21.638953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.638978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-11-27 03:25:21.639094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.639248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.639277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-11-27 03:25:21.639377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.639537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.639566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-11-27 03:25:21.639703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.639796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.639821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-11-27 03:25:21.639931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.640018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.640044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-11-27 03:25:21.640134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.640291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.640316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.197 qpair failed and we were unable to recover it. 00:30:19.197 [2024-11-27 03:25:21.640426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.640586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.197 [2024-11-27 03:25:21.640615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-11-27 03:25:21.640710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.640807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.640835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-11-27 03:25:21.640944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.641030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.641055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-11-27 03:25:21.641171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.641296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.641323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-11-27 03:25:21.641477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.641571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.641600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-11-27 03:25:21.641730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.641834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.641874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-11-27 03:25:21.641959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.642105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.642130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-11-27 03:25:21.642220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.642374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.642399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-11-27 03:25:21.642584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.642713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.642738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.198 qpair failed and we were unable to recover it. 00:30:19.198 [2024-11-27 03:25:21.642823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.198 [2024-11-27 03:25:21.642898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.642923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-11-27 03:25:21.643039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.643149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.643174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-11-27 03:25:21.643311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.643464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.643492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-11-27 03:25:21.643632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.643743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.643768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-11-27 03:25:21.643940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.644076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.644104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-11-27 03:25:21.644215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.644331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.644357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-11-27 03:25:21.644500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.644674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.199 [2024-11-27 03:25:21.644700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.199 qpair failed and we were unable to recover it. 00:30:19.199 [2024-11-27 03:25:21.644832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-11-27 03:25:21.644970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-11-27 03:25:21.644995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-11-27 03:25:21.645112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-11-27 03:25:21.645218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-11-27 03:25:21.645262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-11-27 03:25:21.645370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-11-27 03:25:21.645486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-11-27 03:25:21.645513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-11-27 03:25:21.645620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-11-27 03:25:21.645737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-11-27 03:25:21.645762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.200 qpair failed and we were unable to recover it. 00:30:19.200 [2024-11-27 03:25:21.645874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.200 [2024-11-27 03:25:21.645974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.646004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-11-27 03:25:21.646117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.646208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.646249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-11-27 03:25:21.646392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.646475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.646500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-11-27 03:25:21.646597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.646695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.646722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-11-27 03:25:21.646849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.646962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.646988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-11-27 03:25:21.647068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.647175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.647199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-11-27 03:25:21.647320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.647439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.201 [2024-11-27 03:25:21.647466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.201 qpair failed and we were unable to recover it. 00:30:19.201 [2024-11-27 03:25:21.647582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.647696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.647720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-11-27 03:25:21.647839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.647918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.647943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-11-27 03:25:21.648026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.648118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.648142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-11-27 03:25:21.648225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.648341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.648366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.202 [2024-11-27 03:25:21.648492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.648613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.202 [2024-11-27 03:25:21.648638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.202 qpair failed and we were unable to recover it. 00:30:19.203 [2024-11-27 03:25:21.648720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-11-27 03:25:21.648809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-11-27 03:25:21.648853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-11-27 03:25:21.648947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-11-27 03:25:21.649062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-11-27 03:25:21.649090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-11-27 03:25:21.649196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-11-27 03:25:21.649281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-11-27 03:25:21.649306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-11-27 03:25:21.649426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-11-27 03:25:21.649504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-11-27 03:25:21.649537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.203 qpair failed and we were unable to recover it. 00:30:19.203 [2024-11-27 03:25:21.649679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.203 [2024-11-27 03:25:21.649792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-11-27 03:25:21.649817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-11-27 03:25:21.649908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-11-27 03:25:21.649992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-11-27 03:25:21.650016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-11-27 03:25:21.650129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-11-27 03:25:21.650216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-11-27 03:25:21.650242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-11-27 03:25:21.650326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-11-27 03:25:21.650420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-11-27 03:25:21.650444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-11-27 03:25:21.650545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-11-27 03:25:21.650686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.204 [2024-11-27 03:25:21.650711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.204 qpair failed and we were unable to recover it. 00:30:19.204 [2024-11-27 03:25:21.650888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-11-27 03:25:21.651032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-11-27 03:25:21.651057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.205 qpair failed and we were unable to recover it. 00:30:19.205 [2024-11-27 03:25:21.651171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.205 [2024-11-27 03:25:21.651284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-11-27 03:25:21.651308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-11-27 03:25:21.651440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-11-27 03:25:21.651578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-11-27 03:25:21.651604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-11-27 03:25:21.651741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-11-27 03:25:21.651869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-11-27 03:25:21.651894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-11-27 03:25:21.652012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-11-27 03:25:21.652103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-11-27 03:25:21.652128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.206 qpair failed and we were unable to recover it. 00:30:19.206 [2024-11-27 03:25:21.652216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.206 [2024-11-27 03:25:21.652333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.652357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-11-27 03:25:21.652488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.652622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.652647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-11-27 03:25:21.652766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.652848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.652872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-11-27 03:25:21.653001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.653160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.653184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-11-27 03:25:21.653271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.653385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.653410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.207 [2024-11-27 03:25:21.653567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.653660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.207 [2024-11-27 03:25:21.653686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.207 qpair failed and we were unable to recover it. 00:30:19.208 [2024-11-27 03:25:21.653801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.653967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.653994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-11-27 03:25:21.654099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.654192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.654220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-11-27 03:25:21.654354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.654445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.654470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-11-27 03:25:21.654584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.654728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.654756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.208 [2024-11-27 03:25:21.654863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.654984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.208 [2024-11-27 03:25:21.655012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.208 qpair failed and we were unable to recover it. 00:30:19.209 [2024-11-27 03:25:21.655169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.655287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.655311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-11-27 03:25:21.655403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.655485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.655510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-11-27 03:25:21.655666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.655760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.655786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-11-27 03:25:21.655874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.655987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.656014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-11-27 03:25:21.656153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.656258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.656300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-11-27 03:25:21.656392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.656511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.656545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.209 qpair failed and we were unable to recover it. 00:30:19.209 [2024-11-27 03:25:21.656668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.656774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.209 [2024-11-27 03:25:21.656802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-11-27 03:25:21.656933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.657087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.657115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-11-27 03:25:21.657210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.657341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.657369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-11-27 03:25:21.657534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.657650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.657675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-11-27 03:25:21.657813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.657932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.657959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-11-27 03:25:21.658122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.658245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.658269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-11-27 03:25:21.658406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.658495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.210 [2024-11-27 03:25:21.658522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.210 qpair failed and we were unable to recover it. 00:30:19.210 [2024-11-27 03:25:21.658714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.658802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.658826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-11-27 03:25:21.658920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.659071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.659100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-11-27 03:25:21.659245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.659342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.659367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-11-27 03:25:21.659500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.659630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.659659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-11-27 03:25:21.659764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.659883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.659908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-11-27 03:25:21.660014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.660136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.660163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-11-27 03:25:21.660254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.660370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.660397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-11-27 03:25:21.660522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.660634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.660658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.211 qpair failed and we were unable to recover it. 00:30:19.211 [2024-11-27 03:25:21.660817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.211 [2024-11-27 03:25:21.660933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.660958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-11-27 03:25:21.661074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.661157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.661200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-11-27 03:25:21.661306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.661435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.661462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-11-27 03:25:21.661609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.661697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.661722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-11-27 03:25:21.661844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.661935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.661960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-11-27 03:25:21.662056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.662170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.662195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-11-27 03:25:21.662312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.662437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.662463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.212 qpair failed and we were unable to recover it. 00:30:19.212 [2024-11-27 03:25:21.662557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.662644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.212 [2024-11-27 03:25:21.662671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-11-27 03:25:21.662809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.662928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.662953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-11-27 03:25:21.663037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.663142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.663167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-11-27 03:25:21.663248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.663366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.663391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-11-27 03:25:21.663477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.663590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.663616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.213 [2024-11-27 03:25:21.663731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.663828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.213 [2024-11-27 03:25:21.663854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.213 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.663989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.664112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.664140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.664266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.664359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.664387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.664558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.664649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.664676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.664790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.664909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.664934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.665019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.665215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.665412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.665675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.665879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.665995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.666083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.666257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.666285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.666408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.666500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.666535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.666646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.666764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.666789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.666883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.667022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.667048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.667188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.667304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.667332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.667417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.667537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.667566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.667688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.667803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.667828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.667939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.668131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.668156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.668237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.668322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.668347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.214 qpair failed and we were unable to recover it. 00:30:19.214 [2024-11-27 03:25:21.668468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.214 [2024-11-27 03:25:21.668593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.668622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.668766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.668855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.668880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.669018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.669129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.669155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.669251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.669368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.669409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.669539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.669666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.669694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.669847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.669965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.669990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.670139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.670265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.670293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.670392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.670549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.670575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.670660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.670779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.670804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.670898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.671042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.671068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.671209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.671300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.671344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.671442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.671561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.671587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.671671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.671746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.671770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.671886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.671997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.672025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.672123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.672272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.672299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.672450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.672539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.672583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.672673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.672791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.672816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.672904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.672986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.673010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.673118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.673243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.673271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.673395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.673538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.673567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.673690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.673818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.673846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.673963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.674084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.674109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.674191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.674282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.674308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.674419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.674513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.674558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.674723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.674841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.674869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.675003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.675121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.675145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.675233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.675348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.675390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.675541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.675658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.675683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.675813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.675915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.675944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.676059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.676173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.676197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.676325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.676454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.676480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.215 [2024-11-27 03:25:21.676606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.676685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.215 [2024-11-27 03:25:21.676710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.215 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.676819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.676943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.676967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.677082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.677175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.677199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.677311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.677437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.677465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.677574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.677699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.677724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.677858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.677979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.678007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.678142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.678261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.678287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.678415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.678519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.678589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.678701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.678812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.678855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.678975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.679079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.679104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.679200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.679282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.679307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.679468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.679563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.679592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.679693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.679809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.679836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.679944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.680064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.680092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.680201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.680310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.680336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.680458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.680541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.680583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.680682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.680780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.680807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.680930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.681033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.681060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.681194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.681304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.681329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.681429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.681553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.681579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.681691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.681807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.681832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.681984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.682113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.682141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.682280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.682371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.682396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.682511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.682610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.682655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.682785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.682894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.682919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.683073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.683188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.683215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.683318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.683408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.683433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.683577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.683655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.216 [2024-11-27 03:25:21.683680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.216 qpair failed and we were unable to recover it. 00:30:19.216 [2024-11-27 03:25:21.683805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.683908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.683934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.684014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.684128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.684152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.684263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.684379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.684404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.684485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.684577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.684603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.684746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.684852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.684879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.685019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.685136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.685165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.685281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.685393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.685417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.685506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.685606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.685631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.685716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.685793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.685817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.685897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.686013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.686038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.686167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.686262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.686286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.686374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.686489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.686514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.686653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.686758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.686782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.686891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.687011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.687039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.687152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.687260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.687285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.687376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.687486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.687541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.687666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.687767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.687791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.687906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.688082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.688110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.688240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.688352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.688377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.688543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.688671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.688698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.688859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.688985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.689013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.689141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.689271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.689298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.689432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.689576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.689601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.689690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.689779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.217 [2024-11-27 03:25:21.689803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.217 qpair failed and we were unable to recover it. 00:30:19.217 [2024-11-27 03:25:21.689914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.690077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.690101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.690243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.690357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.690398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.690576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.690693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.690717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.690811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.690899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.690924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.691008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.691154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.691182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.691306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.691469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.691494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.691650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.691733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.691757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.691946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.692120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.692146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.692284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.692372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.692396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.692508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.692647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.692674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.692811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.692894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.692918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.693014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.693093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.693117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.693242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.693382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.693409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.693550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.693634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.693658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.693777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.693866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.693890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.693982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.694096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.694119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.694211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.694325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.694352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.694455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.694575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.694603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.694706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.694819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.694844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.694980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.695080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.695107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.695202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.695331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.695356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.695470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.695583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.695608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.695697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.695816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.695840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.695976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.696119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.696144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.696233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.696328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.696352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.696488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.696599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.696625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.696716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.696852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.696876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.697002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.697104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.697131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.697257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.697377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.697404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.697538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.697676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.697702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.218 [2024-11-27 03:25:21.697786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.697896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.218 [2024-11-27 03:25:21.697920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.218 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.698082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.698216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.698243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.698393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.698496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.698560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.698716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.698840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.698868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.699009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.699122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.699148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.699274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.699439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.699464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.699576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.699706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.699733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.699876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.699965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.699989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.700104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.700187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.700212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.700376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.700511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.700545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.700723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.700861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.700885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.701017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.701113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.701138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.701257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.701344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.701374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.701541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.701633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.701662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.701789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.701939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.701967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.702101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.702218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.702242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.702363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.702473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.702498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.702618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.702762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.702787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.702918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.703052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.703077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.703193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.703301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.703325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.703455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.703595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.703620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.703764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.703946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.703971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.704086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.704205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.704232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.704387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.704510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.704546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.704679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.704816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.704841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.705005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.705099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.705126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.705250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.705367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.705393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.705557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.705643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.705668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.705774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.705865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.705890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.705987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.706122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.706147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.706288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.706396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.706423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.706589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.706719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.706745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.219 qpair failed and we were unable to recover it. 00:30:19.219 [2024-11-27 03:25:21.706836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.706965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.219 [2024-11-27 03:25:21.706989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.707097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.707194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.707221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.707373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.707468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.707495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.707629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.707769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.707793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.707887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.707971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.707996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.708107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.708222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.708250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.708344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.708451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.708475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.708634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.708734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.708761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.708879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.709016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.709041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.709170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.709299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.709326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.709493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.709608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.709633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.709731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.709884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.709912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.710074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.710189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.710214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.710330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.710495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.710519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.710705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.710793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.710821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.710946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.711045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.711086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.711230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.711345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.711370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.711483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.711612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.711640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.711762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.711913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.711940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.712070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.712196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.712223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.712330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.712440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.712464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.712581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.712720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.712745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.712860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.712964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.712991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.713130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.713235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.713259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.713424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.713520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.713570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.713688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.713841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.713868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.713990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.714086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.714113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.714237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.714355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.714383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.714549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.714665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.714690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.714826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.714922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.714949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.715106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.715228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.715254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.715394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.715509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.715544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.715665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.715747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.715772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.220 qpair failed and we were unable to recover it. 00:30:19.220 [2024-11-27 03:25:21.715864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.715974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.220 [2024-11-27 03:25:21.715998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.716119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.716226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.716269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.716438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.716559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.716584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.716678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.716762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.716787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.716880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.716994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.717019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.717108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.717215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.717240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.717357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.717445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.717469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.717600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.717740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.717765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.717873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.718001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.718027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.718161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.718276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.718303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.718434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.718565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.718590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.718737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.718845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.718869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.719022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.719107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.719130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.719272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.719358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.719382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.719541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.719662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.719706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.719848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.719940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.719964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.720055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.720196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.720221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.720308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.720415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.221 [2024-11-27 03:25:21.720442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.221 qpair failed and we were unable to recover it. 00:30:19.221 [2024-11-27 03:25:21.720545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.720679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.720704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.720797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.720911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.720936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.721091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.721218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.721247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.721348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.721531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.721558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.721641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.721784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.721808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.721941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.722053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.722077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.722197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.722362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.722388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.722506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.722658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.722686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.722785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.722923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.722948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.723036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.723115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.723139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.723253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.723345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.723372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.723467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.723574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.723604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.723694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.723780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.723807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.723940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.724052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.724075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.724153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.724285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.724328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.724447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.724537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.724579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.724705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.724811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.724838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.724942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.725085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.725109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.725239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.725342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.725367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.725452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.725587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.725614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.725704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.725801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.725829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.725969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.726114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.726138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.726270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.726359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.726386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.726509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.726645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.726673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.726798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.726909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.726933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.727079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.727221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.727246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.727349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.727444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.727471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.727638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.727749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.727774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.727907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.727994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.728021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.728151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.728229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.728254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.728376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.728472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.728512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.728654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.728782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.728811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.728923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.729028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.729052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.729213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.729324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.729349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.729489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.729626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.729654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.729769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.729883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.729907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.729999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.730090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.730132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.730296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.730410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.730435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.730547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.730636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.730678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.730830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.730955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.730981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.503 [2024-11-27 03:25:21.731078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.731196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.503 [2024-11-27 03:25:21.731223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.503 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.731364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.731447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.731476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.731601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.731691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.731715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.731843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.731963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.731990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.732088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.732253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.732277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.732420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.732507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.732537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.732676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.732809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.732833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.732923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.733043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.733067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.733178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.733309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.733335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.733456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.733601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.733625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.733747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.733877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.733904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.734028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.734124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.734165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.734286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.734401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.734426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.734541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.734629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.734654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.734777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.734903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.734931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.735017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.735183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.735208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.735288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.735370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.735409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.735519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.735668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.735693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.735876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.735990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.736015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.736140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.736241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.736268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.736395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.736532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.736560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.736717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.736829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.736853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.736974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.737088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.737130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.737246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.737376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.737404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.737539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.737668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.737695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.737830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.737948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.737973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.738083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.738168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.738193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.738273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.738382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.738424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.738568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.738696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.738724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.738897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.739014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.739039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.739172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.739259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.739286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.739401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.739531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.739556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.739684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.739786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.739814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.739933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.740049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.740074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.740176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.740334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.740377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.740502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.740643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.740668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.740787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.740873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.740898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.741005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.741080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.741105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.741232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.741383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.741411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.741534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.741664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.741692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.741783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.741935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.741963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.742066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.742174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.742199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.742313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.742410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.742438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.742601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.742744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.742769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.742867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.742992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.743020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.743142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.743264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.743289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.743386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.743493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.743518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.743647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.743767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.743795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.743958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.744043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.744068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.504 [2024-11-27 03:25:21.744214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.744320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.504 [2024-11-27 03:25:21.744345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.504 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.744442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.744557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.744585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.744690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.744814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.744839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.744948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.745059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.745092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.745242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.745364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.745390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.745531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.745636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.745678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.745791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.745946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.745974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.746095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.746228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.746252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.746392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.746467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.746491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.746624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.746741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.746765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.746892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.747054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.747079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.747167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.747254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.747278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.747381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.747508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.747558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.747699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.747781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.747805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.747964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.748072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.748097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.748182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.748311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.748338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.748476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.748561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.748585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.748715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.748877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.748901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.748994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.749102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.749126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.749242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.749357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.749382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.749531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.749616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.749640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.749729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.749849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.749873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.750028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.750157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.750198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.750287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.750405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.750447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.750619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.750710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.750736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.750879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.750957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.750999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.751100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.751197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.751224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.751369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.751501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.751547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.751657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.751765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.751789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.751903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.752012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.752039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.752138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.752263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.752291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.752442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.752574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.752603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.752704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.752819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.752844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.752958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.753105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.753133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.753262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.753412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.753440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.753590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.753743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.753783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.753898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.754015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.754039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.754153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.754234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.754278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.754396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.754534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.754560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.754710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.754840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.754868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.754983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.755098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.755122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.755254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.755351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.755393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.755509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.755598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.755638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.755731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.755829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.755859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.505 qpair failed and we were unable to recover it. 00:30:19.505 [2024-11-27 03:25:21.755970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.505 [2024-11-27 03:25:21.756091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.756116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.756259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.756361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.756389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.756547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.756703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.756731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.756821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.756921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.756948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.757106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.757192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.757218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.757358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.757480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.757504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.757627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.757782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.757812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.757955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.758114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.758140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.758251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.758369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.758396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.758551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.758691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.758716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.758832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.758921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.758952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.759069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.759187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.759212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.759297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.759377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.759402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.759509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.759645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.759670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.759777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.759863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.759888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.760017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.760145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.760173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.760270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.760391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.760419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.760549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.760650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.760675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.760775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.760855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.760879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.760994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.761077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.761102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.761224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.761340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.761370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.761458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.761559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.761587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.761716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.761799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.761825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.761929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.762060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.762088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.762230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.762345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.762370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.762480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.762629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.762654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.762767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.762859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.762887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.762972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.763103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.763128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.763247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.763389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.763414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.763571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.763717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.763742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.763824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.763970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.764000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.764096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.764176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.764201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.764379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.764523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.764554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.764643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.764770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.764795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.764939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.765195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.765418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.765628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.765871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.765993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.766128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.766214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.766239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.766346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.766488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.766513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.766653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.766726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.766751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.766860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.767016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.767044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.767167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.767319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.767346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.767507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.767657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.767683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.767781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.767893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.767919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.768006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.768176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.768204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.768329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.768507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.768539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.506 [2024-11-27 03:25:21.768688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.768798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.506 [2024-11-27 03:25:21.768824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.506 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.769037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.769178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.769219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.769340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.769431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.769459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.769601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.769716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.769743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.769854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.769965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.769991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.770138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.770250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.770275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.770361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.770499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.770530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.770677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.770759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.770785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.770934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.771047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.771073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.771208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.771301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.771328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.771480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.771648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.771676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.771801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.771927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.771969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.772084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.772199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.772225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.772395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.772533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.772559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.772672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.772788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.772813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.772933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.773046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.773071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.773161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.773247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.773272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.773405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.773556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.773583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.773668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.773805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.773833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.773953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.774093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.774120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.774267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.774461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.774489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.774664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.774758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.774783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.774866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.774973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.774998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.775130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.775258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.775300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.775434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.775572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.775599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.775721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.775845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.775875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.776002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.776125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.776154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.776313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.776413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.776438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.776534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.776641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.776667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.776761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.776869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.776894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.777000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.777169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.777196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.777321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.777437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.777462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.777605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.777733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.777758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.777930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.778015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.778057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.778200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.778285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.778329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.778454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.778572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.778601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.778706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.778800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.778826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.778975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.779076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.779103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.779203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.779339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.779364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.779509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.779644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.779673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.779819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.779910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.779935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.780053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.780185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.780213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.780372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.780503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.780538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.780664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.780754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.780784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.780922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.781006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.781031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.781160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.781313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.781340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.781486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.781639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.781666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.781801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.781891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.781920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.782055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.782176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.507 [2024-11-27 03:25:21.782201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.507 qpair failed and we were unable to recover it. 00:30:19.507 [2024-11-27 03:25:21.782285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.782423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.782451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.782605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.782751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.782776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.782926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.783041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.783066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.783185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.783270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.783296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.783415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.783531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.783561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.783686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.783812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.783840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.783963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.784083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.784110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.784252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.784369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.784395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.784515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.784607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.784632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.784721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.784868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.784893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.785017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.785149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.785179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.785305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.785391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.785416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.785627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.785771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.785795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.785932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.786026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.786069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.786165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.786277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.786320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.786462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.786549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.786575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.786669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.786805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.786833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.786983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.787076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.787104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.787204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.787338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.787364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.787479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.787593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.787619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.787755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.787836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.787862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.787946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.788158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.788187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.788340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.788432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.788461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.788617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.788730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.788755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.788893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.788995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.789023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.789175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.789329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.789357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.789496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.789615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.789640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.789780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.789870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.789897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.790027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.790187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.790211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.790299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.790413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.790439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.790634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.790832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.790859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.791054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.791139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.791165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.791301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.791425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.791453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.791577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.791705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.791746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.791830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.791917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.791943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.792091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.792208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.792233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.792364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.792506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.792537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.792674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.792815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.792840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.792978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.793091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.793116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.793194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.793282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.793309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.793396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.793523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.793558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.793673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.793764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.793793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.793941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.794039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.794069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.794232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.794376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.794401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.508 qpair failed and we were unable to recover it. 00:30:19.508 [2024-11-27 03:25:21.794523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.508 [2024-11-27 03:25:21.794673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.794699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.794814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.794931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.794959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.795050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.795181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.795206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.795313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.795413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.795440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.795607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.795704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.795729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.795895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.796034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.796059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.796169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.796297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.796324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.796459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.796544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.796570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.796678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.796795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.796839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.796953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.797042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.797070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.797195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.797374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.797399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.797489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.797610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.797635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.797749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.797888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.797917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.798056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.798175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.798200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.798283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.798446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.798474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.798584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.798696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.798722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.798881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.798976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.799006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.799145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.799233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.799259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.799391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.799538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.799564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.799685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.799829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.799854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.799964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.800094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.800126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.800282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.800436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.800463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.800618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.800819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.800846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.800980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.801065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.801089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.801260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.801394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.801422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.801575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.801719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.801744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.801826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.801947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.801975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.802142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.802283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.802325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.802523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.802686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.802714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.802866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.803013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.803038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.803116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.803235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.803264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.803378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.803492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.803516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.803657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.803798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.803822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.803964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.804072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.804116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.804236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.804369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.804395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.804509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.804601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.804627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.804712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.804874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.804902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.805025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.805141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.805166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.805260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.805374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.805399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.805542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.805634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.805660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.805752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.805847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.805876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.805993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.806076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.806102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.806219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.806332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.806359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.806466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.806576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.806602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.806745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.806891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.806918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.807084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.807196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.807221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.807331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.807456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.807484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.807639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.807755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.807780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.509 qpair failed and we were unable to recover it. 00:30:19.509 [2024-11-27 03:25:21.807914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.509 [2024-11-27 03:25:21.808039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.808068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.808193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.808345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.808373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.808511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.808662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.808692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.808806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.808894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.808919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.809036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.809116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.809157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.809283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.809434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.809462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.809576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.809702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.809742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.809835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.809975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.810000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.810132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.810226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.810253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.810353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.810501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.810551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.810737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.810866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.810892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.811010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.811121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.811148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.811282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.811374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.811403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.811570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.811714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.811740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.811878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.811961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.811986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.812067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.812208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.812233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.812370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.812536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.812561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.812698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.812838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.812866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.813030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.813130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.813157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.813321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.813464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.813504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.813650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.813806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.813848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.813981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.814142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.814167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.814275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.814355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.814380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.814474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.814589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.814614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.814709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.814802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.814829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.815043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.815193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.815220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.815338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.815472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.815496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.815619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.815726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.815751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.815850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.815973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.816001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.816095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.816246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.816274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.816423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.816620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.816645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.816787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.816928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.816953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.817048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.817161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.817186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.817310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.817412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.817441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.817561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.817679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.817704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.817826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.818035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.818063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.818191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.818292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.818321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.818407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.818540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.818569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.818725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.818822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.818850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.818965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.819075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.819100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.819211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.819296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.819322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.819472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.819565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.819594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.819700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.819825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.819867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.820022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.820133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.820159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.820273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.820397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.820425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.820521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.820738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.820764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.820899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.821094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.821122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.821258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.821379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.821405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.821486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.821605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.821630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.510 qpair failed and we were unable to recover it. 00:30:19.510 [2024-11-27 03:25:21.821747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.510 [2024-11-27 03:25:21.821862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.821887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.821979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.822118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.822160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.822298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.822489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.822515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.822713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.822807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.822835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.823007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.823092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.823117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.823261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.823368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.823393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.823538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.823657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.823682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.823818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.823984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.824009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.824094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.824235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.824260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.824335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.824448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.824473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.824616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.824762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.824788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.824899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.825015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.825043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.825137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.825350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.825379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.825544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.825670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.825699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.825834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.825955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.825981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.826148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.826271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.826299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.826468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.826583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.826609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.826693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.826834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.826860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.826989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.827180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.827205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.827292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.827406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.827433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.827573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.827670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.827698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.827793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.827922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.827965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.828081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.828167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.828193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.828331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.828431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.828473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.828574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.828692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.828719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.828863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.828956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.828984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.829130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.829242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.829267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.829381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.829494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.829521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.829669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.829764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.829789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.829939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.830165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.830412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.830622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.830851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.830990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.831135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.831232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.831258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.831342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.831427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.831451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.831569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.831723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.831752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.831909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.832036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.832064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.832198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.832347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.832372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.832560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.832651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.832676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.832790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.832928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.832953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.833066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.833198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.833227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.833336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.833426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.833452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.833593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.833672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.833697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.833814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.833994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.834023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.511 qpair failed and we were unable to recover it. 00:30:19.511 [2024-11-27 03:25:21.834142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.511 [2024-11-27 03:25:21.834266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.834295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.834461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.834585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.834611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.834695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.834817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.834843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.835020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.835141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.835166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.835277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.835370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.835398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.835540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.835655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.835680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.835763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.835889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.835917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.836011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.836138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.836165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.836263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.836354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.836381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.836485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.836608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.836638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.836750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.836893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.836921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.837008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.837144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.837169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.837284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.837371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.837414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.837521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.837646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.837671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.837784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.837897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.837922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.838051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.838178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.838206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.838327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.838445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.838474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.838578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.838677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.838702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.838796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.838873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.838898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.838977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.839090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.839115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.839220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.839317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.839345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.839486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.839611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.839638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.839722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.839852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.839879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.840029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.840122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.840150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.840303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.840392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.840420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.840537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.840655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.840681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.840772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.840886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.840912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.841000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.841168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.841194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.841304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.841418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.841443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.841536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.841654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.841679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.841795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.841904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.841929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.842034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.842133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.842161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.842252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.842349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.842392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.842499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.842609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.842634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.842731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.842848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.842873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.843029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.843171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.843196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.843310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.843461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.843489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.843605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.843721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.843746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.843857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.844034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.844061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.844214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.844362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.844390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.844515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.844669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.844694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.844805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.844918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.844943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.845036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.845164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.845192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.845347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.845471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.845497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.845625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.845744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.845769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.845953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.846040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.846065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.846203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.846309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.846334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.846421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.846543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.846587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.846675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.846754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.846779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.512 qpair failed and we were unable to recover it. 00:30:19.512 [2024-11-27 03:25:21.846892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.512 [2024-11-27 03:25:21.846985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.847010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.847112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.847207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.847235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.847316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.847443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.847471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.847563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.847697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.847721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.847803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.847888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.847913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.847996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.848135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.848162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.848283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.848418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.848460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.848601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.848694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.848719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.848838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.848954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.848979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.849091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.849201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.849245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.849409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.849537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.849565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.849687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.849847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.849876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.849992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.850106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.850130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.850210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.850311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.850339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.850510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.850631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.850657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.850752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.850861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.850886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.851004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.851110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.851135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.851215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.851344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.851372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.851504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.851594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.851620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.851711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.851853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.851881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.852012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.852095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.852120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.852236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.852344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.852387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.852480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.852604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.852632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.852762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.852899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.852924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.853012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.853127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.853153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.853271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.853352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.853378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.853495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.853606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.853632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.853746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.853835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.853862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.853984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.854099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.854125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.854294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.854387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.854416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.854578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.854693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.854718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.854829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.854970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.854999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.855107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.855245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.855270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.855442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.855577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.855607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.855699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.855797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.855825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.855996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.856087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.856113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.856256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.856345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.856370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.856490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.856635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.856664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.856765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.856850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.856878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.856980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.857103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.857132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.857249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.857340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.857365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.857442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.857557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.857583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.857674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.857790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.857831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.857949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.858044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.858073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.858180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.858258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.858284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.513 [2024-11-27 03:25:21.858394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.858523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.513 [2024-11-27 03:25:21.858558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.513 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.858688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.858775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.858800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.858915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.859082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.859110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.859254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.859335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.859361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.859503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.859602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.859631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.859751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.859849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.859874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.859998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.860137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.860165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.860328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.860444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.860469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.860592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.860714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.860743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.860865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.861029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.861057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.861159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.861284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.861314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.861454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.861550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.861577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.861694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.861826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.861854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.861987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.862081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.862109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.862231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.862348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.862377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.862543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.862625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.862650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.862761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.862898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.862923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.863014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.863095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.863125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.863285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.863405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.863433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.863609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.863698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.863724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.863844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.863935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.863962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.864072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.864150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.864175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.864299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.864389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.864433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.864555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.864671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.864696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.864782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.864896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.864923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.865053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.865172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.865200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.865328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.865443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.865471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.865612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.865697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.865722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.865850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.865979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.866008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.866112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.866205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.866234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.866366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.866490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.866515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.866640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.866714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.866740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.866875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.867028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.867053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.867139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.867255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.867280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.867460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.867597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.867626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.867758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.867838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.867862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.867998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.868099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.868127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.868211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.868338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.868367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.868518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.868642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.868668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.868780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.868872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.868897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.868980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.869072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.869098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.869204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.869321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.869349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.869440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.869563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.869591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.869705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.869850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.869875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.870013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.870098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.870123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.870229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.870372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.870397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.870535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.870664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.870692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.870834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.870951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.870977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.871123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.871275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.514 [2024-11-27 03:25:21.871304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.514 qpair failed and we were unable to recover it. 00:30:19.514 [2024-11-27 03:25:21.871398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.871559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.871585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.871700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.871787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.871813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.871930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.872027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.872052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.872181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.872292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.872319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.872486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.872605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.872631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.872769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.872873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.872902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.873007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.873118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.873143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.873254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.873376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.873405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.873572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.873697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.873726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.873853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.874039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.874064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.874154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.874299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.874324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.874506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.874646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.874671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.874788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.874865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.874906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.875008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.875118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.875145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.875276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.875359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.875384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.875518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.875619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.875648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.875743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.875851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.875877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.876008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.876100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.876125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.876241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.876356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.876381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.876509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.876656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.876686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.876783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.876933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.876961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.877088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.877214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.877242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.877351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.877434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.877469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.877585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.877673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.877699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.877816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.877934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.877959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.878058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.878224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.878252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.878399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.878509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.878561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.878698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.878832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.878857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.878948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.879106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.879134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.879298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.879424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.879452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.879581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.879699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.879724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.879822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.879944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.879973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.880072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.880194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.880235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.880343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.880436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.880464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.880587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.880698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.880723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.880867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.880983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.881011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.881111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.881237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.881265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.881360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.881462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.881490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.881610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.881700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.881725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.881810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.881944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.881971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.882088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.882201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.882229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.882327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.882456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.882483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.882613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.882704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.882730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.882815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.882969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.882997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.883088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.883324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.883354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.883482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.883656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.883681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.883793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.884000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.884025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.884193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.884331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.884358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.884479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.884583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.515 [2024-11-27 03:25:21.884611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.515 qpair failed and we were unable to recover it. 00:30:19.515 [2024-11-27 03:25:21.884781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.884896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.884921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.885039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.885129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.885158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.885321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.885452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.885477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.885593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.885705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.885730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.885850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.885933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.885958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.886085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.886198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.886223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.886308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.886444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.886472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.886614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.886693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.886718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.886864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.887008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.887035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.887172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.887260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.887286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.887406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.887563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.887589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.887701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.887878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.887904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.888026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.888157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.888184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.888302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.888410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.888440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.888538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.888674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.888700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.888817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.888906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.888950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.889102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.889198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.889243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.889413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.889535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.889561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.889654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.889767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.889792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.889878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.889964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.889988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.890113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.890261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.890286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.890400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.890535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.890565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.890703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.890795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.890833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.890961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.891090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.891118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.891213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.891372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.891398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.891569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.891654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.891679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.891770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.891912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.891937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.892101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.892215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.892241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.892352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.892428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.892453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.892574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.892654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.892679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.892823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.892939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.892964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.893108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.893234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.893268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.893372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.893469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.893498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.893625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.893735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.893760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.893918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.894010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.894038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.894157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.894252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.894280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.894379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.894471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.894500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.894619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.894731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.894756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.894841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.895016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.895057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.895167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.895329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.895357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.895482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.895647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.895673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.895794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.895910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.895934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.896116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.896227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.896253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.896339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.896573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.896599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.516 [2024-11-27 03:25:21.896790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.896938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.516 [2024-11-27 03:25:21.896981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.516 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.897099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.897217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.897242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.897386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.897508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.897545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.897658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.897796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.897821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.897983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.898090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.898117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.898212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.898354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.898382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.898537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.898673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.898697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.898828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.898949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.898981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.899111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.899243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.899271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.899409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.899516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.899548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.899711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.899838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.899867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.900025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.900164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.900192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.900327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.900537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.900566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.900704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.900892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.900935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.901066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.901240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.901268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.901391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.901536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.901565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.901689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.901790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.901817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.901920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.902029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.902054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.902155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.902265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.902308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.902428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.902576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.902606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.902773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.902888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.902913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.903028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.903143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.903168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.903289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.903402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.903445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.903574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.903676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.903718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.903867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.904003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.904031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.904205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.904342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.904384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.904495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.904627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.904656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.904781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.904891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.904916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.905011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.905144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.905172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.905277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.905362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.905388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.905549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.905711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.905738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.905828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.905933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.905961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.906059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.906255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.906283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.906425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.906537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.906563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.906716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.906846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.906871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.907006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.907158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.907186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.907287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.907412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.907440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.907564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.907707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.907732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.907825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.907903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.907932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.908050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.908160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.908188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.908323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.908415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.908442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.908552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.908662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.908687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.908772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.908895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.908920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.909005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.909086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.909111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.909223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.909353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.909381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.909495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.909612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.909638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.909753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.909904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.909932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.910031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.910121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.910149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.910278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.910397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.517 [2024-11-27 03:25:21.910425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.517 qpair failed and we were unable to recover it. 00:30:19.517 [2024-11-27 03:25:21.910558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.910637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.910672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.910797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.910881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.910907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.911022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.911179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.911204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.911321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.911456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.911484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.911632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.911749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.911775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.911910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.912039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.912064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.912180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.912361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.912386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.912500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.912616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.912644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.912756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.912884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.912909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.912992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.913083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.913108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.913229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.913366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.913393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.913486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.913613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.913648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.913811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.913950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.913976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.914076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.914215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.914240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.914322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.914412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.914437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.914575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.914660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.914688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.914831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.914943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.914968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.915086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.915219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.915247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.915349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.915438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.915466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.915564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.915666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.915694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.915861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.915979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.916004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.916139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.916279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.916303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.916427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.916568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.916595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.916707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.916798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.916840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.916974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.917098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.917123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.917261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.917415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.917457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.917535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.917657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.917682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.917793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.917975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.917999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.918080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.918223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.918247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.918350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.918450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.918496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.918637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.918755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.918780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.918878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.919000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.919028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.919143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.919283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.919308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.919417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.919531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.919560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.919697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.919810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.919835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.919956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.920070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.920094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.920212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.920305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.920332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.920494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.920633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.920662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.920784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.920923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.920948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.921066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.921201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.921228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.921371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.921486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.921516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.921609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.921718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.921743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.921859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.921961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.921991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.922117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.922234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.922262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.922364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.922475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.922499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.922597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.922689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.922714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.922804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.922891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.922917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.923026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.923117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.923143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.923253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.923386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.923411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.518 qpair failed and we were unable to recover it. 00:30:19.518 [2024-11-27 03:25:21.923559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.518 [2024-11-27 03:25:21.923684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.923712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.923850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.923964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.923990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.924108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.924245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.924273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.924405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.924544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.924570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.924687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.924790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.924818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.924957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.925069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.925097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.925203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.925350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.925378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.925495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.925623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.925648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.925759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.925862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.925905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.926045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.926144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.926173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.926256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.926399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.926424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.926565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.926678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.926714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.926833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.926923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.926948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.927040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.927952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.927986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.928141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.928284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.928311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.928467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.928566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.928592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.928704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.928826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.928854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.928943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.929068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.929097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.929194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.929289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.929331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.929464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.929608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.929634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.929728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.929883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.929911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.930078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.930169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.930196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.930330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.930455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.930483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.930603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.930725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.930750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.930849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.930989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.931032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.931145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.931236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.931262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.931420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.931518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.931577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.931695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.931842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.931868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.932011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.932124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.932149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.932242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.932350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.932378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.932501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.932653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.932682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.932801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.932929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.932954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.933071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.933192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.933217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.933295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.933411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.933436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.933559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.933696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.933723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.933861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.933945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.933971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.934106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.934252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.934277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.934366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.934492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.934517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.934602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.934693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.934719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.934843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.934951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.934976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.935113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.935232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.935260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.935424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.935587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.935613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.935732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.935835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.935868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.935974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.936086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.936111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.936222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.936353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.936381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.519 [2024-11-27 03:25:21.936515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.936633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.519 [2024-11-27 03:25:21.936659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.519 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.936745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.936864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.936889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.936966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.937104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.937129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.937240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.937364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.937392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.937488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.937624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.937653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.937743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.937867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.937895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.938006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.938113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.938138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.938247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.938341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.938388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.938467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.938590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.938616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.938736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.938850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.938894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.939002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.939082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.939108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.939249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.939369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.939397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.939542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.939638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.939666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.939779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.939899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.939925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.940031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.940114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.940140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.940224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.940313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.940339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.940450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.940548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.940590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.940732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.940817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.940843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.940993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.941108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.941133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.941233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.941326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.941358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.941490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.941626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.941652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.941789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.941919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.941952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.942090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.942180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.942209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.942319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.942405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.942434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.942545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.942668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.942693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.942800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.942920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.942948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.943057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.943138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.943164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.943312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.943439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.943468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.943619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.943708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.943734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.943833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.943960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.943986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.944106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.944197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.944223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.944321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.944400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.944425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.944542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.944625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.944650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.944744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.944868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.944920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.945019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.945098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.945124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.945211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.945345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.945374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.945529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.945684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.945712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.945877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.946008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.946036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.946150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.946266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.946291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.946446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.946551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.946580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.946724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.946813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.946838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.946953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.947060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.947088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.947188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.947294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.947319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.947409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.947551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.947581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.947677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.947784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.947835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.947952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.948051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.948079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.948184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.948298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.948323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.948465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.948589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.948617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.948745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.948884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.948912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.520 [2024-11-27 03:25:21.949042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.949131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.520 [2024-11-27 03:25:21.949160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.520 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.949270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.949361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.949386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.949470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.949590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.949618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.949729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.949809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.949834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.949935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.950052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.950077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.950223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.950343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.950368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.950571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.950689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.950714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.950832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.950939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.950967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.951087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.951208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.951237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.951339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.951424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.951454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.951551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.951658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.951687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.951810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.951906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.951935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.952064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.952190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.952218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.952332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.952416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.952441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.952568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.952661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.952686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.952773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.952847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.952872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.952991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.953082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.953123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.953223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.953363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.953389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.953490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.953618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.953646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.953745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.953844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.953871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.954005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.954100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.954128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.954269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.954353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.954379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.954520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.954668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.954694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.954784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.954909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.954937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.955078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.955203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.955229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.955344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.955451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.955477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.955586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.955708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.955736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.955829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.955938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.955966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.956133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.956226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.956251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.956342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.956451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.956476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.956593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.956711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.956739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.956855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.956946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.956974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.957092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.957218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.957246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.957410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.957534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.957559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.957744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.957865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.957889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.958015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.958114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.958142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.958299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.958450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.958491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.958600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.958718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.958743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.958855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.958992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.959017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.959138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.959270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.959298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.959439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.959565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.959591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.959707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.959793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.959818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.959955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.960075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.960104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.960202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.960321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.960350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.960454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.960546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.960575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.960710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.960830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.960855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.960971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.961059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.961084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.961251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.961351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.961379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.961493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.961652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.961680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.961793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.961873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.521 [2024-11-27 03:25:21.961898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.521 qpair failed and we were unable to recover it. 00:30:19.521 [2024-11-27 03:25:21.961986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.962153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.962179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.962263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.962400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.962428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.962584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.962714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.962740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.962862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.963010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.963035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.963139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.963267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.963301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.963471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.963586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.963612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.963718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.963809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.963837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.963975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.964064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.964089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.964197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.964327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.964356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.964522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.964643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.964668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.964849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.964960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.964989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.965081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.965169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.965193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.965284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.965430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.965454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.965565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.965642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.965683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.965805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.965934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.965962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.966093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.966183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.966208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.966322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.966411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.966436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.966565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.966707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.966736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.966845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.966934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.966964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.967047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.967127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.967152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.967245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.967341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.967384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.967521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.967690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.967715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.967838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.967940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.967968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.968096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.968179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.968205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.968374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.968493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.968521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.968660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.968752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.968777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.968907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.969003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.969032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.969168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.969277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.969311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.969476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.969619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.969644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.969755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.969883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.969925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.970072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.970208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.970236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.970375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.970466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.970492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.970600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.970684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.970709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.970795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.970971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.970999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.971117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.971242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.971270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.971386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.971479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.971503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.971617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.971710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.971753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.971937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.972028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.972054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.972195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.972281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.972323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.972500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.972610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.972636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.972744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.972863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.972888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.973006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.973113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.973155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.973248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.973383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.973411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.973537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.973660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.973685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.973768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.973934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.973975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.522 qpair failed and we were unable to recover it. 00:30:19.522 [2024-11-27 03:25:21.974126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.522 [2024-11-27 03:25:21.974259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.974287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.974408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.974544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.974573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.974718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.974811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.974836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.975000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.975135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.975160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.975245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.975327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.975352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.975430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.975506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.975589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.975697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.975822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.975848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.975946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.976040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.976065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.976180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.976266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.976291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.976389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.976500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.976546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.976676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.976792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.976817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.976929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.977038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.977064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.977220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.977343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.977371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.977470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.977603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.977632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.977769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.977864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.977890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.977990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.978128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.978154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.978234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.978348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.978382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.978465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.978571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.978597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.978709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.978835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.978860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.978973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.979053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.979078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.979157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.979300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.979325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.979414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.979495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.979520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.979619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.979743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.979769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.979850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.979963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.980005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.980098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.980274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.980301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.980410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.980556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.980585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.980694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.980804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.980829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.980975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.981108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.981136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.981312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.981428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.981453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.981559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.981661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.981689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.981809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.981924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.981948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.982040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.982161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.982207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.982292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.982404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.982452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.982583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.982672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.982697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.982846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.982959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.982984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.983123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.983214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.983252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.983375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.983464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.983492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.983679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.983804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.983833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.983966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.984079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.984104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.984209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.984332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.984375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.984522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.984658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.984705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.984801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.984912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.984953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.985068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.985208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.985233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.985376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.985517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.985553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.985645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.985744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.985772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.985884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.985974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.986007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.986108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.986187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.986213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.986312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.986429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.986455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.986576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.986697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.986722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.523 qpair failed and we were unable to recover it. 00:30:19.523 [2024-11-27 03:25:21.986826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.523 [2024-11-27 03:25:21.986920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.986948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.987087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.987202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.987227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.987370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.987501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.987545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.987656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.987769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.987795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.987933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.988055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.988083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.988232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.988348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.988373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.988484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.988580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.988605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.988719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.988836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.988864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.988957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.989087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.989130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.989257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.989370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.989396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.989512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.989656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.989684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.989856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.989998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.990024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.990155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.990313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.990341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.990447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.990570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.990607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.990694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.990828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.990855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.991017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.991107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.991134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.991262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.991380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.991412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.991555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.991645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.991670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.991755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.991868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.991915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.992719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.992821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.992851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.992970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.993079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.993121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.993206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.993347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.993372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.993505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.993657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.993682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.993799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.993896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.993921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.994012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.994124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.994169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.994322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.994408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.994434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.994552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.994654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.994682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.994772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.994875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.994902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.994997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.995090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.995120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.995208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.995347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.995373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.995479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.995589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.995615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.995704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.995839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.995867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.995961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.996080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.996108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.996207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.996320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.996345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.996467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.996563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.996588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.996750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.996866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.996894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.996992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.997087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.997115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.997214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.997295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.997320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.997411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.997553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.997596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.997723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.997816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.997841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.997934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.998065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.998094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.998208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.998329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.998355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.998516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.998626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.998655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.998747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.998875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.998902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.999032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.999156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.999183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.524 qpair failed and we were unable to recover it. 00:30:19.524 [2024-11-27 03:25:21.999294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.524 [2024-11-27 03:25:21.999413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:21.999439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:21.999552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:21.999656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:21.999684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:21.999770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:21.999891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:21.999916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.000034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.000115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.000140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.000236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.000341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.000366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.000455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.000583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.000609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.000691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.000866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.000891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.000998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.001104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.001136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.001274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.001392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.001421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.001536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.001643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.001669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.001758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.001880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.001906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.001998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.002112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.002139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.002270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.002349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.002375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.002491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.002577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.002602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.002724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.002822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.002867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.002967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.003144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.003170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.003283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.003378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.003403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.003502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.003601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.003629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.003728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.003858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.003886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.004010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.004112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.004140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.004277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.004402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.004427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.004520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.004630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.004658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.004815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.004917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.004945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.005065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.005159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.005188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.005321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.005416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.005442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.005553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.005679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.005707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.005871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.005984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.006010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.006115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.006201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.006228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.006339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.006450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.006475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.006597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.006711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.006736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.006840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.006957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.006985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.007119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.007232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.007257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.007372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.007456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.007483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.007641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.007768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.007796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.007961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.008047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.008082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.008164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.008311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.008337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.008437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.008583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.008609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.008707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.008795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.008821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.008907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.009063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.009088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.009228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.009328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.009355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.009485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.009582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.009611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.009750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.009877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.009902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.009991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.010227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.010454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.010676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.010871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.010985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.011099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.011202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.011229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.011364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.011477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.011502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.525 qpair failed and we were unable to recover it. 00:30:19.525 [2024-11-27 03:25:22.011618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.525 [2024-11-27 03:25:22.011724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.011748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.011837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.011946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.011972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.012108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.012272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.012297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.012386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.012474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.012500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.012585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.012667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.012693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.012839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.012937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.012961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.013065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.013162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.013188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.013290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.013418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.013444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.013552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.013646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.013670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.013758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.013855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.013880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.013993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.014103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.014128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.014242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.014330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.014356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.014479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.014591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.014618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.014737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.014828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.014870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.014997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.015107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.015133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.015245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.015353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.015379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.015477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.015606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.015633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.015725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.015841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.015867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.015955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.016147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.016408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.016643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.016863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.016983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.017099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.017188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.017212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.017306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.017385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.017411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.017539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.017666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.017692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.017778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.017922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.017948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.018062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.018155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.018180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.018285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.018401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.018426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.018516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.018647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.018673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.018756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.018846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.018871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.018989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.019139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.019163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.019254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.019361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.019386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.019485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.019578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.019605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.019701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.019789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.019815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.019895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.020035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.020059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.020137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.020252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.020282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.020427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.020510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.020540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.020628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.020745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.020770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.020916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.021202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.021431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.021647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.021865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.021981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.022072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.022188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.022214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.022335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.022423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.022448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.022537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.022620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.022645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.022738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.022823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.022847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.526 qpair failed and we were unable to recover it. 00:30:19.526 [2024-11-27 03:25:22.022958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.023038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.526 [2024-11-27 03:25:22.023063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.023182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.023299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.023324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.023438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.023556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.023583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.023676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.023795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.023820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.023948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.024189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.024400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.024599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.024873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.024990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.025087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.025167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.025192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.025301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.025429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.025453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.025567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.025680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.025706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.025793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.025895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.025921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.026011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.026096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.026121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.026236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.026320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.026345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.026457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.026582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.026608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.026704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.026804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.026837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.026960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.027044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.027069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.027182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.027307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.027332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.027450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.027539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.027565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.027696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.027779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.027804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.027913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.028025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.028050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.028167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.028266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.028291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.028433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.028548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.028574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.028661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.028749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.028776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.028903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.029019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.029045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.029168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.029244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.029269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.029378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.029503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.029534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.029630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.029738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.029763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.029854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.029975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.030000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.030109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.030194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.030219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.030311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.030438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.030463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.030562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.030650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.030676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.030789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.030897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.030922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.031009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.031090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.031115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.031238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.031326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.031351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.031442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.031566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.031592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.031682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.031798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.031824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.031959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.032072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.032097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.032217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.032311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.032340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.032421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.032563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.032589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.032697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.032778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.032804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.032904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.033049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.033075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.033184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.033321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.033346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.033504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.033627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.033653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.033745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.033835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.033861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.527 [2024-11-27 03:25:22.033954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.034069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.527 [2024-11-27 03:25:22.034094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.527 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.034173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.034316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.034341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.034442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.034571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.034613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.034751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.034912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.034944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.035116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.035258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.035284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.035394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.035509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.035566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.035655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.035742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.035767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.035881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.035961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.035986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.036142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.036254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.036279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.036378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.036541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.036566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.036680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.036769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.036810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.036907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.037028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.037057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.037175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.037300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.037342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.037426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.037539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.037565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.037656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.037767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.037792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.037880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.037996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.038040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.038160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.038263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.038305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.038484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.038597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.038623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.038719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.038800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.038824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.038934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.039017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.039043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.039182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.039312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.039340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.039444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.039557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.039583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.039699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.039814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.039840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.039950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.040164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.040189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.040304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.040421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.040446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.040576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.040673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.040697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.040784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.040917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.040945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.041043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.041191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.041218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.041306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.041405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.041433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.041577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.041660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.041685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.041798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.041882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.041907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.042046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.042165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.042190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.042322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.042456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.042481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.042598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.042686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.042712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.042799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.042930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.042955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.043097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.043206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.043230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.043333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.043449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.043476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.043648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.043766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.043790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.043935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.044047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.044072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.044154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.044308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.044336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.044454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.044568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.044594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.044736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.044847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.044871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.045011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.045145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.045170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.045287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.045426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.045468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.045605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.045691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.045717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.045838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.045956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.045981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.046102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.046220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.046245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.046339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.046478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.046503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.046594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.046706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.046731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.528 [2024-11-27 03:25:22.046811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.046929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.528 [2024-11-27 03:25:22.046954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.528 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.047037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.047193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.047236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.047353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.047486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.047547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.047661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.047746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.047771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.047856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.047971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.047996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.048114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.048250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.048279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.048394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.048521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.048554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.048676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.048755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.048780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.048874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.048962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.048987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.049106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.049185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.049210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.049346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.049485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.049510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.049622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.049791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.049816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.049961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.050100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.050125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.050227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.050352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.050379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.050529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.050618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.050644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.050720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.050808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.050833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.050956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.051070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.051095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.051195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.051281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.051307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.051420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.051556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.051583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.051694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.051836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.051861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.051978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.052065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.052091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.052197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.052326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.052354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.052455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.052605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.052633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.052736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.052835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.052864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.052997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.053143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.053169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.053348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.053457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.053481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.053582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.053661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.053687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.053780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.053903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.053928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.054064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.054153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.054178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.054338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.054467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.054495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.054655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.054795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.054820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.054907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.055012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.055039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.055144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.055239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.055264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.055349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.055518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.055553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.055672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.055817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.055842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.055979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.056103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.056131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.056278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.056382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.056407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.056544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.056673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.056698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.056841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.056948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.056976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.057102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.057222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.057249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.057365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.057473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.057498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.057591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.057703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.057728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.057839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.057947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.057972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.058111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.058225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.058253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.058397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.058510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.058542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.058631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.058724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.058749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.058885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.058980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.059008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.059176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.059290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.059316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.059433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.059545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.059570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.529 [2024-11-27 03:25:22.059738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.059857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.529 [2024-11-27 03:25:22.059882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.529 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.060031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.060125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.060150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.060233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.060354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.060379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.060509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.060652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.060677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.060767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.060867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.060894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.060984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.061100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.061142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.061224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.061339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.061364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.061504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.061591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.061620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.061748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.061871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.061898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.062022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.062141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.062169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.062289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.062381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.062424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.062509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.062633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.062659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.062814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.062944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.062969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.063109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.063212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.063240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.063365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.063518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.063587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.063717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.063832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.063857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.063967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.064047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.064072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.064161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.064322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.064348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.064478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.064600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.064628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.064748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.064837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.064862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.065007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.065241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.065458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.065657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.065871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.065978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.066114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.066246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.066286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.066397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.066487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.066511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.066609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.066726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.066751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.066891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.067057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.067085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.067222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.067321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.067348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.530 [2024-11-27 03:25:22.067437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.067578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.530 [2024-11-27 03:25:22.067605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.530 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.067683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.067772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.067796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.067915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.068033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.068058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.068186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.068296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.068320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.068479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.068597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.068624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.068759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.068838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.068863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.068953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.069093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.069135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.069261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.069342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.069367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.069462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.069586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.069613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.069720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.069821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.069846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.070013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.070174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.070201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.070327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.070427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.070455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.070599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.070693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.070721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.070844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.070965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.070990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.071101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.071191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.071215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.071304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.071393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.071419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.071569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.071664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.071689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.071778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.071884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.071909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.072019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.072135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.072160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.072250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.072390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.072418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.072537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.072646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.072671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.072786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.072894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.072920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.073037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.073169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.073197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.073340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.073479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.073507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.073617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.073699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.073724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.073869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.073981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.074006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.074102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.074214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.074239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.074397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.074531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.074574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.531 [2024-11-27 03:25:22.074699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.074791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.531 [2024-11-27 03:25:22.074820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.531 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.074960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.075075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.075100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.075183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.075268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.075293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.075382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.075510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.075565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.075693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.075784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.075828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.075960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.076040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.076065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.076172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.076272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.076300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.076398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.076532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.076576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.076674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.076794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.076821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.076982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.077092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.077117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.077249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.077420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.077452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.077628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.077726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.077753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.077860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.078032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.078057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.078198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.078342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.078383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.078549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.078669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.078696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.078834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.078966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.078994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.079086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.079211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.079238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.079389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.079507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.079537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.079630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.079737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.079763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.079891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.080020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.080062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.080173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.080310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.080354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.080569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.080666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.080691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.080851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.080960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.080989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.081108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.081260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.081288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.081379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.081537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.081581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.081695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.081776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.081801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.081881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.081997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.082038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.082158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.082297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.082324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.082443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.082579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.082620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.532 qpair failed and we were unable to recover it. 00:30:19.532 [2024-11-27 03:25:22.082760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.532 [2024-11-27 03:25:22.082877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.082902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.083002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.083132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.083160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.083260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.083392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.083420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.083554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.083645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.083670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.083764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.083852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.083877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.083969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.084103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.084145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.084277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.084428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.084456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.084577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.084714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.084740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.084849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.084988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.085013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.085094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.085200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.085225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.085339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.085450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.085474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.085557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.085667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.085695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.085804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.085926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.085952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.086090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.086230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.086255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.086367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.086501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.086536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.086694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.086802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.086827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.086911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.087029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.087053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.087160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.087327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.087369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.087489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.087676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.087702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.087844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.087956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.087984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.088148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.088264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.088289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.088400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.088515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.088547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.088643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.088814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.088847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.089000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.089084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.089109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.089218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.089338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.089363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.089485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.089583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.089611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.089734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.089857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.089901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.089990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.090105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.090147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.533 qpair failed and we were unable to recover it. 00:30:19.533 [2024-11-27 03:25:22.090269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.090381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.533 [2024-11-27 03:25:22.090406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.090521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.090641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.090668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.090820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.090978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.091006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.091107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.091196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.091224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.091341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.091451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.091481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.091629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.091717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.091745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.091888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.091976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.092001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.092117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.092264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.092289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.092402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.092484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.092510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.092619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.092744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.092786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.092900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.092984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.093009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.093163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.093288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.093317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.093481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.093573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.093598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.093703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.093795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.093838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.093953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.094044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.094087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.094173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.094301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.094326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.094413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.094552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.094578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.094722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.094825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.094849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.094997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.095117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.095144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.095234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.095340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.095368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.095459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.095592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.095618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.095725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.095852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.095893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.095971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.096115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.096144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.096296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.096421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.096449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.096556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.096694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.096728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.534 qpair failed and we were unable to recover it. 00:30:19.534 [2024-11-27 03:25:22.096823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.534 [2024-11-27 03:25:22.096916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.096941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-11-27 03:25:22.097057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.097146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.097170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-11-27 03:25:22.097255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.097345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.097370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-11-27 03:25:22.097485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.097577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.097602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-11-27 03:25:22.097684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.097798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.097826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-11-27 03:25:22.097991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.098134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.535 [2024-11-27 03:25:22.098159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.535 qpair failed and we were unable to recover it. 00:30:19.535 [2024-11-27 03:25:22.098237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-11-27 03:25:22.098317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-11-27 03:25:22.098343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-11-27 03:25:22.098421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-11-27 03:25:22.098538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-11-27 03:25:22.098564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.817 qpair failed and we were unable to recover it. 00:30:19.817 [2024-11-27 03:25:22.098660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.817 [2024-11-27 03:25:22.098758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.098782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.098922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.099080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.099107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.099251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.099376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.099401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.099516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.099649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.099674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.099823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.099964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.099989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.100123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.100258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.100283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.100414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.100544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.100572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.100684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.100802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.100827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.100958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.101088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.101113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.101222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.101336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.101378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.101475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.101590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.101616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.101730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.101858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.101883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.101989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.102136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.102163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.102253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.102376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.102403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.102537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.102635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.102661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.102765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.102876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.102901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.102992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.103110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.103135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.103296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.103393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.103421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.103552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.103656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.103682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.103766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.103849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.103874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.103981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.104090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.104136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.104230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.104350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.818 [2024-11-27 03:25:22.104391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.818 qpair failed and we were unable to recover it. 00:30:19.818 [2024-11-27 03:25:22.104481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.104604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.104634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.104754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.104861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.104885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.105024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.105150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.105180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.105315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.105486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.105512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.105705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.105831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.105860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.105992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.106213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.106407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.106637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.106863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.106967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.107107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.107188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.107213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.107307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.107443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.107471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.107610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.107698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.107723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.107808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.107903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.107928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.108062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.108203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.108227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.108316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.108396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.108421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.108537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.108672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.108697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.108785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.108871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.108896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.108982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.109110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.109135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.109213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.109321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.109346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.819 [2024-11-27 03:25:22.109456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.109569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.819 [2024-11-27 03:25:22.109597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.819 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.109713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.109829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.109854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.109983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.110112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.110138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.110251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.110350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.110377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.110505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.110633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.110676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.110784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.110893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.110918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.111060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.111150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.111175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.111303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.111433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.111461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.111614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.111707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.111751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.111871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.111959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.111984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.112065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.112173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.112200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.112344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.112486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.112511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.112688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.112811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.112853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.112973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.113082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.113107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.113253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.113391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.113419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.113556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.113649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.113675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.113815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.113913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.113942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.114099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.114213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.114238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.114364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.114489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.114517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.114644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.114769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.114797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.114885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.114984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.115011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.115148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.115295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.115321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.820 qpair failed and we were unable to recover it. 00:30:19.820 [2024-11-27 03:25:22.115434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.115558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.820 [2024-11-27 03:25:22.115588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.115679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.115821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.115846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.115967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.116048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.116073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.116163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.116286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.116310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.116447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.116578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.116607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.116734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.116864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.116890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.117000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.117131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.117159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.117302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.117419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.117444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.117550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.117651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.117679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.117775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.117910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.117943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.118087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.118205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.118230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.118350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.118426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.118451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.118598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.118696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.118724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.118845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.118969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.118996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.119132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.119246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.119271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.119384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.119463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.119489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.119583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.119699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.119727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.119851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.119942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.119970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.120097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.120221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.120262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.120362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.120483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.120511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.120631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.120733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.120758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.821 qpair failed and we were unable to recover it. 00:30:19.821 [2024-11-27 03:25:22.120872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.121015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.821 [2024-11-27 03:25:22.121044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.121142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.121250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.121277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.121389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.121479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.121505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.121603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.121691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.121716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.121830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.121909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.121934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.122049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.122169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.122197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.122310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.122422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.122448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.122568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.122745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.122773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.122903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.123074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.123099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.123219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.123398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.123423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.123553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.123649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.123674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.123759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.123843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.123868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.123985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.124091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.124117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.124211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.124376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.124404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.124515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.124621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.124646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.124730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.124815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.124840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.124947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.125041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.125069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.125198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.125336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.125363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.125510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.125651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.125677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.125781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.125874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.125899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.126027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.126109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.126134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.126278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.126375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.126404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.822 qpair failed and we were unable to recover it. 00:30:19.822 [2024-11-27 03:25:22.126541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.822 [2024-11-27 03:25:22.126684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.126709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.126800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.126903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.126932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.127064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.127156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.127192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.127319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.127452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.127477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.127626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.127743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.127768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.127878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.127997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.128025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.128145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.128241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.128266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.128357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.128499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.128530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.128625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.128735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.128760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.128882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.129002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.129027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.129113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.129227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.129268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.129350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.129438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.129465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.129588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.129707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.129733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.129852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.129980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.130007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.130141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.130251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.130276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.130355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.130534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.130561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.130724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.130811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.130837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.131012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.131127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.131156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.131263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.131358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.131386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.823 qpair failed and we were unable to recover it. 00:30:19.823 [2024-11-27 03:25:22.131511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.131691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.823 [2024-11-27 03:25:22.131719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.131883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.132024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.132050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.132194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.132334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.132359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.132487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.132632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.132658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.132748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.132844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.132869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.132993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.133109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.133133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.133264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.133349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.133377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.133476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.133617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.133642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.133731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.133844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.133891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.134011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.134161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.134187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.134302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.134395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.134420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.134538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.134696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.134724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.134849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.134988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.135013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.135153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.135296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.135338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.135468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.135575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.135602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.135754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.135879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.135909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.136000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.136168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.136193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.136307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.136448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.136473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.136566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.136706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.136733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.136842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.136971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.136999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.137122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.137216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.824 [2024-11-27 03:25:22.137244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.824 qpair failed and we were unable to recover it. 00:30:19.824 [2024-11-27 03:25:22.137381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.137496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.137537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.137659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.137740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.137784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.137893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.138003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.138030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.138166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.138289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.138313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.138428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.138513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.138545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.138670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.138759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.138784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.138911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.139080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.139113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.139244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.139449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.139479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.139649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.139764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.139791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.139960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.140072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.140097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.140177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.140258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.140285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.140392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.140481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.140506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.140610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.140728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.140753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.140886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.141045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.141070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.141184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.141281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.141309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.141414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.141550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.141594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.141718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.141842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.141867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.141955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.142063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.142088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.142181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.142294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.142319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.142472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.142570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.142614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.142729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.142821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.142846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.142945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.143082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.143107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.143193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.143300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.143325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.825 qpair failed and we were unable to recover it. 00:30:19.825 [2024-11-27 03:25:22.143443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.825 [2024-11-27 03:25:22.143536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.143562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.143678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.143794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.143819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.143916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.144081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.144109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.144233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.144373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.144397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.144513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.144603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.144629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.144741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.144836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.144861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.144948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.145058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.145083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.145194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.145308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.145335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.145455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.145570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.145596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.145675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.145799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.145834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.145956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.146092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.146119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.146216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.146314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.146357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.146464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.146581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.146606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.146693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.146786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.146812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.146927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.147009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.147050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.147149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.147278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.147311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.147471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.147572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.147614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.147708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.147800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.147825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.147937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.148096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.148123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.148250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.148346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.148374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.148501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.148655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.148681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.148838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.148952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.148977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.826 qpair failed and we were unable to recover it. 00:30:19.826 [2024-11-27 03:25:22.149103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.826 [2024-11-27 03:25:22.149201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.149229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.149430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.149542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.149586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.149702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.149786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.149811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.149930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.150051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.150080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.150205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.150290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.150318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.150439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.150584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.150609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.150709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.150822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.150846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.150988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.151066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.151090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.151191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.151278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.151318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.151440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.151611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.151637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.151736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.151892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.151919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.152052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.152138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.152163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.152299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.152392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.152419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.152548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.152668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.152693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.152781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.152916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.152945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.153089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.153185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.153210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.153319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.153410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.153450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.153580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.153737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.153762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.153896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.154036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.154079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.154225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.154313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.154338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.154452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.154605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.154631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.154722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.154851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.154892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.827 [2024-11-27 03:25:22.155038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.155151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.827 [2024-11-27 03:25:22.155186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.827 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.155317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.155466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.155492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.155644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.155733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.155758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.155895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.156055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.156080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.156189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.156294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.156322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.156485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.156634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.156660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.156761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.156887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.156914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.157041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.157177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.157205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.157329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.157417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.157444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.157584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.157671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.157696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.157813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.157935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.157960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.158036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.158122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.158148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.158258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.158346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.158373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.158507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.158642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.158668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.158785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.158869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.158894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.159028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.159153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.159181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.159344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.159486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.159511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.159614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.159722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.159748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.159864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.159975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.160017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.160136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.160234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.160261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.160387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.160518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.160548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.828 [2024-11-27 03:25:22.160693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.160807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.828 [2024-11-27 03:25:22.160832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.828 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.160923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.161121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.161371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.161610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.161834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.161970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.162084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.162217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.162261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.162392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.162522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.162557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.162665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.162756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.162782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.162880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.162972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.162997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.163089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.163257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.163298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.163414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.163554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.163585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.163670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.163783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.163808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.163942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.164035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.164064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.164194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.164342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.164370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.164538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.164682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.164707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.164842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.164949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.164974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.165116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.165197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.165222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.165345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.165436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.165477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.829 [2024-11-27 03:25:22.165583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.165707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.829 [2024-11-27 03:25:22.165736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.829 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.165915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.166053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.166096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.166200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.166313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.166338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.166460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.166574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.166600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.166718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.166874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.166902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.167008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.167100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.167125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.167237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.167315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.167339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.167432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.167585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.167611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.167758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.167848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.167876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.167982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.168101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.168126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.168241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.168382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.168410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.168499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.168603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.168632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.168733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.168838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.168866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.169036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.169126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.169151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.169266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.169385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.169413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.169502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.169633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.169661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.169768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.169936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.169960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.170047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.170167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.170193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.170334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.170431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.170459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.170583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.170746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.170774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.170898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.170990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.171018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.830 [2024-11-27 03:25:22.171133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.171247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.830 [2024-11-27 03:25:22.171271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.830 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.171409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.171507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.171542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.171712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.171842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.171871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.171996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.172148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.172189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.172306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.172394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.172420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.172552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.172661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.172690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.172825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.173018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.173043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.173151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.173247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.173276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.173427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.173579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.173607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.173696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.173804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.173830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.173971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.174096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.174124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.174299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.174378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.174404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.174538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.174631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.174657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.174752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.174880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.174908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.175046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.175136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.175161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.175281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.175443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.175470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.175577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.175661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.175686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.175827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.175905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.175932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.176046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.176192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.176217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.176343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.176480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.176509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.176647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.176791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.176816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.176952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.177077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.177103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.177241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.177380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.831 [2024-11-27 03:25:22.177408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.831 qpair failed and we were unable to recover it. 00:30:19.831 [2024-11-27 03:25:22.177558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.177680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.177705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.177848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.177963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.177988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.178173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.178258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.178283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.178391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.178544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.178570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.178684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.178835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.178860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.178976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.179094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.179119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.179228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.179339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.179365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.179440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.179550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.179576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.179719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.179857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.179885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.179993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.180112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.180137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.180266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.180371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.180400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.180559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.180669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.180696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.180812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.180916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.180944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.181074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.181179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.181204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.181283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.181392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.181419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.181554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.181680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.181706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.181800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.181882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.181907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.181987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.182069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.182094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.182179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.182261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.182288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.182424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.182609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.182636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.182750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.182867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.182893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.182978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.183066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.183091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.832 [2024-11-27 03:25:22.183252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.183409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.832 [2024-11-27 03:25:22.183437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.832 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.183573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.183767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.183792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.183928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.184077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.184105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.184269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.184353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.184378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.184522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.184697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.184722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.184865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.185000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.185028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.185157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.185256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.185284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.185426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.185533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.185565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.185684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.185804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.185830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.185919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.186071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.186098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.186194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.186307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.186332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.186479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.186585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.186612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.186734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.186866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.186894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.187093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.187189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.187217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.187342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.187476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.187501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.187597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.187708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.187734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.187884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.188038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.188067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.188233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.188373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.188403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.188547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.188675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.188703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.188814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.188929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.188955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.189062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.189158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.189185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.189309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.189439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.189481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.189677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.189790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.189815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.833 qpair failed and we were unable to recover it. 00:30:19.833 [2024-11-27 03:25:22.189998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.833 [2024-11-27 03:25:22.190105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.190131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.190282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.190378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.190404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.190521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.190632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.190658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.190768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.190877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.190903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.191018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.191100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.191129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.191293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.191419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.191448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.191620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.191735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.191761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.191874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.191974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.192002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.192139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.192251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.192276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.192363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.192458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.192500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.192592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.192677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.192703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.192790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.192902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.192928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.193080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.193192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.193218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.193319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.193455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.193480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.193579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.193663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.193692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.193832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.193963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.193991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.194123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.194215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.194240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.194373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.194469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.194513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.194639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.194731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.194757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.194869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.194961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.194986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.195083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.195168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.195194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.195346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.195466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.195511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.834 qpair failed and we were unable to recover it. 00:30:19.834 [2024-11-27 03:25:22.195632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.195744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.834 [2024-11-27 03:25:22.195769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.195892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.196051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.196079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.196245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.196330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.196355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.196509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.196646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.196675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.196792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.196924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.196948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.197089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.197215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.197243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.197379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.197521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.197553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.197746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.197898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.197927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.198050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.198189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.198214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.198298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.198456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.198483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.198633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.198722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.198747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.198864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.198953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.198978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.199071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.199203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.199230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.199391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.199569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.199595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.199682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.199796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.199821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.199902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.200043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.200068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.200177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.200292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.200317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.200432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.200533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.200561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.200684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.200789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.200814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.835 qpair failed and we were unable to recover it. 00:30:19.835 [2024-11-27 03:25:22.200956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.835 [2024-11-27 03:25:22.201106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.201131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.201274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.201409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.201438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.201591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.201712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.201757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.201844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.201952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.201977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.202082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.202180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.202224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.202338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.202498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.202539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.202701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.202797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.202822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.202962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.203077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.203103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.203249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.203378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.203406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.203545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.203674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.203700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.203790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.203923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.203951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.204088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.204172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.204198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.204357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.204483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.204512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.204643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.204764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.204792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.204922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.205050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.205079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.205246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.205338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.205363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.205481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.205574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.205599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.205739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.205878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.205902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.206060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.206151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.206178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.206293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.206401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.206427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.206560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.206657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.206685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.206819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.206941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.206969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.207135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.207244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.207269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.836 qpair failed and we were unable to recover it. 00:30:19.836 [2024-11-27 03:25:22.207408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.207530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.836 [2024-11-27 03:25:22.207556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.207665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.207820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.207848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.207978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.208106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.208134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.208229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.208396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.208420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.208537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.208653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.208677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.208792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.208901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.208926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.209006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.209129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.209157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.209279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.209392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.209418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.209557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.209643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.209668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.209754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.209925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.209950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.210065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.210218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.210243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.210334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.210465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.210493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.210627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.210716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.210741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.210900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.211016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.211044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.211164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.211286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.211329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.211473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.211567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.211596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.211720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.211809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.211836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.211994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.212151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.212179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.212343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.212454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.212479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.212607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.212746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.212771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.212859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.212948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.212974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.213090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.213178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.213204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.213314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.213431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.837 [2024-11-27 03:25:22.213456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.837 qpair failed and we were unable to recover it. 00:30:19.837 [2024-11-27 03:25:22.213538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.213619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.213644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.213763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.213847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.213872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.213982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.214069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.214094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.214215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.214297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.214322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.214431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.214548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.214574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.214717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.214801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.214825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.214917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.215002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.215027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.215173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.215262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.215291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.215425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.215523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.215558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.215691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.215808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.215833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.215965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.216060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.216088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.216212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.216328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.216357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.216458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.216579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.216607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.216747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.216832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.216857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.216988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.217112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.217141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.217278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.217371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.217399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.217568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.217727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.217754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.217897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.218008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.218032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.218113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.218217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.218243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.218418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.218556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.218582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.218731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.218847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.218872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.219010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.219154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.219179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.219307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.219441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.219470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.838 qpair failed and we were unable to recover it. 00:30:19.838 [2024-11-27 03:25:22.219627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.838 [2024-11-27 03:25:22.219749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.219777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.219902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.219992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.220034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.220120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.220205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.220231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.220356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.220464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.220489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.220616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.220699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.220724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.220846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.220927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.220967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.221112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.221226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.221251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.221366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.221476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.221517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.221624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.221734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.221759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.221886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.221981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.222010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.222143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.222260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.222285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.222366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.222547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.222580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.222702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.222860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.222885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.222999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.223131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.223159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.223320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.223407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.223434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.223536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.223656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.223682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.223826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.223934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.223959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.224157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.224272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.224298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.224479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.224565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.224592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.224720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.224875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.224903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.225059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.225173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.225199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.225302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.225430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.225458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.839 [2024-11-27 03:25:22.225619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.225711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.839 [2024-11-27 03:25:22.225736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.839 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.225848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.225968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.226010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.226125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.226214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.226239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.226376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.226476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.226521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.226662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.226752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.226776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.226931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.227084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.227111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.227253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.227396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.227421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.227555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.227691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.227717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.227808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.227887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.227912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.228004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.228109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.228138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.228270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.228386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.228429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.228552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.228639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.228667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.228788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.228926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.228951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.229105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.229250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.229279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.229366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.229497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.229530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.229679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.229794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.229819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.229904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.229983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.230009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.230171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.230264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.230292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.230422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.230510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.230558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.230679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.230830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.230857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.230989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.231101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.231126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.231266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.231420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.231448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.231575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.231693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.840 [2024-11-27 03:25:22.231721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.840 qpair failed and we were unable to recover it. 00:30:19.840 [2024-11-27 03:25:22.231860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.231954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.232001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.232108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.232222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.232247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.232379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.232502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.232536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.232644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.232776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.232804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.232908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.233034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.233062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.233197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.233307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.233332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.233445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.233577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.233606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.233750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.233828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.233853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.233933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.234022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.234047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.234159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.234272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.234297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.234383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.234496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.234546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.234711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.234848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.234872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.234962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.235081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.235106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.235224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.235309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.235334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.235478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.235623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.235649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.235768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.235900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.235928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.236045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.236149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.236179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.841 qpair failed and we were unable to recover it. 00:30:19.841 [2024-11-27 03:25:22.236291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.841 [2024-11-27 03:25:22.236397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.236423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.236522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.236679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.236707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.236827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.236925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.236954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.237081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.237185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.237211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.237307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.237412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.237438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.237566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.237654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.237680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.237767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.237886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.237927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.238029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.238185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.238210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.238327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.238444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.238469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.238599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.238727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.238755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.238895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.239011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.239037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.239124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.239211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.239236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.239377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.239469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.239493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.239596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.239751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.239780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.239917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.240065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.240093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.240215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.240344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.240369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.240485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.240573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.240599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.240726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.240805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.240831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.240975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.241134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.241162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.241319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.241440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.241467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.241645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.241788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.241813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.842 [2024-11-27 03:25:22.241925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.242033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.842 [2024-11-27 03:25:22.242058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.842 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.242179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.242291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.242315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.242436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.242576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.242602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.242686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.242802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.242827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.242943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.243071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.243099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.243186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.243269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.243297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.243432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.243590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.243619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.243731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.243840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.243865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.243953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.244036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.244061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.244175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.244334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.244362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.244457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.244550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.244579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.244693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.244811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.244836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.244922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.245060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.245086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.245213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.245332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.245361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.245491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.245598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.245628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.245729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.245872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.245897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.246030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.246130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.246172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.246281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.246396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.246440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.246565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.246694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.246722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.246862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.246955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.246980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.247122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.247262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.247287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.247370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.247480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.247521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.247679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.247853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.843 [2024-11-27 03:25:22.247878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.843 qpair failed and we were unable to recover it. 00:30:19.843 [2024-11-27 03:25:22.248008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.248121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.248148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.248284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.248411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.248439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.248567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.248686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.248714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.248843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.248965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.248993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.249099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.249239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.249264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.249375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.249507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.249541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.249657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.249784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.249810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.249909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.250047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.250076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.250185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.250273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.250317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.250443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.250577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.250604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.250720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.250845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.250871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.250983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.251118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.251146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.251313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.251425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.251451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.251586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.251714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.251742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.251829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.251945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.251973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.252064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.252191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.252233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.252327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.252446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.252470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.252557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.252642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.252667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.252754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.252931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.252955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.253070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.253175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.253204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.253317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.253458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.253483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.253598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.253738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.253763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.253889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.254015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.254058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.844 qpair failed and we were unable to recover it. 00:30:19.844 [2024-11-27 03:25:22.254138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.844 [2024-11-27 03:25:22.254253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.254278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.254396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.254476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.254503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.254609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.254754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.254780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.254880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.254980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.255008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.255147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.255238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.255264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.255426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.255532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.255576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.255685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.255766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.255791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.255946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.256125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.256155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.256281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.256413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.256441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.256577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.256666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.256691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.256788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.256929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.256954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.257042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.257119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.257143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.257313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.257406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.257434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.257558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.257635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.257660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.257754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.257867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.257892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.257972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.258150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.258176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.258295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.258389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.258417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.258581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.258728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.258754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.258877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.259020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.259048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.259216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.259306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.259331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.259447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.259559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.259584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.259723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.259805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.259830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.260010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.260123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.260148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.845 [2024-11-27 03:25:22.260234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.260374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.845 [2024-11-27 03:25:22.260399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.845 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.260499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.260604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.260630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.260770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.260883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.260908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.261058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.261185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.261213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.261338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.261436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.261468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.261634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.261751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.261777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.261892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.261973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.262000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.262132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.262229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.262257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.262379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.262496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.262532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.262639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.262757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.262782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.262929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.263070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.263113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.263288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.263372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.263397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.263516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.263604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.263630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.263719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.263848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.263876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.264012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.264103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.264129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.264276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.264360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.264385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.264497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.264615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.264640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.264754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.264870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.264914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.265077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.265186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.265212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.265354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.265505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.265541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.265644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.265781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.265806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.265988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.266101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.266126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.266244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.266357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.266382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.846 qpair failed and we were unable to recover it. 00:30:19.846 [2024-11-27 03:25:22.266512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.846 [2024-11-27 03:25:22.266661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.266686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.266797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.266908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.266937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.267107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.267199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.267227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.267369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.267485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.267511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.267634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.267748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.267774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.267919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.268026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.268054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.268183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.268273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.268301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.268434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.268549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.268575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.268668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.268782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.268808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.268924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.269011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.269036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.269121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.269285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.269326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.269469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.269552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.269577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.269690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.269829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.269854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.269973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.270089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.270115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.270276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.270395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.270423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.270536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.270651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.270676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.270761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.270841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.270866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.270982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.271076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.271104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.847 qpair failed and we were unable to recover it. 00:30:19.847 [2024-11-27 03:25:22.271232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.847 [2024-11-27 03:25:22.271358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.271383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.271494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.271609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.271634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.271746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.271908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.271936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.272027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.272155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.272183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.272304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.272428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.272456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.272587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.272711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.272736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.272829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.272941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.272966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.273072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.273179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.273207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.273339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.273498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.273531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.273634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.273717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.273742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.273907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.274035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.274062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.274190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.274313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.274340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.274440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.274599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.274625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.274739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.274846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.274871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.274994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.275098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.275147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.275266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.275347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.275373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.275495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.275588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.275614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.275736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.275858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.275884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.276027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.276113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.276139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.276283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.276369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.276411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.276536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.276678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.276703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.276791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.276910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.276935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.277066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.277163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.277190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.848 qpair failed and we were unable to recover it. 00:30:19.848 [2024-11-27 03:25:22.277313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.848 [2024-11-27 03:25:22.277440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.277467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.277561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.277691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.277723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.277860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.277978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.278003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.278114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.278234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.278263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.278385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.278512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.278546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.278674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.278793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.278820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.278934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.279049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.279073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.279211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.279313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.279340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.279465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.279623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.279648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.279758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.279892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.279919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.280068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.280158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.280185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.280293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.280410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.280434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.280574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.280692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.280717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.280823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.280975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.281003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.281138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.281245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.281270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.281409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.281522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.281557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.281651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.281770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.281809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.281949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.282077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.282105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.282274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.282386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.282410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.282511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.282622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.282650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.282796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.282888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.282916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.849 qpair failed and we were unable to recover it. 00:30:19.849 [2024-11-27 03:25:22.283071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.849 [2024-11-27 03:25:22.283163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.283191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.283339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.283452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.283478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.283596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.283690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.283719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.283839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.283961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.283989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.284087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.284217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.284242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.284343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.284453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.284479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.284593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.284725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.284753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.284890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.285037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.285062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.285178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.285270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.285295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.285424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.285549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.285592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.285711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.285826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.285851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.286007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.286146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.286187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.286329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.286472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.286497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.286617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.286762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.286787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.286928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.287057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.287085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.287240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.287364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.287389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.287487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.287634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.287659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.287790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.287918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.287942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.288118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.288240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.288268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.288407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.288535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.288564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.288689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.288815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.288843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.289013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.289127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.289153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.850 qpair failed and we were unable to recover it. 00:30:19.850 [2024-11-27 03:25:22.289300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.850 [2024-11-27 03:25:22.289424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.289451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.289551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.289707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.289735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.289867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.289952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.289980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.290125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.290239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.290264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.290369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.290521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.290570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.290680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.290764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.290790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.290933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.291048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.291072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.291186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.291330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.291356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.291518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.291629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.291655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.291752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.291864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.291894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.292062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.292193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.292220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.292389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.292505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.292534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.292676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.292795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.292823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.292960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.293100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.293124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.293233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.293359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.293400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.293510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.293633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.293658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.293806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.293931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.293972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.294052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.294206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.294234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.294329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.294446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.294473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.294613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.294731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.294755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.294862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.294988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.295015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.295142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.295258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.295300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.851 qpair failed and we were unable to recover it. 00:30:19.851 [2024-11-27 03:25:22.295386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.851 [2024-11-27 03:25:22.295499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.295547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.295661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.295776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.295805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.295937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.296029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.296057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.296228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.296345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.296369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.296487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.296643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.296671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.296793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.296906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.296931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.297089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.297231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.297255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.297369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.297464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.297507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.297633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.297747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.297772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.297860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.297982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.298007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.298119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.298210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.298235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.298313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.298424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.298449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.298572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.298689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.298714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.298826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.298910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.298934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.299053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.299215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.299242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.299385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.299498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.299523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.299667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.299764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.299792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.299925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.300063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.300088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.300224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.300344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.300371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.300505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.300625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.300650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.300789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.300915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.300942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.301075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.301182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.301207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.301356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.301480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.301507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.301655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.301749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.301774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.852 qpair failed and we were unable to recover it. 00:30:19.852 [2024-11-27 03:25:22.301894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.852 [2024-11-27 03:25:22.302018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.302045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.302211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.302326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.302351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.302517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.302645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.302670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.302780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.302903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.302930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.303102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.303246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.303271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.303414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.303540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.303565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.303677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.303773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.303801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.303930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.304046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.304071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.304210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.304295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.304322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.304428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.304504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.304533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.304615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.304767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.304791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.304911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.305040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.305065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.305223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.305335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.305360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.305491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.305666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.305691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.305810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.305952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.305984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.306129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.306269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.306294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.306419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.306561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.306587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.306706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.306819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.306844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.853 qpair failed and we were unable to recover it. 00:30:19.853 [2024-11-27 03:25:22.306950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.853 [2024-11-27 03:25:22.307049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.307076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.307219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.307345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.307372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.307495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.307630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.307675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.307788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.307875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.307901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.308037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.308132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.308160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.308261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.308369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.308395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.308479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.308589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.308615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.308714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.308802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.308827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.308917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.309031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.309070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.309226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.309352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.309379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.309477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.309627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.309653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.309784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.309926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.309967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.310169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.310337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.310362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.310573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.310674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.310702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.310855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.310996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.311021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.311136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.311223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.311247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.311379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.311468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.311497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.311618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.311732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.311757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.311880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.311979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.312006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.312173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.312263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.312289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.312445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.312548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.312589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.312706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.312822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.312846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.854 qpair failed and we were unable to recover it. 00:30:19.854 [2024-11-27 03:25:22.312929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.313085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.854 [2024-11-27 03:25:22.313113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.313221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.313361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.313386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.313521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.313647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.313676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.313783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.313886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.313911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.314023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.314138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.314163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.314249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.314339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.314364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.314476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.314607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.314635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.314763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.314859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.314887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.314985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.315104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.315131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.315273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.315384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.315408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.315570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.315689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.315715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.315834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.315976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.316003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.316129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.316230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.316272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.316382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.316497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.316522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.316664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.316825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.316850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.316961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.317102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.317127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.317215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.317351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.317379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.317519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.317635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.317661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.317753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.317890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.317918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.318070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.318194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.318221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.318340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.318435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.318462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.318625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.318713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.318739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.855 qpair failed and we were unable to recover it. 00:30:19.855 [2024-11-27 03:25:22.318824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.318961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.855 [2024-11-27 03:25:22.318986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.319131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.319237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.319278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.319403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.319538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.319581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.319675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.319793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.319822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.319966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.320102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.320130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.320260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.320379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.320406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.320501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.320677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.320702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.320812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.320954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.320978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.321127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.321238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.321263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.321413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.321534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.321576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.321691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.321853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.321881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.322058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.322183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.322211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.322309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.322433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.322462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.322637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.322757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.322786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.322893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.322982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.323010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.323148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.323260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.323284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.323410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.323534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.323563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.323681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.323839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.323866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.323967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.324119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.324147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.324304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.324421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.324446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.324582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.324681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.324709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.324858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.324983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.325007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.325121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.325231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.325272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.856 qpair failed and we were unable to recover it. 00:30:19.856 [2024-11-27 03:25:22.325411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.856 [2024-11-27 03:25:22.325553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.325578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.325666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.325763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.325789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.325949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.326068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.326096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.326233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.326397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.326422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.326565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.326707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.326749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.326849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.326940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.326968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.327095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.327256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.327280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.327410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.327513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.327547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.327714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.327821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.327846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.327986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.328113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.328141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.328267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.328387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.328415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.328518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.328615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.328643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.328780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.328900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.328925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.329041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.329179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.329204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.329285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.329395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.329419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.329510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.329621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.329663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.329795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.329906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.329930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.330053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.330193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.330217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.330359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.330445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.330470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.330576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.330766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.330791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.330875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.330986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.331012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.331132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.331296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.331322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.857 [2024-11-27 03:25:22.331464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.331547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.857 [2024-11-27 03:25:22.331572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.857 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.331683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.331794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.331838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.331972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.332089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.332114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.332225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.332342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.332369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.332498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.332624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.332652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.332743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.332880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.332923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.333010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.333147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.333172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.333299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.333414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.333441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.333544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.333703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.333728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.333867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.334036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.334061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.334187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.334327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.334352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.334534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.334663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.334687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.334801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.334883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.334907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.335055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.335140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.335165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.335272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.335357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.335382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.335497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.335593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.335618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.335709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.335825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.335867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.335960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.336110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.336138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.336272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.336386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.336411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.336546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.336698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.336730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.336900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.337021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.337045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.337182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.337267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.337294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.858 qpair failed and we were unable to recover it. 00:30:19.858 [2024-11-27 03:25:22.337395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.337508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.858 [2024-11-27 03:25:22.337539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.337660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.337749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.337774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.337875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.337996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.338024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.338117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.338277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.338301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.338445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.338576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.338602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.338695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.338833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.338860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.338980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.339130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.339158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.339284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.339379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.339407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.339503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.339620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.339645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.339733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.339872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.339900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.340030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.340150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.340174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.340293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.340398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.340426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.340594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.340701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.340727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.340835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.340959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.340986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.341125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.341255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.341279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.341405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.341518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.341547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.341688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.341803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.341828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.341976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.342106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.859 [2024-11-27 03:25:22.342133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.859 qpair failed and we were unable to recover it. 00:30:19.859 [2024-11-27 03:25:22.342237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.342336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.342363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.342491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.342637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.342666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.342801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.342938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.342963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.343096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.343248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.343276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.343415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.343503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.343533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.343620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.343733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.343758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.343869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.343987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.344012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.344164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.344286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.344311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.344452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2587277 Killed "${NVMF_APP[@]}" "$@" 00:30:19.860 [2024-11-27 03:25:22.344590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.344619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.344743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.344869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.344895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 wit 03:25:22 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:19.860 h addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 03:25:22 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:19.860 [2024-11-27 03:25:22.345050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 03:25:22 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:19.860 [2024-11-27 03:25:22.345170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.345196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 03:25:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:19.860 [2024-11-27 03:25:22.345296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 03:25:22 -- common/autotest_common.sh@10 -- # set +x 00:30:19.860 [2024-11-27 03:25:22.345380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.345408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.345577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.345669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.345694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.345814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.345954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.345982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.346090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.346182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.346207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.346323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.346460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.346488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.346622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.346752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.346777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.346908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.347044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.347072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.347186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.347264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.347289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.347406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.347592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.347621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.860 qpair failed and we were unable to recover it. 00:30:19.860 [2024-11-27 03:25:22.347773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.860 [2024-11-27 03:25:22.347866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.347906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.348039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.348210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.348237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.348395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 03:25:22 -- nvmf/common.sh@469 -- # nvmfpid=2587859 00:30:19.861 [2024-11-27 03:25:22.348510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.348548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 03:25:22 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:19.861 03:25:22 -- nvmf/common.sh@470 -- # waitforlisten 2587859 00:30:19.861 [2024-11-27 03:25:22.348691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 03:25:22 -- common/autotest_common.sh@829 -- # '[' -z 2587859 ']' 00:30:19.861 [2024-11-27 03:25:22.348806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.348844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 03:25:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:19.861 [2024-11-27 03:25:22.348956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 03:25:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:19.861 [2024-11-27 03:25:22.349079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.349107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 03:25:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:19.861 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:19.861 03:25:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:19.861 [2024-11-27 03:25:22.349241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 03:25:22 -- common/autotest_common.sh@10 -- # set +x 00:30:19.861 [2024-11-27 03:25:22.349320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.349347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.349460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.349583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.349610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.349701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.349821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.349861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.349996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.350120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.350145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.350260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.350402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.350430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.350574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.350668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.350693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.350846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.350960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.350985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.351095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.351176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.351201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.351314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.351431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.351455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.351567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.351684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.351709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.351828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.351907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.351932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.352019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.352135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.352160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.352268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.352385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.352414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.352539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.352631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.352656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.352776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.352917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.352942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.861 [2024-11-27 03:25:22.353063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.353178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.861 [2024-11-27 03:25:22.353202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.861 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.353320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.353415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.353442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.353559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.353677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.353703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.353789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.353866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.353891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.354007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.354085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.354110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.354221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.354313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.354338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.354464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.354558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.354584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.354671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.354783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.354813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.354901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.355182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.355393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.355615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.355814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.355958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.356048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.356134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.356159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.356243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.356333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.356359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.356456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.356570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.356596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.356709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.356791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.356817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.356928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.357164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.357360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.357602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.357824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.357962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.358049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.358135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.358160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.358275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.358393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.862 [2024-11-27 03:25:22.358418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.862 qpair failed and we were unable to recover it. 00:30:19.862 [2024-11-27 03:25:22.358499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.358648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.358674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.358808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.358937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.358962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.359082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.359179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.359205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.359315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.359403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.359428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.359560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.359653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.359678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.359771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.359892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.359917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.360035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.360123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.360148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.360254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.360360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.360385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.360476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.360569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.360595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.360676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.360766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.360791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.360908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.361056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.361081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.361223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.361328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.361353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.361471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.361598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.361625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.361743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.361856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.361880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.361975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.362091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.362116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.362229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.362345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.362371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.362495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.362655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.362681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.362803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.362887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.362912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.363033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.363143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.363168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.363284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.363404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.363429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.363515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.363611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.363638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.363733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.363858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.363884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.363971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.364080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.364105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.863 qpair failed and we were unable to recover it. 00:30:19.863 [2024-11-27 03:25:22.364198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.364285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.863 [2024-11-27 03:25:22.364311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.364451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.364538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.364568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.364704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.364799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.364836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.364929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.365192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.365404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.365614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.365857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.365998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.366138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.366227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.366252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.366344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.366452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.366477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.366601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.366695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.366720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.366813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.366914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.366945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.367099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.367191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.367217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.367347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.367502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.367547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.367671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.367784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.367810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.367915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.368143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.368401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.368678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.368880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.368993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.369081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.369171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.369197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.369317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.369400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.369425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.369557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.369675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.369701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.369810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.369889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.369914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.370030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.370155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.864 [2024-11-27 03:25:22.370180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.864 qpair failed and we were unable to recover it. 00:30:19.864 [2024-11-27 03:25:22.370260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.370371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.370396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.370508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.370654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.370678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.370759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.370842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.370867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.370968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.371056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.371080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.371178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.371260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.371286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.371402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.371522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.371572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.371662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.371769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.371794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.371889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.371997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.372021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.372114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.372225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.372249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.372342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.372424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.372449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.372594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.372710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.372735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.372889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.372989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.373014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.373137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.373221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.373246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.373355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.373442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.373467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.373599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.373718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.373743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.373893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.374011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.374035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.374118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.374269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.374294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.374383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.374469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.374494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.374622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.374738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.374764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.374872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.374991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.375017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.375107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.375190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.375215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.375330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.375437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.375462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.375613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.375709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.375734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.865 qpair failed and we were unable to recover it. 00:30:19.865 [2024-11-27 03:25:22.375850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.865 [2024-11-27 03:25:22.375995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.376020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.376113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.376203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.376228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.376308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.376386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.376411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.376504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.376617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.376642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.376750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.376842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.376868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.376960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.377075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.377100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.377218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.377305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.377330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.377449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.377576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.377601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.377689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.377769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.377794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.377913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.378103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.378322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.378556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.378745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.378890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.379011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.379151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.379180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.379294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.379406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.379431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.379544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.379632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.379658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.379748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.379838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.379863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.379956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.380063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.380088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.380198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.380315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.380340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.380478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.380606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.380632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.380741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.380855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.380881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.380966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.381080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.381107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.381254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.381348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.381373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.381486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.381591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.381617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.381710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.381827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.381851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.866 [2024-11-27 03:25:22.381946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.382086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.866 [2024-11-27 03:25:22.382117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.866 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.382238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.382352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.382378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.382492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.382591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.382617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.382725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.382821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.382847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.382973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.383205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.383432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.383636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.383830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.383940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.384023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.384135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.384160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.384264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.384358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.384383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.384502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.384626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.384651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.384766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.384878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.384903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.385030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.385159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.385184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.385300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.385415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.385440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.385518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.385637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.385665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.385770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.385882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.385907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.386023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.386111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.386136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.386229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.386381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.386407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.386502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.386634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.386659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.386750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.386866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.386891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.387012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.387091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.387116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.387232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.387318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.387344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.387436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.387554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.387580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.387702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.387828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.387853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.387941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.388034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.388059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.388181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.388270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.867 [2024-11-27 03:25:22.388294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.867 qpair failed and we were unable to recover it. 00:30:19.867 [2024-11-27 03:25:22.388408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.388520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.388552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.388650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.388768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.388793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.388887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.389008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.389034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.389112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.389195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.389220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.389335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.389478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.389503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.389591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.389709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.389734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.389849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.389994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.390019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.390106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.390225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.390250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.390361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.390447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.390472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.390593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.390711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.390736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.390829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.390905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.390930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.391016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.391133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.391158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.391253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.391370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.391399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.391414] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:19.868 [2024-11-27 03:25:22.391484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.391488] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:19.868 [2024-11-27 03:25:22.391631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.391656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.391752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.391877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.391901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.391992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.392111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.392137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.392259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.392372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.392398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.392483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.392573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.392599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.392688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.392784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.392809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.392905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.393018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.393053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.393172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.393253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.393279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.393392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.393537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.393563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.393665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.393750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.393775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.393886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.393987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.394012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.394128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.394250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.394275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.868 qpair failed and we were unable to recover it. 00:30:19.868 [2024-11-27 03:25:22.394393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.868 [2024-11-27 03:25:22.394480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.394506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.394606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.394735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.394761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.394861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.394978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.395003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.395089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.395176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.395202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.395314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.395426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.395452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.395558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.395643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.395669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.395751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.395845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.395871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.395989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.396104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.396129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.396220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.396358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.396383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.396481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.396599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.396636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.396728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.396850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.396875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.396960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.397052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.397078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.397197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.397292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.397317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.397426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.397550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.397576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.397689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.397772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.397799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.397921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.398158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.398372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.398613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.398817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.398957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.399045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.399132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.399157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.399248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.399331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.399356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.399459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.399587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.399613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.399694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.399806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.399841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.399948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.400063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.400089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.400178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.400275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.400301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.400399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.400515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.400546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.400664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.400795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.400821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.869 qpair failed and we were unable to recover it. 00:30:19.869 [2024-11-27 03:25:22.400946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.401035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.869 [2024-11-27 03:25:22.401060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.401188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.401283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.401307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.401420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.401504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.401536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.401620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.401730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.401756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.401850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.401958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.401984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.402077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.402161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.402186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.402268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.402379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.402404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.402521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.402609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.402634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.402718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.402827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.402852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.402940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.403191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.403417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.403653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.403858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.403996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.404085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.404224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.404249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.404330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.404422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.404447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.404558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.404657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.404682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.404763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.404903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.404928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.405067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.405161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.405185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.405332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.405467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.405492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.405639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.405767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.405793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.405879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.405966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.405990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.406139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.406254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.406279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.406373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.406460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.406485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.870 [2024-11-27 03:25:22.406613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.406728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.870 [2024-11-27 03:25:22.406754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.870 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.406844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.406952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.406978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.407077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.407194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.407228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.407340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.407423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.407448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.407567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.407684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.407709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.407792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.407906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.407931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.408076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.408164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.408190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.408291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.408384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.408409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.408523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.408620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.408645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.408796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.408919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.408944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.409063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.409180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.409206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.409330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.409453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.409485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.409600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.409700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.409725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.409831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.409946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.409971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.410082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.410198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.410225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.410355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.410470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.410495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.410650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.410737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.410762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.410854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.410946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.410981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.411071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.411182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.411210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.411289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.411412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.411439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:19.871 [2024-11-27 03:25:22.411551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.411644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:19.871 [2024-11-27 03:25:22.411669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:19.871 qpair failed and we were unable to recover it. 00:30:20.161 [2024-11-27 03:25:22.411765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.411894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.411920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-11-27 03:25:22.412010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.412093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.412119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-11-27 03:25:22.412215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.412356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.412381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-11-27 03:25:22.412505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.412600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.412626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-11-27 03:25:22.412712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.412832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.412858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-11-27 03:25:22.412943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.413098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.413124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-11-27 03:25:22.413244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.413375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.161 [2024-11-27 03:25:22.413401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.161 qpair failed and we were unable to recover it. 00:30:20.161 [2024-11-27 03:25:22.413544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.413657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.413683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.413796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.413888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.413914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.414000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.414179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.414204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.414345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.414440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.414465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.414558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.414687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.414712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.414828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.414924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.414949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.415070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.415176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.415206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.415299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.415440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.415465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.415551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.415671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.415701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.415843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.415951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.415977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.416091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.416196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.416222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.416381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.416479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.416505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.416604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.416749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.416775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.416874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.416991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.417025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.417104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.417188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.417213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.417331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.417421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.417446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.417556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.417678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.417704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.417847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.417992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.418017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.418130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.418246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.418272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.418368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.418513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.418544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.418655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.418773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.418798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.418913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.419003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.419029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.419173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.419285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.419310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.419426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.419539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.162 [2024-11-27 03:25:22.419565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.162 qpair failed and we were unable to recover it. 00:30:20.162 [2024-11-27 03:25:22.419684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.419804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.419829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.419920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.420031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.420066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.420156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.420274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.420299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.420412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.420521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.420553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.420676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.420785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.420810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.420901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.420983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.421008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.421099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.421215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.421240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.421367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.421474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.421499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.421617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.421731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.421758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.421874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.421964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.421988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.422080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.422158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.422183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.422298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.422412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.422437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.422514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.422660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.422686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.422796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.422906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.422931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.423055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.423180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.423206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.423301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.423420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.423445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.423536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.423680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.423705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.423846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.423932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.423957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.424078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.424170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.424196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.424311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.424419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.424444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.424623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.424715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.424741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.424826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.424940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.424965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.163 qpair failed and we were unable to recover it. 00:30:20.163 [2024-11-27 03:25:22.425054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.425140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.163 [2024-11-27 03:25:22.425165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.425278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.425391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.425416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.425534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.425663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.425688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.425810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.425897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.425923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.426072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.426189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.426214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.426358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.426513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.426545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.426672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.426760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.426786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.426927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.427124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.427357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.427591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.427784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.427896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.427978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.428099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.428124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.428244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.428335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.428364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.428475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.428553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.428579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.428696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.428866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.428891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.429008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 EAL: No free 2048 kB hugepages reported on node 1 00:30:20.164 [2024-11-27 03:25:22.429119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.429144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.429232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.429353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.429378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.429492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.429588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.429615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.429716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.429793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.429818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.429929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.430015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.430040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.430180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.430296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.430320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.430469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.430559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.430584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.430701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.430814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.164 [2024-11-27 03:25:22.430843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.164 qpair failed and we were unable to recover it. 00:30:20.164 [2024-11-27 03:25:22.430938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.431050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.431074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.431163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.431280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.431305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.431424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.431566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.431592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.431687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.431806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.431831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.431947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.432070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.432096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.432249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.432335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.432360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.432481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.432571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.432598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.432697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.432785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.432810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.432935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.433194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.433453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.433670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.433865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.433974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.434066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.434180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.434206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.434328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.434415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.434441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.434552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.434635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.434661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.434748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.434853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.434877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.434956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.435070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.435096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.435215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.435331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.435356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.435455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.435632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.435657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.435779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.435891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.435916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.436058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.436178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.436204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.165 qpair failed and we were unable to recover it. 00:30:20.165 [2024-11-27 03:25:22.436298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.165 [2024-11-27 03:25:22.436444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.436469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.436601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.436692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.436717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.436808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.436922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.436949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.437063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.437177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.437202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.437313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.437405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.437430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.437547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.437625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.437649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.437740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.437878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.437903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.438025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.438166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.438191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.438309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.438425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.438451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.438570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.438683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.438709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.438795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.438878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.438904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.439019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.439108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.439133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.439250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.439344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.439369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.439462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.439555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.439581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.439726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.439848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.439874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.439990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.440224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.440441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.440683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.440874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.440985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.441111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.441225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.441250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.441339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.441454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.441479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.166 qpair failed and we were unable to recover it. 00:30:20.166 [2024-11-27 03:25:22.441597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.166 [2024-11-27 03:25:22.441684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.441709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.441803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.441923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.441947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.442044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.442130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.442155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.442280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.442366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.442391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.442517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.442642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.442668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.442778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.442898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.442922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.443002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.443120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.443150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.443261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.443354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.443379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.443497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.443617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.443643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.443758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.443881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.443906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.444015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.444127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.444151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.444243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.444387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.444413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.444534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.444633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.444658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.444743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.444868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.444893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.444988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.445096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.445121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.445263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.445355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.445380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.445472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.445549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.445578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.167 qpair failed and we were unable to recover it. 00:30:20.167 [2024-11-27 03:25:22.445706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.167 [2024-11-27 03:25:22.445819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.445844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.445926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.446013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.446038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.446136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.446218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.446244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.446335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.446491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.446516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.446681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.446799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.446824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.446943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.447028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.447053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.447168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.447277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.447302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.447413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.447539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.447566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.447650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.447764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.447789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.447909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.448015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.448040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.448158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.448285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.448310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.448433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.448551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.448577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.448657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.448739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.448764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.448891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.448975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.449000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.449088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.449178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.449204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.449297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.449404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.449429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.449544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.449642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.449667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.449755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.449848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.449873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.449994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.450103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.450128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.450218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.450297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.450322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.168 qpair failed and we were unable to recover it. 00:30:20.168 [2024-11-27 03:25:22.450449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.168 [2024-11-27 03:25:22.450579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.450605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.450723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.450824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.450850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.450940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.451171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.451369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.451638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.451873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.451992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.452083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.452167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.452191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.452308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.452405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.452430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.452546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.452637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.452662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.452778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.452894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.452919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.453039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.453130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.453155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.453278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.453369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.453394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.453510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.453631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.453656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.453752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.453838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.453864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.453953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.454039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.454064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.454177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.454291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.454317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.454439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.454532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.454558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.454646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.454732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.454757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.454871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.454995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.455020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.455159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.455280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.455309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.455399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.455489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.455515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.455616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.455714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.169 [2024-11-27 03:25:22.455740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.169 qpair failed and we were unable to recover it. 00:30:20.169 [2024-11-27 03:25:22.455859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.455999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.456024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.456106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.456188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.456213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.456332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.456421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.456446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.456564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.456648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.456672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.456789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.456903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.456927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.457036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.457116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.457140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.457255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.457332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.457357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.457441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.457569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.457599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.457693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.457780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.457806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.457931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.458018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.458044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.458134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.458251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.458276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.458380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.458492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.458517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.458644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.458769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.458795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.458886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.459001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.459026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.459114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.459255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.459280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.459378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.459518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.459548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.459642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.459730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.459755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.459899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.459981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.460007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.460119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.460235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.460261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.460350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.460449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.460474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.460587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.460676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.460701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.460791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.460870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.460895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.170 qpair failed and we were unable to recover it. 00:30:20.170 [2024-11-27 03:25:22.461018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.461110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.170 [2024-11-27 03:25:22.461135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.461255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.461363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.461388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.461468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.461583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.461608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.461733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.461819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.461843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.461964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.462079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.462104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.462219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.462305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.462331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.462454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.462549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.462576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.462668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.462827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.462852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.462969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.463069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.463094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.463182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.463264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.463289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.463398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.463515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.463545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.463654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.463765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.463790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.463868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.463978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.464003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.464085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.464205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.464231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.464319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.464435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.464461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.464555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.464648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.464674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.464771] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:20.171 [2024-11-27 03:25:22.464794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.464905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.464930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.465023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.465136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.465161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.465251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.465369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.465395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.465484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.465574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.465599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.465692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.465831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.465856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.465972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.466089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.466114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.171 [2024-11-27 03:25:22.466201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.466324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.171 [2024-11-27 03:25:22.466349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.171 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.466458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.466549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.466574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.466674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.466760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.466785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.466902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.467047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.467072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.467190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.467278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.467303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.467432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.467549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.467576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.467721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.467819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.467844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.467956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.468072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.468097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.468190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.468306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.468331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.468419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.468570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.468596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.468689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.468825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.468850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.468964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.469082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.469107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.469196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.469314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.469338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.469460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.469558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.469584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.469691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.469783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.469809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.469923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.470024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.470050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.470153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.470273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.470299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.470440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.470556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.470582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.470703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.470790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.470816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.470943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.471062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.471088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.471201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.471285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.471310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.471413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.471532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.471557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.172 [2024-11-27 03:25:22.471648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.471773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.172 [2024-11-27 03:25:22.471798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.172 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.471885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.472127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.472341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.472650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.472871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.472980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.473094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.473212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.473238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.473327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.473407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.473432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.473537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.473624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.473649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.473727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.473816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.473840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.473928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.474169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.474375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.474600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.474807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.474950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.475059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.475177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.475203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.475297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.475419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.475444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.475587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.475728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.475762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.475845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.475935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.173 [2024-11-27 03:25:22.475960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.173 qpair failed and we were unable to recover it. 00:30:20.173 [2024-11-27 03:25:22.476043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.476138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.476163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.476250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.476392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.476417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.476502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.476615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.476641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.476784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.476873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.476899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.476985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.477101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.477126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.477272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.477357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.477382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.477507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.477633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.477659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.477739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.477833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.477858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.477935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.478051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.478075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.478158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.478298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.478325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.478430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.478556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.478582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.478675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.478768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.478793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.478893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.478984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.479010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.479131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.479226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.479252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.479376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.479493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.479534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.479650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.479737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.479762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.479843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.479959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.479985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.480101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.480223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.480248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.480380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.480476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.480501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.480643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.480761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.480787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.480876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.480994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.481020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.481164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.481305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.481339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.481438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.481543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.174 [2024-11-27 03:25:22.481569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.174 qpair failed and we were unable to recover it. 00:30:20.174 [2024-11-27 03:25:22.481687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.481772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.481797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.481938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.482082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.482108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.482203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.482295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.482321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.482411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.482570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.482597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.482682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.482809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.482833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.482999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.483079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.483105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.483198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.483337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.483363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.483458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.483586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.483613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.483732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.483823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.483848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.483970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.484065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.484091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.484214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.484354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.484379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.484476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.484594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.484625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.484722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.484812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.484842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.484986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.485064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.485089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.485174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.485288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.485319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.485411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.485496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.485521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.485644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.485759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.485784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.485879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.485992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.486017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.486161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.486274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.486299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.486382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.486536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.486561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.486656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.486776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.486802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.486891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.487040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.487070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.487153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.487259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.487284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.175 qpair failed and we were unable to recover it. 00:30:20.175 [2024-11-27 03:25:22.487434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.175 [2024-11-27 03:25:22.487514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.487547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.487637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.487723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.487748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.487875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.487983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.488008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.488336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.488455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.488481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.488615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.488697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.488722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.488815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.488930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.488955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.489054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.489166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.489191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.489281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.489393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.489419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.489514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.489636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.489662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.489756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.489844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.489869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.489979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.490121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.490145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.490234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.490411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.490436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.490541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.490637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.490664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.490758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.490875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.490901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.490991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.491134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.491169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.491296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.491424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.491451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.491541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.491628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.491654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.491780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.491896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.491921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.492005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.492090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.492116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.492217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.492323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.492349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.492452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.492571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.492597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.492716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.492826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.492852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.176 qpair failed and we were unable to recover it. 00:30:20.176 [2024-11-27 03:25:22.492964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.176 [2024-11-27 03:25:22.493054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.493079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.493197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.493308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.493334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.493420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.493535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.493560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.493656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.493749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.493775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.493902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.494135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.494354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.494585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.494819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.494935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.495047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.495123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.495148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.495267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.495350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.495376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.495465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.495581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.495607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.495693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.495808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.495833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.495954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.496043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.496069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.496196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.496283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.496308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.496397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.496508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.496538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.496652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.496767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.496792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.496886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.497177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.497371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.497576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.497798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.497909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.498005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.498112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.177 [2024-11-27 03:25:22.498137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.177 qpair failed and we were unable to recover it. 00:30:20.177 [2024-11-27 03:25:22.498222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.498312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.498338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.498453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.498544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.498571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.498687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.498774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.498800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.498944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.499141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.499390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.499625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.499845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.499963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.500068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.500151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.500176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.500265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.500361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.500387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.500503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.500597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.500623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.500733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.500823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.500848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.500925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.501067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.501093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.501169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.501284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.501309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.501392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.501505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.501537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.501637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.501753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.501779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.501874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.502126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.502353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.502573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.502830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.502944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.503029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.503120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.503146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.503257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.503339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.178 [2024-11-27 03:25:22.503364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.178 qpair failed and we were unable to recover it. 00:30:20.178 [2024-11-27 03:25:22.503446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.503529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.503555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.503657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.503762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.503787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.503936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.504054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.504084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.504174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.504312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.504337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.504435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.504528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.504554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.504675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.504784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.504809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.504901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.505163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.505403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.505631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.505830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.505968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.506051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.506134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.506160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.506307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.506390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.506416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.506506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.506607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.506632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.506728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.506844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.506869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.506977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.507097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.507122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.507241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.507325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.507350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.507463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.507580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.507606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.179 qpair failed and we were unable to recover it. 00:30:20.179 [2024-11-27 03:25:22.507691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.507805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.179 [2024-11-27 03:25:22.507837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.507929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.508040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.508077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.508161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.508249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.508274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.508357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.508477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.508502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.508641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.508775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.508817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.508965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.509103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.509145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.509303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.509424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.509463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.509620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.509737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.509776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.509959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.510082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.510121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.510271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.510415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.510454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.510579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.510724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.510764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.510916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.511060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.511101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.511244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.511336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.511362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.511466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.511608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.511635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.511726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.511811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.511840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.511960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.512152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.512355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.512616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.512823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.512940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.513026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.513116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.513141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.180 [2024-11-27 03:25:22.513264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.513354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.180 [2024-11-27 03:25:22.513381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.180 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.513506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.513599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.513626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.513742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.513836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.513861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.514022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.514121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.514151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.514237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.514327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.514352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.514447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.514531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.514558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.514679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.514769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.514795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.514884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.514993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.515018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.515111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.515195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.515220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.515334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.515419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.515444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.515540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.515623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.515649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.515740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.515832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.515858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.515970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.516059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.516084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.516199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.516316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.516341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.516427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.516509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.516580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.516719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.516803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.516830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.516946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.517164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.517396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.517661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.517863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.517999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.518108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.518198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.518222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.518370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.518488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.518513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.181 [2024-11-27 03:25:22.518631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.518751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.181 [2024-11-27 03:25:22.518777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.181 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.518885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.518984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.519009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.519147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.519241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.519266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.519354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.519437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.519462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.519607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.519705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.519731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.519822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.519926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.519952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.520063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.520148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.520175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.520293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.520371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.520396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.520539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.520628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.520653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.520738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.520857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.520882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.520979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.521065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.521091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.521217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.521306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.521331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.521453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.521569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.521595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.521712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.521832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.521858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.521989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.522112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.522137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.522222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.522347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.522372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.522458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.522546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.522572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.522664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.522780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.522806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.522923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.523154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.523335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.523546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.523777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.523923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.524040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.524152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.182 [2024-11-27 03:25:22.524177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.182 qpair failed and we were unable to recover it. 00:30:20.182 [2024-11-27 03:25:22.524297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.524401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.524427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.524541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.524648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.524673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.524757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.524858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.524884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.525001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.525103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.525129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.525242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.525347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.525373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.525457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.525553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.525578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.525708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.525800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.525826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.525967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.526055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.526085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.526173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.526265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.526290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.526405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.526479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.526504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.526666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.526777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.526807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.526951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.527076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.527104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.527201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.527318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.527345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.527428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.527516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.527554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.527678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.527775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.527801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.527894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.527982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.528009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.528097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.528183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.528208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.528327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.528430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.528455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.528557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.528673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.528700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.528788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.528879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.528906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.529040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.529151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.183 [2024-11-27 03:25:22.529176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.183 qpair failed and we were unable to recover it. 00:30:20.183 [2024-11-27 03:25:22.529262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.529370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.529395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.529481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.529625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.529651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.529733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.529826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.529851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.529953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.530194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.530430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.530635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.530868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.530984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.531074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.531155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.531179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.531275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.531386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.531412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.531500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.531585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.531611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.531705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.531823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.531848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.531932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.532138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.532368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.532605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.532832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.532966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.533056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.533173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.533198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.533314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.533401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.533426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.533544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.533656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.533681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.533803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.533929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.533954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.534097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.534187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.184 [2024-11-27 03:25:22.534213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.184 qpair failed and we were unable to recover it. 00:30:20.184 [2024-11-27 03:25:22.534330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.534420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.534445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.534538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.534626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.534651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.534737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.534851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.534876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.534963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.535187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.535418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.535661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.535878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.535979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.536088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.536203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.536228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.536321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.536430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.536455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.536551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.536639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.536664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.536786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.536879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.536904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.537029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.537140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.537164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.537306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.537386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.537411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.537493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.537608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.537635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.537751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.537835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.537868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.537959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.538070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.538095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.538177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.538291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.538317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.185 qpair failed and we were unable to recover it. 00:30:20.185 [2024-11-27 03:25:22.538431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.185 [2024-11-27 03:25:22.538551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.538596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.538675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.538758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.538782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.538896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.539159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.539444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.539645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.539846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.539957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.540047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.540154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.540183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.540277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.540386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.540411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.540496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.540657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.540682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.540775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.540920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.540944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.541029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.541170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.541195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.541291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.541372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.541397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.541483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.541584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.541610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.541726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.541875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.541900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.541983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.542068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.542094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.542212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.542300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.542325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.542436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.542535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.542572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.542666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.542757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.542782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.542899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.543014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.543040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.543185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.543305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.543330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.543451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.543572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.543597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.186 [2024-11-27 03:25:22.543695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.543775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.186 [2024-11-27 03:25:22.543799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.186 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.543883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.544000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.544025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.544144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.544284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.544309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.544395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.544486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.544511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.544642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.544755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.544780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.544897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.545139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.545343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.545541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.545767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.545884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.546000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.546107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.546132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.546252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.546366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.546391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.546511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.546607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.546633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.546750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.546837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.546862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.546952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.547207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.547429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.547668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.547889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.547996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.548087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.548177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.548202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.548324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.548437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.548463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.548572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.548658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.548683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.548763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.548859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.548894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.187 [2024-11-27 03:25:22.548986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.549093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.187 [2024-11-27 03:25:22.549117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.187 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.549238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.549352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.549377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.549466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.549588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.549613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.549753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.549843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.549867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.549981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.550056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.550080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.550192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.550282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.550307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.550448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.550531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.550565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.550691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.550783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.550807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.550916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.551121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.551335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.551589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.551788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.551929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.552019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.552108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.552137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.552255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.552366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.552391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.552505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.552613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.552640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.552761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.552871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.552896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.553007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.553097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.553122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.553238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.553321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.553347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.553466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.553557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.553582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.553667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.553786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.553810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.553901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.553992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.554017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.188 qpair failed and we were unable to recover it. 00:30:20.188 [2024-11-27 03:25:22.554131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.554215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.188 [2024-11-27 03:25:22.554240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.554329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.554412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.554438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.554554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.554630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.554656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.554744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.554838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.554863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.554960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.555074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.555099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.555219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.555334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.555359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.555481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.555570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.555596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.555712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.555804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.555829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.555942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.556060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.556085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.556174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.556286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.556311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.556391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.556509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.556575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.556670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.556819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.556844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.556983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.557171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.557370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.557632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.557884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.557994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.558081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.558172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.558197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.558312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.558467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.558492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.558587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.558672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.558697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.558782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.558881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.558906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.558987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.559071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.559096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.189 qpair failed and we were unable to recover it. 00:30:20.189 [2024-11-27 03:25:22.559196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.559301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.189 [2024-11-27 03:25:22.559331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 [2024-11-27 03:25:22.559323] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.559426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.559452] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:20.190 [2024-11-27 03:25:22.559472] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:20.190 [2024-11-27 03:25:22.559484] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:20.190 [2024-11-27 03:25:22.559511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.559544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.559548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:20.190 [2024-11-27 03:25:22.559639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.559614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:20.190 [2024-11-27 03:25:22.559617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:20.190 [2024-11-27 03:25:22.559588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:20.190 [2024-11-27 03:25:22.559726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.559751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.559870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.559966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.559992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.560079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.560193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.560220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.560318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.560407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.560433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.560519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.560613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.560639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.560763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.560854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.560880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.561000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.561081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.561107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.561229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.561370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.561396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.561482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.561581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.561608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.561701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.561843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.561869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.561953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.562164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.562363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.562608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.562817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.562971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.563062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.563184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.563210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.563304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.563395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.563421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.563538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.563650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.563676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.563769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.563857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.190 [2024-11-27 03:25:22.563884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.190 qpair failed and we were unable to recover it. 00:30:20.190 [2024-11-27 03:25:22.563970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.564188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.564415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.564637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.564833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.564942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.565057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.565140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.565173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.565260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.565366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.565395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.565495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.565618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.565644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.565747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.565845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.565871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.565987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.566076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.566101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.566214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.566297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.566324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.566452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.566548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.566583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.566672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.566765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.566790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.566906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.567008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.567035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.567157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.567257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.567283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.567372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.567486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.567512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.567651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.567738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.567764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.567895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.567991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.191 [2024-11-27 03:25:22.568017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.191 qpair failed and we were unable to recover it. 00:30:20.191 [2024-11-27 03:25:22.568116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.568206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.568232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.568316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.568413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.568440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.568538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.568624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.568650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.568764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.568877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.568903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.569024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.569130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.569156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.569276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.569368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.569394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.569487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.569595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.569622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.569706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.569788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.569822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.569934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.570159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.570389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.570606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.570834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.570945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.571033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.571151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.571181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.571290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.571365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.571391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.571482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.571612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.571639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.571770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.571867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.571893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.572008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.572100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.572126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.572262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.572343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.572369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.572482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.572599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.572626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.572722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.572814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.572840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.572944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.573030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.573056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.192 qpair failed and we were unable to recover it. 00:30:20.192 [2024-11-27 03:25:22.573142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.573233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.192 [2024-11-27 03:25:22.573259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.573350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.573460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.573485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.573595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.573687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.573713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.573829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.573924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.573959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.574060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.574161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.574186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.574285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.574365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.574391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.574477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.574573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.574600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.574678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.574769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.574800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.574921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.575143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.575402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.575621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.575826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.575945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.576059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.576138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.576164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.576288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.576379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.576405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.576504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.576681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.576709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.576851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.576942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.576968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.577087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.577171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.577203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.577294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.577376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.577403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.577485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.577604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.577630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.577742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.577828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.577854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.577958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.578078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.578104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.578188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.578275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.578300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.193 qpair failed and we were unable to recover it. 00:30:20.193 [2024-11-27 03:25:22.578384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.578476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.193 [2024-11-27 03:25:22.578501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.578638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.578728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.578754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.578859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.578972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.578998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.579087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.579173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.579199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.579312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.579407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.579439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.579541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.579624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.579651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.579738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.579860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.579887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.579973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.580052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.580078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.580164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.580250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.580286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.580402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.580523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.580554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.580677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.580769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.580796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.580890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.580975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.581001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.581124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.581204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.581230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.581321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.581401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.581426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.581517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.581612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.581646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.581730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.581814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.581840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.581932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.582017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.582043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.582141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.582294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.582320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.582439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.582572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.582599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.582685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.582795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.582821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.582909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.583120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.583325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.583551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.194 qpair failed and we were unable to recover it. 00:30:20.194 [2024-11-27 03:25:22.583746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.194 [2024-11-27 03:25:22.583882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.583976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.584069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.584094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.584209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.584298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.584325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.584405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.584515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.584547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.584642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.584728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.584754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.584851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.584974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.585000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.585116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.585236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.585262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.585376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.585459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.585485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.585684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.585765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.585792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.585888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.585979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.586015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.586100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.586215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.586241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.586337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.586477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.586503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.586631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.586712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.586738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.586841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.586954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.586981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.587065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.587178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.587203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.587313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.587442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.587468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.587588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.587689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.587716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.587848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.587930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.587955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.588045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.588123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.588149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.588234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.588382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.588408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.588531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.588622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.588648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.588776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.588872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.588900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.588986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.589085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.589111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.195 qpair failed and we were unable to recover it. 00:30:20.195 [2024-11-27 03:25:22.589193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.195 [2024-11-27 03:25:22.589293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.589319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.589415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.589506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.589539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.589665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.589752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.589777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.589870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.589953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.589978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.590104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.590190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.590216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.590330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.590440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.590466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.590553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.590638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.590665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.590757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.590839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.590866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.590959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.591078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.591104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.591196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.591329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.591355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.591436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.591518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.591568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.591684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.591770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.591796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.591893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.591984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.592009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.592089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.592168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.592195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.592321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.592405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.592432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.592518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.592651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.592677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.592768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.592860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.592887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.593010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.593091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.593121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.593215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.593298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.593324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.593408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.593500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.593532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.196 qpair failed and we were unable to recover it. 00:30:20.196 [2024-11-27 03:25:22.593617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.196 [2024-11-27 03:25:22.593714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.593741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.593857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.593936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.593971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.594114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.594225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.594251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.594337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.594452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.594477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.594592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.594682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.594709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.594836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.594954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.594981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.595074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.595156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.595183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.595271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.595353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.595378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.595498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.595609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.595636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.595726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.595810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.595836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.595932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.596158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.596363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.596569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.596756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.596878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.596960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.597076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.597102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.597193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.597274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.597299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.597414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.597500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.597531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.597640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.597727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.597754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.597861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.597987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.598013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.598123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.598237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.598263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.598348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.598493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.598518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.598680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.598765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.598791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.598921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.599005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.197 [2024-11-27 03:25:22.599032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.197 qpair failed and we were unable to recover it. 00:30:20.197 [2024-11-27 03:25:22.599146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.599238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.599264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.599349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.599445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.599471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.599567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.599680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.599706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.599818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.599907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.599933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.600020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.600132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.600158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.600280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.600413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.600438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.600556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.600649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.600676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.600766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.600850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.600877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.600978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.601171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.601381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.601591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.601785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.601905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.601993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.602088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.602113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.602238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.602329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.602355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.602450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.602535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.602568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.602680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.602759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.602784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.602911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.603118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.603355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.603615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.603840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.603982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.198 qpair failed and we were unable to recover it. 00:30:20.198 [2024-11-27 03:25:22.604097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.198 [2024-11-27 03:25:22.604190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.604217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.604305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.604397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.604423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.604539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.604657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.604683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.604770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.604856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.604882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.604971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.605171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.605371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.605620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.605862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.605977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.606074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.606152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.606178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.606272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.606360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.606386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.606507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.606646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.606672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.606755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.606840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.606871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.606956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.607076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.607102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.607195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.607291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.607317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.607403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.607514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.607547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.607644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.607725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.607751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.607865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.607985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.608011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.608092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.608174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.608200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.608288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.608395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.608420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.608509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.608609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.608635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.608725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.608805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.199 [2024-11-27 03:25:22.608837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.199 qpair failed and we were unable to recover it. 00:30:20.199 [2024-11-27 03:25:22.608934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.609174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.609381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.609603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.609845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.609963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.610047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.610138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.610163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.610256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.610350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.610377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.610466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.610561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.610587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.610680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.610790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.610818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.610906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.610993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.611020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.611105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.611194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.611224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.611305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.611423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.611449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.611548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.611628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.611654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.611770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.611856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.611882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.612001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.612147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.612173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.612258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.612345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.612377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.612464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.612589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.612615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.612718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.612796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.612822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.612918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.613001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.613027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.613141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.613259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.613285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.613361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.613448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.613478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.613575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.613669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.613695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.200 qpair failed and we were unable to recover it. 00:30:20.200 [2024-11-27 03:25:22.613795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.200 [2024-11-27 03:25:22.613874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.613900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.613990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.614207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.614439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.614651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.614866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.614972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.615054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.615137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.615163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.615278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.615364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.615391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.615475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.615586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.615621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.615733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.615824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.615850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.615969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.616163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.616379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.616633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.616837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.616960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.617045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.617130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.617156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.617271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.617391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.617417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.617506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.617593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.617620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.617706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.617813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.617848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.617928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.618043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.618070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.618161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.618250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.618276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.618421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.618510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.618542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.201 [2024-11-27 03:25:22.618638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.618720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.201 [2024-11-27 03:25:22.618746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.201 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.618843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.618963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.618988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.619079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.619169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.619195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.619276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.619388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.619414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.619532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.619638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.619665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.619756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.619834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.619870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.619981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.620189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.620382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.620637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.620871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.620987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.621071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.621182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.621208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.621291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.621375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.621401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.621521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.621655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.621680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.621770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.621899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.621924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.622017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.622104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.622131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.622275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.622392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.622418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.622517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.622620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.622646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.622727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.622806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.622832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.622936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.623016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.202 [2024-11-27 03:25:22.623043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.202 qpair failed and we were unable to recover it. 00:30:20.202 [2024-11-27 03:25:22.623122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.623219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.623245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.623324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.623450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.623476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.623576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.623699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.623725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.623810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.623923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.623948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.624066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.624168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.624194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.624309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.624407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.624432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.624511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.624608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.624634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.624753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.624841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.624868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.624956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.625080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.625106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.625190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.625271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.625297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.625380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.625471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.625498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.625641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.625755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.625782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.625889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.625980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.626007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.626098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.626215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.626242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.626333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.626447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.626473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.626560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.626651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.626678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.626763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.626845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.626874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.626974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.627174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.627378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.627583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.627811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.203 [2024-11-27 03:25:22.627945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.203 qpair failed and we were unable to recover it. 00:30:20.203 [2024-11-27 03:25:22.628035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.628144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.628170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.628256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.628342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.628369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.628458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.628557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.628584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.628691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.628810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.628837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.628928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.629123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.629325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.629560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.629789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.629909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.630015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.630101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.630127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.630225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.630321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.630346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.630428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.630572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.630598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.630690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.630774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.630800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.630915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.631149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.631353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.631562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.631767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.631912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.632014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.632103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.632129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.632240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.632332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.632357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.632441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.632602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.632628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.632722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.632847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.632873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.632981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.633094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.633120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.204 qpair failed and we were unable to recover it. 00:30:20.204 [2024-11-27 03:25:22.633201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.204 [2024-11-27 03:25:22.633282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.633308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.633398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.633479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.633506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.633614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.633749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.633775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.633856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.633970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.633997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.634093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.634187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.634212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.634302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.634418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.634443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.634560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.634654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.634680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.634774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.634862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.634888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.634980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.635185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.635430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.635648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.635870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.635993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.636084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.636168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.636194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.636298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.636411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.636439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.636536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.636632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.636659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.636746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.636844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.636871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.636992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.637072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.637098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.637190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.637269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.637295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.637376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.637474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.637500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.637672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.637789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.637816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.637896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.637984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.638012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.205 qpair failed and we were unable to recover it. 00:30:20.205 [2024-11-27 03:25:22.638096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.205 [2024-11-27 03:25:22.638228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.638254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.638343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.638447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.638473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.638587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.638670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.638696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.638778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.638922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.638947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.639066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.639151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.639177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.639299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.639385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.639410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.639495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.639594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.639622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.639721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.639837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.639863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.639956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.640041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.640067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.640156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.640271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.640297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.640424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.640513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.640559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.640681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.640761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.640786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.640870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.640985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.641011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.641124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.641208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.641234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.641347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.641445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.641471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.641578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.641673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.641699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.641799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.641883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.641910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.642004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.642125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.642151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.642233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.642323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.642348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.642433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.642530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.642565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.642660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.642746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.642777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.642938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.643083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.643109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.643191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.643302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.643328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.206 qpair failed and we were unable to recover it. 00:30:20.206 [2024-11-27 03:25:22.643412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.643499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.206 [2024-11-27 03:25:22.643534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.643636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.643726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.643752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.643873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.643985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.644011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.644100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.644245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.644271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.644357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.644443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.644470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.644552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.644635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.644662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.644788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.644869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.644895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.644978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.645179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.645404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.645623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.645848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.645953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.646076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.646162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.646189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.646280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.646394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.646420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.646499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.646592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.646617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.646707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.646832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.646858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.646937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.647052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.647078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.647165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.647280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.647310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.647424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.647505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.647537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.647656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.647775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.647801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.647887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.647979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.648004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.648084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.648176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.648202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.648285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.648367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.648392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.207 [2024-11-27 03:25:22.648486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.648620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.207 [2024-11-27 03:25:22.648648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.207 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.648741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.648835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.648865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.648984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.649172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.649397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.649617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.649821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.649930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.650074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.650183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.650209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.650298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.650425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.650452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.650544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.650632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.650658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.650759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.650852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.650878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.651008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.651093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.651119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.651209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.651297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.651324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.651437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.651521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.651552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.651638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.651756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.651787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.651914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.651995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.652021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.652116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.652197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.652223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.652313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.652399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.652424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.652537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.652663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.652688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.652780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.652891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.652916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.208 qpair failed and we were unable to recover it. 00:30:20.208 [2024-11-27 03:25:22.653032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.653110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.208 [2024-11-27 03:25:22.653135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.653220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.653319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.653345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.653433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.653528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.653555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.653648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.653726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.653752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.653843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.653930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.653955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.654047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.654169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.654195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.654313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.654394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.654419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.654509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.654642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.654668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.654760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.654857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.654882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.654973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.655165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.655402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.655641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.655865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.655972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.656091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.656207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.656233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.656321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.656403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.656428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.656516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.656627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.656652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.656745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.656830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.656855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.656971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.657047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.657073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.657187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.657274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.657300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.657418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.657538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.657564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.657655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.657736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.657762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.657883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.657997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.658022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.658113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.658194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.658220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.658305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.658387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.658412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.658500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.658606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.658633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.209 qpair failed and we were unable to recover it. 00:30:20.209 [2024-11-27 03:25:22.658732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.209 [2024-11-27 03:25:22.658874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.658900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.659015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.659253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.659477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.659689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.659883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.659992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.660074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.660182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.660208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.660293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.660382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.660407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.660523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.660618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.660645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.660751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.660840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.660866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.660987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.661184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.661404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.661624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.661847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.661967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.662061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.662147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.662172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.662260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.662346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.662373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.662452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.662539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.662575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.662669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.662783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.662809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.662928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.663011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.663037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.663159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.663273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.663299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.663411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.663529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.663555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.663634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.663774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.663800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.663912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.663990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.664016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.664127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.664213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.664239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.664326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.664416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.210 [2024-11-27 03:25:22.664442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.210 qpair failed and we were unable to recover it. 00:30:20.210 [2024-11-27 03:25:22.664565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.664661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.664687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.664797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.664887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.664914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.665030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.665121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.665147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.665254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.665343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.665370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.665488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.665585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.665612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.665696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.665782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.665809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.665920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.666123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.666340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.666568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.666782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.666892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.667006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.667227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.667426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.667654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.667879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.667987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.668109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.668189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.668215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.668301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.668377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.668403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.668487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.668582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.668608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.668723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.668813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.668838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.668920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.669142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.669349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.669602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.669818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.669933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.211 qpair failed and we were unable to recover it. 00:30:20.211 [2024-11-27 03:25:22.670048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.211 [2024-11-27 03:25:22.670164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.670191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.670277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.670359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.670385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.670484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.670600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.670626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.670712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.670831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.670857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.670941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.671151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.671411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.671644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.671837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.671948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.672027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.672140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.672165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.672247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.672359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.672385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.672501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.672598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.672624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.672706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.672793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.672819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.672917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.672997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.673022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.673116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.673233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.673259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.673342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.673461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.673488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.673639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.673726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.673753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.673837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.673923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.673949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.674034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.674152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.674178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.674260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.674346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.674371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.674462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.674593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.674621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.674734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.674816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.674842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.674932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.675156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.675354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.675573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.675772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.675878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.675963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.676052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.676078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.676159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.676272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.676299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.212 qpair failed and we were unable to recover it. 00:30:20.212 [2024-11-27 03:25:22.676414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.212 [2024-11-27 03:25:22.676497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.676522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.676632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.676751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.676777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.676861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.676955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.676981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.677060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.677141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.677167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.677252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.677361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.677387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.677499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.677590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.677616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.677692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.677774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.677801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.677896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.677981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.678006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.678100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.678212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.678237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.678321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.678410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.678438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.678530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.678611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.678637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.678731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.678814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.678840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.678929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.679151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.679347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.679551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.679741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.679850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.679961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.680184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.680419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.680622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.680810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.680913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.681024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.681164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.681189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.681270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.681352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.681379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.681463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.681544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.681571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.681679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.681821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.681846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.213 qpair failed and we were unable to recover it. 00:30:20.213 [2024-11-27 03:25:22.681937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.213 [2024-11-27 03:25:22.682022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.682047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.682128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.682213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.682239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.682321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.682408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.682434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.682516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.682632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.682665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.682754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.682856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.682883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.682977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.683169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.683390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.683643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.683860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.683964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.684073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.684184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.684210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.684303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.684379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.684405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.684491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.684643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.684669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.684747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.684834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.684866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.684947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.685223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.685422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.685648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.685834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.685945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.686057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.686168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.686193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.686307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.686389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.686416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.686537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.686623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.686649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.686761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.686847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.686874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.686958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.687161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.687415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.687613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.687865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.214 [2024-11-27 03:25:22.687974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.214 qpair failed and we were unable to recover it. 00:30:20.214 [2024-11-27 03:25:22.688096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.688208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.688235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.688351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.688430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.688455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.688555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.688645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.688671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.688781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.688858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.688883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.688973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.689168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.689371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.689614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.689809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.689922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.690010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.690199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.690422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.690622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.690829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.690974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.691057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.691140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.691166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.691252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.691331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.691356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.691481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.691572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.691599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.691687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.691807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.691834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.691917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.691995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.692022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.692131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.692223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.692250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.692333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.692450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.692476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.692601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.692684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.692710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.692799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.692883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.692908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.693004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.693085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.693111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.693191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.693267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.693292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.693372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.693483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.693509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.693605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.693693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.215 [2024-11-27 03:25:22.693720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.215 qpair failed and we were unable to recover it. 00:30:20.215 [2024-11-27 03:25:22.693837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.693927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.693953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.694071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.694183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.694209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.694295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.694375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.694400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.694479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.694571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.694597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.694739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.694815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.694841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.694928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.695110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.695309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.695501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.695702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.695844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.695965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.696161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.696356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.696587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.696872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.696983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.697097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.697182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.697208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.697320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.697401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.697427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.697510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.697602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.697628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.697737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.697826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.697852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.697940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.698143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.698342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.698592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.698807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.698920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.699001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.699221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.699422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.699623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.699826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.699931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.216 qpair failed and we were unable to recover it. 00:30:20.216 [2024-11-27 03:25:22.700027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.700138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.216 [2024-11-27 03:25:22.700164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.700247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.700365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.700391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.700479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.700573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.700601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.700691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.700805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.700831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.700919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.701141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.701374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.701615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.701844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.701956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.702036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.702124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.702149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.702245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.702349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.702378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.702467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.702584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.702611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.702695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.702809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.702834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.702919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.703112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.703303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.703507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.703739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.703847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.703931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.704156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.704378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.704644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.704840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.704947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.705027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.705140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.705165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.705255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.705340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.705367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.705456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.705548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.705574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.217 qpair failed and we were unable to recover it. 00:30:20.217 [2024-11-27 03:25:22.705664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.705749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.217 [2024-11-27 03:25:22.705775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.705862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.705973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.705998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.706082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.706272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.706455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.706662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.706886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.706991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.707073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.707149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.707174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.707254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.707337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.707362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.707447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.707558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.707584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.707674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.707801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.707826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.707940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.708130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.708323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.708555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.708754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.708863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.708959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.709153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.709342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.709547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.709778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.218 [2024-11-27 03:25:22.709888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.218 qpair failed and we were unable to recover it. 00:30:20.218 [2024-11-27 03:25:22.709967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.710150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.710340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.710582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.710814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.710953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.711039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.711239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.711426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.711656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.711846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.711953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.712062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.712256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.712449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.712676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.712871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.712980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.713062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.713143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.713168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.713284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.713362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.713387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.713474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.713623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.713648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.713731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.713816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.713843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.713931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.714116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.714305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.714497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.714705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.714912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.714991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.715017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.715100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.715187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.715213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.715307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.715393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.715418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.715537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.715652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.715677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.715761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.715872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.715897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.716004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.716193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.716384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.716617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.716831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.716942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.717057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.717140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.717166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.717249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.717333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.717359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.717476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.717566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.717593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.717682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.717761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.717786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.717871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.717982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.219 [2024-11-27 03:25:22.718007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.219 qpair failed and we were unable to recover it. 00:30:20.219 [2024-11-27 03:25:22.718097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.718184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.718209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.718307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.718410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.718440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.718539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.718627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.718653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.718741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.718829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.718856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.719002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.719118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.719144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.719260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.719353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.719379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.719474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.719555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.719582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.719668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.719782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.719806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.719893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.720127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.720347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.720559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.720770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.720911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.720996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.721194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.721387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.721639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.721842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.721949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.722036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.722152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.722178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.722265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.722352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.722377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.722462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.722565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.722591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.722678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.722769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.722794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.722907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.723085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.723111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.723224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.723314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.723340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.723451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.723537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.723563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.723685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.723803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.723834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.723923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.724122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.724347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.724537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.724757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.724910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.724993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.725083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.725108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.725199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.725324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.725351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.725444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.725536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.725562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.725647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.725734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.725758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.725879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.725993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.726022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.726110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.726195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.726221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.726321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.726407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.726433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.726518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.726638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.726663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.726749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.726828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.726853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.726939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.727134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.727360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.727556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.727763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.727876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.727960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.728049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.728074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.728174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.728284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.728311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.728404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.728516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.728554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.220 qpair failed and we were unable to recover it. 00:30:20.220 [2024-11-27 03:25:22.728649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.220 [2024-11-27 03:25:22.728732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.728758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.728844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.728967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.728993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.729079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.729195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.729220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.729420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.729561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.729587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.729668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.729783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.729809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.729889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.729972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.729997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.730078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.730164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.730189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.730276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.730385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.730410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.730530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.730612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.730637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.730756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.730867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.730893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.731018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.731128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.731154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.731244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.731327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.731353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.731432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.731511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.731542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.731629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.731739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.731765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.731861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.731976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.732002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.732093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.732178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.732203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.732286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.732366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.732393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.732516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.732607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.732634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.732726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.732809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.732834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.732944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.733167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.733393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.733603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.733827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.733963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.734046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.734132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.734157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.734299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.734412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.734437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.734534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.734615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.734640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.734725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.734810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.734835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.734921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.735198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.735419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.735653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.735851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.735951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.736034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.736144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.736170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.736291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.736402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.736427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.736533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.736668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.736694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.736780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.736887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.736912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.737051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.737128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.737152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.737237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.737357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.737383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.737498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.737642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.737669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.737787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.737930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.737955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.738044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.738128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.738154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.738251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.738332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.738358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.221 qpair failed and we were unable to recover it. 00:30:20.221 [2024-11-27 03:25:22.738440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.221 [2024-11-27 03:25:22.738568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.738594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.738678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.738767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.738793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.738881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.738966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.738992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.739077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.739160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.739185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.739312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.739390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.739415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.739501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.739618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.739644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.739725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.739816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.739841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.739989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.740096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.740121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.740242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.740362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.740389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.740515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.740614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.740640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.740726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.740812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.740838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.740930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.741073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.741098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.741209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.741374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.741400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.741501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.741624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.741651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.741737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.741819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.741843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.741961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.742155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.742366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.742606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.742835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.742946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.743059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.743178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.743204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.743290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.743399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.743424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.743511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.743603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.743629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.743730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.743848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.743875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.743969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.744180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.744400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.744649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.744858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.744970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.745056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.745198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.745224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.745312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.745400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.745427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.745513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.745610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.745637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.745756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.745832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.745858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.745969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.746169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.746386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.746630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.746820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.746928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.747012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.747206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.747394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.747619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.747814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.747929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.748041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.748228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.748422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.748624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.748829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.222 [2024-11-27 03:25:22.748966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.222 qpair failed and we were unable to recover it. 00:30:20.222 [2024-11-27 03:25:22.749048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.223 [2024-11-27 03:25:22.749174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.223 [2024-11-27 03:25:22.749200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.223 qpair failed and we were unable to recover it. 00:30:20.223 [2024-11-27 03:25:22.749285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.223 [2024-11-27 03:25:22.749396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.223 [2024-11-27 03:25:22.749421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.223 qpair failed and we were unable to recover it. 00:30:20.223 [2024-11-27 03:25:22.749509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.223 [2024-11-27 03:25:22.749602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.223 [2024-11-27 03:25:22.749628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.223 qpair failed and we were unable to recover it. 00:30:20.223 [2024-11-27 03:25:22.749716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.749802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.749831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.749911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.750113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.750302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.750535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.750736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.750851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.750943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.751158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.751375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.751602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.751797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.751910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.751994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.752224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.752444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.752646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.752841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.752950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.753033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.753255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.753444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.753660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.753859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.753963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.754076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.754153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.517 [2024-11-27 03:25:22.754178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.517 qpair failed and we were unable to recover it. 00:30:20.517 [2024-11-27 03:25:22.754263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.754344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.754370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.754456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.754539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.754565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.754673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.754757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.754788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.754904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.754992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.755019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.755108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.755192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.755217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.755334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.755410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.755435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.755537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.755637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.755667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.755759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.755846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.755872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.755955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.756150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.756340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.756536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.756739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.756853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.756939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.757131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.757320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.757519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.757714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.757905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.757983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.758098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.758288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.758482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.758680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.758908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.758990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.759016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.759107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.759227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.759252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.518 qpair failed and we were unable to recover it. 00:30:20.518 [2024-11-27 03:25:22.759332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.518 [2024-11-27 03:25:22.759420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.759445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.759538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.759623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.759648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.759739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.759818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.759845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.759962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.760194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.760387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.760591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.760814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.760931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.761013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.761255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.761470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.761678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.761877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.761983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.762101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.762212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.762237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.762321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.762407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.762434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.762516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.762613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.762638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.762723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.762808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.762833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.762943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.763177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.763379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.763577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.763793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.763896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.764007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.764093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.764118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.764204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.764323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.764348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.764432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.764517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.764549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.519 qpair failed and we were unable to recover it. 00:30:20.519 [2024-11-27 03:25:22.764636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.519 [2024-11-27 03:25:22.764723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.764748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.764841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.764921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.764946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.765034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.765155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.765180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.765276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.765360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.765385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.765495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.765582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.765607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.765695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.765781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.765806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.765892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.766118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.766343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.766571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.766770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.766915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.766999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.767083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.767108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.767221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.767298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.767323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.767416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.767536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.767562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.767653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.767768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.767793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.767904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.767984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.768011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.768106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.768193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.768217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.768298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.768415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.768441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.768531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.768615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.768640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.768755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.768836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.768861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.768946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.769169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.769365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.769576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.769808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.769917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.770006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.770233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.770429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.770657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.770853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.770957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.771072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.771156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.771181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.771264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.771376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.771401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.771486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.771616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.771642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.771730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.771815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.771841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.771924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.772138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.772391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.772649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.772851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.772957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.773050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.773164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.773189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.773278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.773361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.773386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.773532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.773615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.773640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.773760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.773846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.520 [2024-11-27 03:25:22.773872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.520 qpair failed and we were unable to recover it. 00:30:20.520 [2024-11-27 03:25:22.773959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.774181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.774402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.774599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.774825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.774932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.775026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.775103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.775128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.775240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.775318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.775343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.775430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.775562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.775589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.775707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.775792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.775818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.775930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.776144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.776374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.776587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.776774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.776880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.776972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.777152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.777349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.777575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.777824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.777931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.778045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.778129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.778155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.778257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.778396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.778426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.778558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.778650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.778676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.778764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.778843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.778869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.778949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.779148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.779371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.779578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.779776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.779882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.779969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.780200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.780437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.780637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.780834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.780936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.781019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.781222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.781407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.781652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.781882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.781991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.782070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.782182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.782206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.782332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.782445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.782470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.521 qpair failed and we were unable to recover it. 00:30:20.521 [2024-11-27 03:25:22.782556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.782646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.521 [2024-11-27 03:25:22.782676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.782793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.782886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.782913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.782999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.783110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.783136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.783218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.783303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.783330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.783480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.783596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.783622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.783704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.783830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.783855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.783974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.784202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.784397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.784654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.784877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.784979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.785067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.785149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.785174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.785258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.785339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.785364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.785456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.785569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.785594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.785680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.785789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.785814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.785897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.785983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.786008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.786105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.786189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.786214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.786296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.786414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.786438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.786523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.786621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.786647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.786729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.786808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.786834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.786918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.787143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.787335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.787532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.787732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.787844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.787928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.788118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.788337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.788543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.788767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.788873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.788955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.789182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.789405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.789605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.789793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.789927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.790050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.790134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.790159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.790246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.790325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.790350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.790461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.790548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.790574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.790672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.790757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.790782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.790866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.790980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.791005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.791091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.791217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.791242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.791354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.791467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.791493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.791584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.791667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.791692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.791821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.791909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.791934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.792014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.792100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.792125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.792208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.792290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.792315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.792396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.792476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.792501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.522 qpair failed and we were unable to recover it. 00:30:20.522 [2024-11-27 03:25:22.792589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.792675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.522 [2024-11-27 03:25:22.792699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.792843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.792930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.792955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.793046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.793179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.793204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.793292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.793384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.793409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.793497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.793586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.793618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.793703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.793787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.793811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.793928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.794128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.794348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.794574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.794773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.794877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.794961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.795155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.795347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.795552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.795797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.795929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.796006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.796236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.796457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.796650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.796870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.796971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.797091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.797280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.797477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.797688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.797876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.797982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.798100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.798188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.798213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.798291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.798383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.798409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.798491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.798613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.798638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.798717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.798802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.798827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.798910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.798988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.799013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.799097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.799210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.799234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.799347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.799425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.799451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.799554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.799667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.799693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.799782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.799865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.799890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.799977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.800194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.800407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.800608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.800795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.800936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.801017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.801104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.801129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.801276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.801367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.801392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.801473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.801556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.801581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.801662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.801786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.801811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.801900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.801979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.802004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.802097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.802180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.802205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.802292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.802399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.802424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.523 qpair failed and we were unable to recover it. 00:30:20.523 [2024-11-27 03:25:22.802529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.523 [2024-11-27 03:25:22.802614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.802639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.802729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.802877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.802902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.802989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.803097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.803122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.803239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.803379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.803404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.803517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.803609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.803634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.803713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.803803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.803828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.803915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.803993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.804017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.804107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.804192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.804216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.804312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.804401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.804426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.804511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.804619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.804644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.804736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.804815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.804840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.804982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.805161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.805382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.805613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.805799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.805941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.806025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.806106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.806131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.806213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.806336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.806361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.806444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.806557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.806588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.806706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.806784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.806810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.806904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.807124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.807310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.807529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.807752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.807858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.807970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.808216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.808461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.808674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.808878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.808979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.809058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.809134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.809159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.809269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.809349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.809374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.809486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.809604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.809630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.809711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.809826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.809851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.809934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.810136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.810371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.810658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.810852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.810956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.811049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.811127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.811152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.811238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.811356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.811381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.811464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.811579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.811605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.811687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.811765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.811790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.524 [2024-11-27 03:25:22.811907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.811990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.524 [2024-11-27 03:25:22.812015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.524 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.812101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.812179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.812203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.812303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.812379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.812403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.812489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.812605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.812630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.812743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.812830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.812854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.812935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.813134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.813382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.813608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.813834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.813935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.814050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.814248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.814449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.814670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.814870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.814973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.815058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.815142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.815168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.815245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.815330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.815355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.815463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.815584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.815610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.815720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.815802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.815827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.815913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.815992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.816102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.816307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.816503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.816692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.816878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.816979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.817062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.817263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.817449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.817646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.817850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.817961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.818039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.818230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.818415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.818614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.818805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.818912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.819025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.819108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.819133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.819213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.819293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.819318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.819405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.819572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.819598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.819684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.819797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.819822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.819911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.819996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.820106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.820294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.820482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.820687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.820877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.820984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.821071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.821159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.821184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.821267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.821358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.821383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.525 [2024-11-27 03:25:22.821476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.821559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.525 [2024-11-27 03:25:22.821585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.525 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.821699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.821781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.821806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.821885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.821970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.821996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.822086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.822235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.822260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.822348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.822465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.822490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.822586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.822667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.822692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.822778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.822887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.822911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.823004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.823187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.823386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.823603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.823787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.823893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.823983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.824102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.824127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.824205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.824318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.824344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.824423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.824546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.824572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.824659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.824747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.824771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.824859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.824977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.825002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.825112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.825198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.825222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.825300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.825385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.825410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.825521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.825609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.825634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.825767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.825852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.825877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.825961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.826154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.826342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.826535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.826726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.826828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.826950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.827143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.827320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.827507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.827695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.827899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.827978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.828003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.828082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.828168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.828192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.828308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.828417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.828441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.828560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.828640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.828665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.828748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.828834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.828858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.828939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.829160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.829346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.829576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.829761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.829865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.829954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.830063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.830088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.830170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.830276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.830300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.830388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.830477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.830502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.830591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.830681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.830706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.526 qpair failed and we were unable to recover it. 00:30:20.526 [2024-11-27 03:25:22.830788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.526 [2024-11-27 03:25:22.830899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.830923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.831015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.831222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.831448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.831666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.831859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.831964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.832085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.832194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.832218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.832331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.832413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.832439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.832534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.832615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.832639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.832718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.832830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.832854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.832965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.833176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.833381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.833589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.833795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.833899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.834015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.834204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.834400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.834600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.834828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.834936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.835023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.835214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.835385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.835587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.835810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.835941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.836057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.836170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.836195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.836318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.836403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.836427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.836509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.836655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.836680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.836772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.836855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.836879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.836996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.837220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.837410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.837611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.837802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.837943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.838026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.838141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.838166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.838256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.838371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.838395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.838477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.838601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.838630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.838754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.838835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.838860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.838940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.839159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.839385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.839610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.839806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.839919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.839995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.840072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.840097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.840188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.840300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.840324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.527 qpair failed and we were unable to recover it. 00:30:20.527 [2024-11-27 03:25:22.840404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.527 [2024-11-27 03:25:22.840495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.840520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.840607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.840682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.840711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.840800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.840915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.840940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.841039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.841152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.841177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.841290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.841399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.841423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.841509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.841641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.841667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.841750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.841840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.841865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.841951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.842194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.842408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.842630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.842853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.842960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.843052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.843268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.843452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.843669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.843860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.843967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.844057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.844201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.844226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.844314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.844396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.844421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.844542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.844657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.844683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.844795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.844906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.844932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.845012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.845091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.845116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.845204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.845318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.845343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.845452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.845572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.845597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.845684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.845766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.845791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.845908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.845987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.846100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.846313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.846504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.846715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.846906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.846986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.847011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.847103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.847196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.847221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.847304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.847418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.847443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.847555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.847660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.847685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.847798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.847883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.847908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.848026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.848135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.848160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.848249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.848358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.848383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.848475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.848573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.848598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.848676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.848754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.848779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.848875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.848989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.849014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.849112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.849225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.849250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.849328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.849419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.849444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.849523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.849623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.849649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.849733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.849810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.849836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.849931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.850013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.850038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.850155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.850271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.850295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.850384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.850473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.850498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.528 qpair failed and we were unable to recover it. 00:30:20.528 [2024-11-27 03:25:22.850612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.850698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.528 [2024-11-27 03:25:22.850724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.850819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.850930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.850956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.851044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.851227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.851458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.851670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.851874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.851978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.852059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.852167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.852192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.852303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.852386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.852411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.852503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.852595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.852621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.852705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.852791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.852815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.852926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.853149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.853335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.853569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.853776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.853886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.853984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.854184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.854386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.854620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.854808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.854924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.855001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.855223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.855425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.855662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.855864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.855975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.856102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.856214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.856240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.856327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.856419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.856444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.856532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.856650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.856675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.856754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.856838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.856863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.856939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.857134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.857327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.857554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.857766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.857871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.857955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.858144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.858352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.858539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.858766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.858876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.858956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.859039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.859063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.859150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.859226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.859251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.859344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.859449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.859474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.529 [2024-11-27 03:25:22.859604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.859690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.529 [2024-11-27 03:25:22.859715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.529 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.859830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.859911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.859936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.860057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.860140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.860165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.860256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.860372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.860397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.860476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.860572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.860598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.860710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.860796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.860820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.860904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.861012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.861037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.861153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.861233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.861257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.861343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.861457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.861483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.861587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.861729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.861754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.861865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.862112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.862303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.862492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.862719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.862829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.862909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.863159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.863346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.863553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.863789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.863893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.864010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.864231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.864431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.864656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.864846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.864979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.865090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.865268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.865461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.865641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.865870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.865981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.866061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.866142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.866167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.866243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.866320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.866345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.866457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.866539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.866565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.866657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.866778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.866803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.866891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.867108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.867297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.867490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.867721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.867822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.867975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.868165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.868359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.868543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.868767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.868873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.868968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.869078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.869103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.869184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.869264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.869288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.869401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.869491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.869517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.530 qpair failed and we were unable to recover it. 00:30:20.530 [2024-11-27 03:25:22.869646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.869727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.530 [2024-11-27 03:25:22.869752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.869835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.869913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.869938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.870046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.870235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.870416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.870640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.870836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.870971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.871088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.871202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.871227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.871336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.871424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.871448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.871540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.871627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.871653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.871734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.871813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.871839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.871920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.871994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.872019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.872103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.872185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.872210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.872300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.872372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.872397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.872478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.872567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.872593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.872696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.872811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.872836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.872957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.873140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.873347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.873575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.873796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.873898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.874000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.874082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.874107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.874187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.874295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.874320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.874402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.874520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.874550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.874639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.874752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.874777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.874899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.874980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.875091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.875277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.875467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.875691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.875881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.875989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.876070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.876176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.876201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.876287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.876362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.876387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.876468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.876598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.876624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.876706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.876821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.876845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.876927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.877117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.877337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.877565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.877748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.877884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.877969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.878163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.878385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.878631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.878828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.878961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.879043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.879155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.879180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.879266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.879351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.879376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.531 qpair failed and we were unable to recover it. 00:30:20.531 [2024-11-27 03:25:22.879456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.879598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.531 [2024-11-27 03:25:22.879624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.879756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.879836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.879860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.879954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.880153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.880342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.880536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.880740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.880853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.880969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.881154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.881348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.881539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.881765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.881884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.881978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.882178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.882376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.882642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.882836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.882945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.883033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.883232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.883425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.883647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.883837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.883957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.884049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.884157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.884182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.884265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.884404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.884429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.884510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.884603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.884628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.884745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.884824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.884849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.884935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.885162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.885358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.885552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.885746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.885851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.885965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.886198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.886416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.886651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.886852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.886960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.887078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.887266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.887454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.887666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.887855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.532 [2024-11-27 03:25:22.887988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.532 qpair failed and we were unable to recover it. 00:30:20.532 [2024-11-27 03:25:22.888074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.888154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.888179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.888264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.888372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.888397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.888487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.888580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.888606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.888691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.888823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.888848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.888932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.889126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.889304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.889496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.889711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.889816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.889897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.890115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.890344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.890557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.890781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.890886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.890968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.891179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.891423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.891629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.891834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.891937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.892012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.892233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.892440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.892686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.892868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.892975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.893089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.893176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.893201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.893321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.893398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.893423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.893534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.893632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.893657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.893748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.893831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.893856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.893946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.894131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.894358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.894602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.894802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.894904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.894983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.895207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.895416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.895625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.895818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.895951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.896032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.896107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.896133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.896219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.896338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.896363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.896443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.896522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.896671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.896756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.896836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.896866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.896951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.897179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.897463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.897660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.897860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.533 [2024-11-27 03:25:22.897997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.533 qpair failed and we were unable to recover it. 00:30:20.533 [2024-11-27 03:25:22.898080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.898165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.898189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.898267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.898382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.898406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.898489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.898635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.898661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.898751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.898869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.898894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.898974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.899178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.899362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.899607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.899794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.899897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.900020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.900211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.900397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.900622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.900820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.900953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.901037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.901271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.901459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.901670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.901854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.901965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.902083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.902160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.902185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.902302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.902385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.902412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.902502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.902592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.902618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.902728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.902806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.902831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.902912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.902996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.903021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.903099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.903185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.903210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.903323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.903407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.903432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.903520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.903663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.903689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.903773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.903853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.903878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.903964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.904185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.904404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.904602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.904789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.904900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.904985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.905181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.905371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.905608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.905854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.905960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.906038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.906118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.906143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.906260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.906371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.906396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.906509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.906609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.906634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.906721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.906800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.906825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.906906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.906985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.907010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.907087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.907202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.907227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.907345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.907422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.907446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.907534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.907626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.907658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.534 qpair failed and we were unable to recover it. 00:30:20.534 [2024-11-27 03:25:22.907769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.907854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.534 [2024-11-27 03:25:22.907879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.907975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.908172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.908395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.908617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.908860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.908976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.909066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.909149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.909175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.909295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.909378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.909404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.909491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.909612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.909638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.909728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.909807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.909838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.909917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.910137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.910336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.910587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.910798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.910901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.910982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.911202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.911428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.911652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.911849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.911954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.912051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.912272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.912452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.912652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.912844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.912961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.913049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.913239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.913424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.913671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.913863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.913975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.914094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.914206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.914231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.914341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.914423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.914448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.914530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.914612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.914637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.914721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.914804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.914829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.914909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.915119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.915325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.915513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.915740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.915842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.915951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.916185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.916436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.916660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.535 [2024-11-27 03:25:22.916880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.535 [2024-11-27 03:25:22.916984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.535 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.917066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.917157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.917181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.917324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.917408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.917433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.917510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.917598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.917624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.917700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.917786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.917811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.917922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.918120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.918317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.918550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.918752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.918888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.918972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.919189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.919382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.919582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.919775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.919908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.920027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.920225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.920413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.920611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.920799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.920936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.921049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.921280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.921465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.921659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.921851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.921956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.922050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.922162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.922187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.922280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.922360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.922385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.922504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.922599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.922629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.922710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.922821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.922845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.922935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.923128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.923319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.923548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.923764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.923904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.923980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.924158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.924343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.924576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.924771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.924880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.924995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.925211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.925397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.925613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.925841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.925949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.926069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.926153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.926179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.926266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.926350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.926377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.926495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.926588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.926615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.536 qpair failed and we were unable to recover it. 00:30:20.536 [2024-11-27 03:25:22.926711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.536 [2024-11-27 03:25:22.926796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.926822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.926923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.927113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.927315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.927542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.927738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.927846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.927931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.928157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.928345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.928579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.928781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.928888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.929007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.929198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.929386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.929584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.929782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.929921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.930030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.930228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.930449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.930647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.930880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.930988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.931073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.931160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.931186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.931266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.931376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.931401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.931484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.931577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.931604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.931685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.931793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.931820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.931903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.931986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.932014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.932101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.932211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.932237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.932356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.932436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.932462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.932554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.932646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.932672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.932763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.932858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.932885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.932968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.933229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.933461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.933656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.933882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.933987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.934067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.934146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.934173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.934257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.934370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.934396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.934491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.934586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.934613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.934695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.934783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.934809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.934896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.935178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.935407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.935654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.935848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.935957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.936045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.936171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.936198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.936314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.936429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.936456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.936544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.936658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.537 [2024-11-27 03:25:22.936683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.537 qpair failed and we were unable to recover it. 00:30:20.537 [2024-11-27 03:25:22.936772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.936850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.936876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.936961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.937147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.937386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.937582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.937795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.937910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.938023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.938108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.938134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.938252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.938405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.938431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.938513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.938606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.938632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.938720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.938805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.938831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.938915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.939193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.939440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.939665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.939872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.939985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.940100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.940181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.940207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.940289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.940371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.940396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.940479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.940558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.940584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.940697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.940782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.940808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.940890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.940976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.941001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.941082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.941163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.941190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.941282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.941366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.941392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.941478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.941595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.941622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.941735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.941815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.941841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.941957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.942167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.942396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.942612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.942834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.942942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.943022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.943133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.943158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.943249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.943336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.943364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.943450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.943563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.943589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.943704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.943787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.943813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.943930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.944137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.944339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.944538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.944770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.944880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.944963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.945084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.945110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.538 qpair failed and we were unable to recover it. 00:30:20.538 [2024-11-27 03:25:22.945189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.945263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.538 [2024-11-27 03:25:22.945289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.945369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.945460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.945487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.945575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.945660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.945686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.945767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.945846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.945872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.945954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.946146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.946374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.946578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.946795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.946906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.946993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.947209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.947402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.947601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.947857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.947966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.948048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.948232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.948425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.948632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.948881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.948993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.949084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.949193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.949218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.949302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.949415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.949441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.949529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.949639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.949665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.949747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.949863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.949888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.949976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.950200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.950431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.950661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.950857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.950961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.951044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.951151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.951176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.951261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.951371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.951397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.951479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.951567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.951594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.951679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.951795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.951822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.951905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.951988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.952013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.952099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.952216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.952242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.952326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.952417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.952444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.952533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.952659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.952686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.952813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.952893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.952919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.952999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.953077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.953103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.953224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.953360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.953386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.953467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.953551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.953578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.953666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.953777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.953803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.953888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.953979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.954004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.954088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.954205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.954231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.954309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.954392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.954418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.954498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.954624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.954650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.954733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.954816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.954842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.954936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.955017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.539 [2024-11-27 03:25:22.955043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.539 qpair failed and we were unable to recover it. 00:30:20.539 [2024-11-27 03:25:22.955125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.955205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.955231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.955312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.955396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.955422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.955505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.955595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.955622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.955716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.955832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.955858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.955944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.956164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.956376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.956634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.956828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.956938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.957025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.957228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.957451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.957647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.957878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.957990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.958108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.958192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.958218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.958303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.958415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.958441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.958555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.958636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.958662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.958754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.958839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.958866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.958955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.959160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.959379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.959626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.959842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.959988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.960072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.960214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.960240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.960327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.960418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.960443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.960553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.960637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.960663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.960779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.960862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.960888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.960973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.961208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.961415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.961612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.961838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.961944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.962054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.962194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.962220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.962308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.962385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.962411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.962522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.962640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.962666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.962748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.962837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.962864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.962955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.963099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.963125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.963211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.963290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.963316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.963434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.963530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.963557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.963655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.963798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.963824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.963910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.963996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.964022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.964103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.964217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.964242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.964337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.964416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.964442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.964536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.964616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.964641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.964750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.964833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.964859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.964945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.965025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.965051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.540 qpair failed and we were unable to recover it. 00:30:20.540 [2024-11-27 03:25:22.965163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.540 [2024-11-27 03:25:22.965276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.965301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.965385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.965497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.965522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.965612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.965726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.965752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.965854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.965986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.966015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.966107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.966188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.966214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.966294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.966410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.966435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.966532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.966613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.966639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.966754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.966843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.966869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.966983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.967180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.967371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.967562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.967787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.967923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.968070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.968189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.968216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.968298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.968409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.968434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.968545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.968685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.968710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.968793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.968874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.968899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.969016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.969213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.969411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.969601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.969814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.969927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.970010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.970102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.970128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.970214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.970298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.970324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.970405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.970522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.970551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.970664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.970744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.970770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.970883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.970998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.971024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.971115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.971198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.971223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.971306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.971414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.971439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.971519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.971644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.971669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.971754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.971837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.971861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.971951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.972154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.972373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.972578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.972764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.972901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.972986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.973099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.973124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.973202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.973285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.973309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.973397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.973518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.541 [2024-11-27 03:25:22.973552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.541 qpair failed and we were unable to recover it. 00:30:20.541 [2024-11-27 03:25:22.973646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.973731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.973755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.973838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.973930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.973956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.974050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.974246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.974445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.974644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.974871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.974983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.975080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.975162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.975188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.975271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.975354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.975379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.975458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.975576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.975602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.975691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.975773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.975798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.975877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.975998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.976024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.976136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.976224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.976251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.976340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.976423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.976449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.976544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.976668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.976694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.976774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.976861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.976886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.976970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.977161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.977361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.977622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.977815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.977932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.978041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.978228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.978451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.978645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.978848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.978959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.979051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.979135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.979161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.979242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.979325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.979350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.979432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.979579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.979606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.979687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.979770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.979795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.979908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.979992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.980017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.980130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.980220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.980245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.980322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.980431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.980456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.980570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.980655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.980680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.980794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.980886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.980916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.980998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.981210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.981415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.981626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.981828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.981936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.982024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.982134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.982159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.982242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.982321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.982346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.982427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.982541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.982567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.542 qpair failed and we were unable to recover it. 00:30:20.542 [2024-11-27 03:25:22.982657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.542 [2024-11-27 03:25:22.982740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.982765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.982851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.982967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.983001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.983115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.983197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.983224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.983331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.983421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.983446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.983533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.983615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.983641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.983740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.983851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.983876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.983955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.984153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.984338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.984587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.984781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.984950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.985033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.985117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.985147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.985234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.985316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.985342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.985453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.985560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.985586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.985668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.985778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.985803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.985911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.985989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.986014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.986098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.986183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.986208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.986285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.986385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.986410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.986496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.986589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.986616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.986699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.986839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.986864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.986945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.987160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.987387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.987583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.987801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.987912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.987999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.988187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.988434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.988662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.988881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.988983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.989067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.989180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.989206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.989281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.989392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.989419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.989537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.989630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.989655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.989767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.989853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.989878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.989964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.990153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.990335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.990553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.990770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.990880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.990961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.991155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.991339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.991539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.991755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.991856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.991947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.992031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.992056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.992143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.992228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.992254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.543 [2024-11-27 03:25:22.992335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.992427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.543 [2024-11-27 03:25:22.992454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.543 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.992553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.992667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.992693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.992772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.992882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.992907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.992995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.993245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.993459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.993669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.993854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.993957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.994044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.994233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.994424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.994668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.994852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.994960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.995040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.995249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.995435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.995645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.995863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.995968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.996050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.996134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.996159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.996302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.996380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.996405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.996520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.996632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.996657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.996737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.996849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.996874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.996960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.997189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.997419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.997648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.997841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.997975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.998057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.998171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.998196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.998321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.998432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.998457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.998538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.998621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.998646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.998727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.998874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.998900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.999020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.999103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.999128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.999213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.999293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.999320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.999406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.999513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.999545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.999636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.999749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.999775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:22.999861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:22.999980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.000006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:23.000114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.000212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.000242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:23.000328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.000445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.000471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:23.000558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.000640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.000665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:23.000779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.000887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.000911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:23.001025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.001110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.001135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:23.001218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.001302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.001327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:23.001438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.001517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.001549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.544 qpair failed and we were unable to recover it. 00:30:20.544 [2024-11-27 03:25:23.001641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.544 [2024-11-27 03:25:23.001728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.001753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.001864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.001978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.002004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.002088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.002164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.002189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.002280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.002367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.002392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.002476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.002567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.002592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.002710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.002800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.002827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.002916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.003110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.003331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.003589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.003792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.003896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.003975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.004219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.004448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.004656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.004853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.004988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.005101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.005179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.005204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.005325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.005410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.005436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.005518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.005624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.005650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.005739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.005847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.005872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.005957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.006185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.006379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.006586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.006795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.006902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.006983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.007210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.007403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.007632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.007814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.007949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.008034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.008262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.008467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.008697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.008887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.008992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.009085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.009196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.009221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.009308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.009404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.009429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.009507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.009591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.009616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.009732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.009816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.009841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.009952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.010146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.010400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.010598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.010843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.010990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.011078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.011159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.011184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.011298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.011378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.011403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.545 [2024-11-27 03:25:23.011488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.011584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.545 [2024-11-27 03:25:23.011610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.545 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.011693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.011771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.011797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.011881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.011963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.011988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.012129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.012206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.012231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.012310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.012391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.012418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.012537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.012629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.012655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.012745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.012833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.012858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.012941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.013168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.013398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.013619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.013840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.013980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.014065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.014147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.014172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.014253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.014367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.014393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.014542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.014655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.014680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.014765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.014879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.014905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.015021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.015109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.015137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.015261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.015374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.015401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.015499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.015618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.015644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.015758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.015841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.015866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.015958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.016100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.016126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.016208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.016290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.016314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.016432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.016513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.016545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.016666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.016753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.016778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.016896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.016984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.017011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.017125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.017239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.017264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.017383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.017470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.017495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.017599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.017715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.017739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.017831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.017919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.017946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.018098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.018177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.018201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.018288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.018365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.018390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.018480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.018566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.018591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.018675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.018783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.018808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.018900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.019119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.019345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.019593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.019785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.019926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.020021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.020209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.020399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.020590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.020788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.020890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.021000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.021082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.021107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.021186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.021272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.021298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.546 [2024-11-27 03:25:23.021459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.021537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.546 [2024-11-27 03:25:23.021561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.546 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.021641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.021755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.021780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.021863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.022160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.022383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.022576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.022845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.022985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.023067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.023150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.023175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.023289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.023372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.023402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.023514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.023606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.023633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.023753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.023838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.023863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.024002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.024112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.024137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.024222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.024301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.024327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.024416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.024495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.024520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.024645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.024729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.024755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.024842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.025035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.025061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.025172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.025361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.025387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.025468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.025583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.025610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.025702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.025817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.025842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.025927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.026177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.026371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.026606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.026835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.026940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.027033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.027146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.027171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.027253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.027342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.027367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.547 qpair failed and we were unable to recover it. 00:30:20.547 [2024-11-27 03:25:23.027563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.547 [2024-11-27 03:25:23.027674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.027699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.027813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.027925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.027949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.028041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.028122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.028147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.028232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.028309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.028334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.028428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.028507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.028537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.028617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.028698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.028722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.028846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.029040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.029065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.029188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.029302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.029327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.029445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.029555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.029582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.029695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.029774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.029799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.029911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.030134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.030355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.030535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.030735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.030838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.030950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.031134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.031339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.031548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.031778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.031888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.032002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.032197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.032394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.032601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.032851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.032991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.033073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.033149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.033174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.033293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.033375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.033402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.033484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.033580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.033606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.033685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.033796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.033821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.033928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.034015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.034040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.034150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.034263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.034287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.548 qpair failed and we were unable to recover it. 00:30:20.548 [2024-11-27 03:25:23.034367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.548 [2024-11-27 03:25:23.034445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.034470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.034552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.034663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.034688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.034778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.034894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.034920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.035006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.035221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.035434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.035627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.035854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.035957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.036042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.036135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.036161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.036279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.036363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.036388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.036534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.036619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.036646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.036728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.036811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.036836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.036927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.037148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.037397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.037598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.037782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.037897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.037980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.038165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.038405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.038626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.038852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.038994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.039103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.039214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.039238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.039352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.039435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.039459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.039558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.039648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.039674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.039789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.039867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.039892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.039970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.040167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.040388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.040617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.040805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.040914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.041025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.041111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.041136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.549 qpair failed and we were unable to recover it. 00:30:20.549 [2024-11-27 03:25:23.041221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.549 [2024-11-27 03:25:23.041326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.041350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.041432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.041552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.041577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.041659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.041740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.041764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.041888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.041966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.041991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.042071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.042182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.042211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.042292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.042375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.042401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.042492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.042583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.042610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.042727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.042817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.042842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.042957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.043038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.043062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.043204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.043311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.043335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.043423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.043508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.043553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.043665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.043776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.043801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.043889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.044136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.044358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.044624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.044816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.044949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.045032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.045141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.045167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.045252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.045392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.045417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.045498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.045618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.045643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.045766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.045844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.045868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.045954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.046146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.046356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.046551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.046814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.046919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.047062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.047257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.047449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.047679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.047885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.047992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.048078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.048198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.048223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.550 qpair failed and we were unable to recover it. 00:30:20.550 [2024-11-27 03:25:23.048298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.550 [2024-11-27 03:25:23.048377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.048401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.048484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.048605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.048631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.048717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.048829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.048858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.048949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.049172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.049423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.049615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.049834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.049938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.050030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.050276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.050468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.050673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.050872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.050975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.051059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.051147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.051172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.051292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.051487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.051513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.051661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.051775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.051800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.051882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.051970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.051994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.052104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.052188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.052212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.052333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.052442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.052466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.052554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.052637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.052662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.052777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.052861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.052885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.052995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.053211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.053412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.053635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.053859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.053988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.054111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.054194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.054218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.054315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.054392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.054416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.054496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.054612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.054638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.551 [2024-11-27 03:25:23.054747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.054859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.551 [2024-11-27 03:25:23.054884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.551 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.054993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.055098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.055122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.055219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.055335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.055360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.055500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.055631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.055656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.055776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.055857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.055882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.055961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.056187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.056379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.056598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.056784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.056891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.056969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.057043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.057067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.057157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.057244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.057269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.057382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.057549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.057575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.057698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.057788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.057813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.057899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.057982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.058007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.058088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.058168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.058193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.058301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.058382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.058406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.058535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.058626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.058650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.058737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.058822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.058846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.058927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.059137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.059381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.059611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.059830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.059941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.060036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.060119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.060144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.060229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.060311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.060335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.060416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.060531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.060556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.060654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.060770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.060796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.060879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.061139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.061336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.061583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.061810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.061913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.061995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.062106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.062131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.062217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.062305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.062330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.552 qpair failed and we were unable to recover it. 00:30:20.552 [2024-11-27 03:25:23.062446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.552 [2024-11-27 03:25:23.062534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.062559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.062675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.062756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.062781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.062894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.063007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.063032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.063114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.063200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.063225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.063340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.063453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.063477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.063563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.063646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.063671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.063866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.063988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.064012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.064095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.064180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.064204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.064293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.064374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.064399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.064531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.064611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.064636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.064747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.064831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.064855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.064935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.065152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.065358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.065574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.065800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.065908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.065988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.066195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.066392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.066631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.066863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.066987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.067080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.067167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.067192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.067281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.067361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.067387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.067503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.067595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.067622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.067735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.067844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.067869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.067980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.068168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.068405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.068611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.068806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.068949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.069063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.069146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.069172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.069262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.069344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.069370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.069456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.069571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.069599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.069681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.069793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.553 [2024-11-27 03:25:23.069818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.553 qpair failed and we were unable to recover it. 00:30:20.553 [2024-11-27 03:25:23.069924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.070117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.070343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.070574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.070803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.070908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.070989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.071243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.071441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.071654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.071871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.071979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.072087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.072199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.072224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.072341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.072429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.072455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.072546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.072635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.072662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.072751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.072833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.072858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.072943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.073130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.073342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.073575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.073761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.073933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.074015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.074202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.074436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.074631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.074850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.074964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.075048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.075127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.075152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.075232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.075321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.075347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.075463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.075547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.075574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.075691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.075779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.075804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.075920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.076001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.076027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.076144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.076272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.076299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.554 qpair failed and we were unable to recover it. 00:30:20.554 [2024-11-27 03:25:23.076383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.076466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.554 [2024-11-27 03:25:23.076492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.076639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.076717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.076743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.076830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.076912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.076938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.077057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.077150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.077178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.077290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.077374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.077400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.077479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.077568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.077599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.077695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.077780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.077806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.077888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.077978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.078003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.078084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.078169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.078195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.078286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.078365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.078390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.078512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.078601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.078627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.078705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.078783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.078809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.078922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.079153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.079352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.079595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.079801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.079904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.080046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.080130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.080156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.080270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.080344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.080370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.080453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.080551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.080579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.080668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.080752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.080778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.080898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.080981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.081006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.081086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.081169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.081195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.081288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.081398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.081424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.081559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.081668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.081694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.081774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.081868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.081899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.082000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.082075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.082101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.082202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.082284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.082310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.555 qpair failed and we were unable to recover it. 00:30:20.555 [2024-11-27 03:25:23.082391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.555 [2024-11-27 03:25:23.082473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.082501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa0000b90 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.082639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.082739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.082768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.082888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.082965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.082990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.083075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.083255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.083457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.083674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.083868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.083983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.084102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.084297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.084481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.084695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.084892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.084999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.085079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.085190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.085216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.085295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.085382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.085407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.085533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.085619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.085644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.085727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.085809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.085835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.085949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.086145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.086375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.086581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.086779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.086916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.087027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.087223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.087416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.087624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.087832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.087985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.088097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.088181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.088206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.088303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.088388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.088413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.088496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.088611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.088636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.088717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.088802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.088827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.088907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.088994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.089020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.556 qpair failed and we were unable to recover it. 00:30:20.556 [2024-11-27 03:25:23.089098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.556 [2024-11-27 03:25:23.089209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.089234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.089316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.089396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.089422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.089542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.089621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.089647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.089729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.089811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.089838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.089918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.090125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.090337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.090573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.090786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.090896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.090984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.091204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.091454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.091675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.091894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.091999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.092110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.092191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.092217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.092318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.092401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.092426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.092506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.092597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.092627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.092713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.092796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.092822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.092901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.092988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.093013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.093105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.093216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.093241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.093325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.093452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.093478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.093579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.093661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.093687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.093766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.093875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.093899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.093979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.094087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.094112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.094194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.094308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.094333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.094447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.094561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.094587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.094704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.094792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.094817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.094923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.095108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.095299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.095480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.095670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.095899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.095978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.096003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.096122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.096199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.096224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.557 qpair failed and we were unable to recover it. 00:30:20.557 [2024-11-27 03:25:23.096306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.557 [2024-11-27 03:25:23.096392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.096418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.096503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.096595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.096620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.096734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.096854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.096881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.096970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.097193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.097377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.097612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.097811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.097920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.098009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.098085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.098110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.098233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.098348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.098373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.098484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.098569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.098594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.098677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.098759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.558 [2024-11-27 03:25:23.098784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.558 qpair failed and we were unable to recover it. 00:30:20.558 [2024-11-27 03:25:23.098866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.845 [2024-11-27 03:25:23.098954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.845 [2024-11-27 03:25:23.098979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.845 qpair failed and we were unable to recover it. 00:30:20.845 [2024-11-27 03:25:23.099063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.845 [2024-11-27 03:25:23.099170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.845 [2024-11-27 03:25:23.099195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.845 qpair failed and we were unable to recover it. 00:30:20.845 [2024-11-27 03:25:23.099279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.845 [2024-11-27 03:25:23.099360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.845 [2024-11-27 03:25:23.099385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.845 qpair failed and we were unable to recover it. 00:30:20.845 [2024-11-27 03:25:23.099464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.845 [2024-11-27 03:25:23.099550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.845 [2024-11-27 03:25:23.099575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.845 qpair failed and we were unable to recover it. 00:30:20.845 [2024-11-27 03:25:23.099693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.099775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.099800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.099882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.099971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.099996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.100109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.100221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.100245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.100324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.100435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.100462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.100557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.100646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.100671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.100784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.100868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.100892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.101004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.101188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.101384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.101602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.101790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.101930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.102019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.102128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.102154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.102233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.102323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.102355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.102474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.102588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.102623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.102734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.102820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.102844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.102930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.103186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.103441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.103681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.103880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.103986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.104076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.104276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.104467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.104678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.104876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.104990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.105104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.105182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.105207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.105290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.105380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.105404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.105518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.105647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.105676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.846 [2024-11-27 03:25:23.105792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.105876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.846 [2024-11-27 03:25:23.105901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.846 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.106017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.106244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.106436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.106651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.106845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.106979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.107061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.107141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.107167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.107248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.107358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.107382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.107469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.107560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.107586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.107674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.107781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.107806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.107892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.107980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.108004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.108085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.108167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.108193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.108285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.108391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.108416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.108499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.108588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.108613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.108690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.108767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.108792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.108903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.109157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.109377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.109644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.109840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.109947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.110035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.110140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.110164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.110250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.110354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.110379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.110502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.110604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.110628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.110719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.110809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.110834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.110915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.110997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.111023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.111108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.111222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.111247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.111328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.111436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.111460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.111552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.111639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.111664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.111753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.111835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.111859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.847 qpair failed and we were unable to recover it. 00:30:20.847 [2024-11-27 03:25:23.111970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.112052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.847 [2024-11-27 03:25:23.112078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.112153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.112265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.112290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.112380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.112487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.112511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.112626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.112705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.112730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.112840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.112927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.112953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.113028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.113238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.113456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.113658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.113844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.113975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.114054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.114141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.114167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.114259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.114375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.114399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.114496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.114611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.114637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.114714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.114797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.114821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.114940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.115138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.115359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.115619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.115863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.115974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.116089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.116197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.116222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.116320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.116430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.116455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.116566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.116657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.116686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.116772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.116847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.116872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.116953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.117140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.117319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.117556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.117776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.117880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.117964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.118041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.118066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.848 qpair failed and we were unable to recover it. 00:30:20.848 [2024-11-27 03:25:23.118148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.848 [2024-11-27 03:25:23.118230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.118254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.118339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.118419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.118443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.118553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.118665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.118690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.118778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.118887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.118912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.118994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.119219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.119411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.119601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.119807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.119918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.120015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.120136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.120161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.120241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.120322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.120346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.120433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.120541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.120565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.120676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.120788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.120812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.120952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.121201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.121430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.121645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.121861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.121967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.122049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.122130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.122155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.122237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.122363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.122387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.122477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.122560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.122585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.122699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.122774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.122798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.122882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.122995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.123021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.123115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.123203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.123227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.123303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.123415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.123440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.123530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.123615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.123640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.123753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.123830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.123854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.123937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.124017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.124043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.124131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.124250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.124274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.849 qpair failed and we were unable to recover it. 00:30:20.849 [2024-11-27 03:25:23.124360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.849 [2024-11-27 03:25:23.124439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.124464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.124578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.124691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.124716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.124795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.124910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.124935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.125030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.125109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.125133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.125218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.125338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.125363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.125458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.125586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.125613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.125704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.125809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.125834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.125947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.126166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.126411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.126620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.126815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.126913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.127034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.127223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.127420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.127621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.127868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.127972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.128060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.128276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.128486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.128696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.128887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.128990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.129072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.129178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.129203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.129279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.129360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.129384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.850 qpair failed and we were unable to recover it. 00:30:20.850 [2024-11-27 03:25:23.129499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.850 [2024-11-27 03:25:23.129593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.129618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.129704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.129792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.129818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.129938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.130117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.130307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.130487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.130708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.130909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.130996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.131021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.131130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.131208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.131234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.131317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.131437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.131463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.131579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.131661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.131685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.131781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.131887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.131911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.131996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.132071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.132095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.132214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.132323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.132347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.132458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.132566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.132592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.132702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.132812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.132836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.132928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.133140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.133326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.133507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.133730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.133840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.133958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.134148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.134368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.134598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.134832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.134994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.135075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.135186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.135210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.135319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.135404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.135428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.135506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.135604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.851 [2024-11-27 03:25:23.135628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.851 qpair failed and we were unable to recover it. 00:30:20.851 [2024-11-27 03:25:23.135713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.135793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.135817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.135932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.136142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.136368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.136554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.136777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.136878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.136961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.137209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.137437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.137627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.137877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.137984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.138095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.138237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.138261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.138376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.138490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.138518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.138617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.138698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.138723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.138837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.138918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.138943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.139055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.139138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.139163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.139249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.139351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.139375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.139465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.139556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.139581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.139691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.139803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.139827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.139912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.139999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.140023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.140134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.140241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.140265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.140340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.140417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.140442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.140560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.140653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.140682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.140769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.140881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.140905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.141010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.141122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.141146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.141226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.141340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.141364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.141477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.141622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.141647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.141731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.141819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.141843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.141954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.142033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.852 [2024-11-27 03:25:23.142057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.852 qpair failed and we were unable to recover it. 00:30:20.852 [2024-11-27 03:25:23.142139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.142253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.142278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.142387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.142473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.142498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.142605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.142689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.142713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.142801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.142877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.142901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.142993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.143197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.143419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.143642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.143863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.143970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.144050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.144159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.144183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.144264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.144347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.144371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.144480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.144561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.144590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.144669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.144782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.144808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.144900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.144984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.145008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.145099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.145215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.145240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.145325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.145407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.145432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.145513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.145609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.145635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.145720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.145847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.145873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.145952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.146170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.146381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.146603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.146819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.146919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.146995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.147197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.147424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.147628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.147825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.147927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.148040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.148118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.853 [2024-11-27 03:25:23.148142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.853 qpair failed and we were unable to recover it. 00:30:20.853 [2024-11-27 03:25:23.148264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.148345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.148370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.148449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.148580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.148606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.148721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.148835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.148859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.148955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.149038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.149063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.149142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.149281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.149306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.149447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.149543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.149568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.149658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.149765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.149796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.149912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.150126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.150375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.150627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.150857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.150994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.151076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.151155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.151180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.151273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.151357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.151381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.151465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.151548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.151573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.151657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.151738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.151767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.151877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.151991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.152016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.152095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.152175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.152199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.152306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.152388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.152412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.152536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.152623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.152647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.152759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.152872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.152896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.152974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.153208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.153394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.153592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.153819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.153924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.154006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.154117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.854 [2024-11-27 03:25:23.154141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.854 qpair failed and we were unable to recover it. 00:30:20.854 [2024-11-27 03:25:23.154253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.154338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.154363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.154445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.154578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.154605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.154691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.154771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.154805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.154918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.155174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.155409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.155668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.155888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.155995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.156086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.156205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.156230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.156321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.156397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.156422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.156509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.156631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.156656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.156747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.156827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.156851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.156941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.157167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.157409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.157612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.157839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.157941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.158051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.158164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.158189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.158274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.158388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.158413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.158516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.158618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.158643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.158731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.158814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.158838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.158924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.159152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.159370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.159564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.159793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.159903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.160014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.160130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.160154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.855 qpair failed and we were unable to recover it. 00:30:20.855 [2024-11-27 03:25:23.160236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.855 [2024-11-27 03:25:23.160318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.160343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.160419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.160494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.160519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.160617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.160700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.160725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.160819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.160928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.160954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.161052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.161166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.161191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.161276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.161354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.161378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.161500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.161633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.161657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.161747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.161863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.161887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.161967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.162107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.162131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.162219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.162307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.162331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.162409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.162523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.162573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.162687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.162764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.162789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.162907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.163132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.163345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.163573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.163770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.163919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.164031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.164219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.164445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.164637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.164827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.164936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.165049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.165250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.165443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.165663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.165852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.165984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.166098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.166239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.166263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.166339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.166421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.166446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.856 qpair failed and we were unable to recover it. 00:30:20.856 [2024-11-27 03:25:23.166564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.856 [2024-11-27 03:25:23.166646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.166671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.166762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.166868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.166894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.166977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.167156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.167362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.167564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.167815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.167922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.168008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.168199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.168395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.168620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.168836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.168933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.169021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.169105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.169130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.169236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.169322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.169346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.169431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.169542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.169567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.169662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.169745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.169770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.169857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.169981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.170006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.170148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.170235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.170260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.170380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.170493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.170518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.170614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.170724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.170749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.170834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.170941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.170965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.171050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.171165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.171189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.171276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.171386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.171410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.171490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.171576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.171601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.171688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.171771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.171796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.171924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.172031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.172055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.172137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.172247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.172271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.172354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.172436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.172461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.172560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.172676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.172701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.857 qpair failed and we were unable to recover it. 00:30:20.857 [2024-11-27 03:25:23.172784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.857 [2024-11-27 03:25:23.172895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.172919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.173020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.173267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.173447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.173656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.173844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.173954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.174034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.174149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.174175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.174262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.174341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.174366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.174506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.174621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.174647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.174738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.174840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.174867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.174952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.175172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.175360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.175583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.175781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.175885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.175992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.176099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.176123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.176235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.176320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.176344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.176457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.176570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.176595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.176713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.176799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.176834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.176918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.176999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.177024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.177114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.177202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.177229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.177310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.177418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.177442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.177599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.177681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.177705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.177822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.177940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.177973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.178068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.178171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.178197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.178284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.178369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.178393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.178502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.178596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.178622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.178768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.178862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.178888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.179020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.179146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.179170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.858 qpair failed and we were unable to recover it. 00:30:20.858 [2024-11-27 03:25:23.179265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.858 [2024-11-27 03:25:23.179351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.179375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.179484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.179573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.179599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.179684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.179770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.179794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.179906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.180160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.180354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.180555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.180786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.180895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.180980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.181187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.181378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.181663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.181862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.181968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.182076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.182154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.182179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.182263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.182347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.182372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.182481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.182617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.182643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.182776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.182862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.182886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.182981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.183092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.183117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.183202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.183292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.183317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.183455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.183550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.183577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.183689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.183773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.183798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.183908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.184158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.184366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.184609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.184808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.184953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.859 qpair failed and we were unable to recover it. 00:30:20.859 [2024-11-27 03:25:23.185031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.859 [2024-11-27 03:25:23.185114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.185139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.185220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.185309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.185333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.185415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.185543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.185569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.185650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.185733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.185757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.185844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.185920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.185946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.186050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.186163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.186189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.186276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.186390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.186414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.186539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.186617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.186642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.186726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.186837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.186861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.186968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.187168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.187410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.187630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.187815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.187928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.188009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.188191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.188411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.188606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.188784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.188917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.189003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.189200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.189430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.189625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.189832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.189943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.190051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.190243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.190428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.190633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.190826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.190930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.860 qpair failed and we were unable to recover it. 00:30:20.860 [2024-11-27 03:25:23.191015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.860 [2024-11-27 03:25:23.191126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.191151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.191241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.191322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.191345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.191427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.191500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.191532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.191651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.191731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.191757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.191880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.191964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.191988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.192070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.192258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.192451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.192671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.192862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.192995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.193074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.193265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.193452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.193647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.193846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.193948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.194025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.194112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.194136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.194220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.194302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.194327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.194441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.194538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.194564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.194646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.194755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.194779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.194906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.195118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.195310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.195540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.195758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.195909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.195998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.196186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.196440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.196669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.196889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.196993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.861 qpair failed and we were unable to recover it. 00:30:20.861 [2024-11-27 03:25:23.197076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.861 [2024-11-27 03:25:23.197160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.197184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.197276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.197350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.197374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.197457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.197544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.197569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.197648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.197769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.197794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.197907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.198128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.198347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.198540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.198728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.198836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.198946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.199169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.199420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.199645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.199841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.199944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.200033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.200267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.200476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.200676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.200873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.200975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.201050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.201130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.201155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.201232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.201345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.201369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.201485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.201584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.201609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.201693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.201774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.201798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.201912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.201996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.202021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.202112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.202196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.202221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.202317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.202393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.202417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.202503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.202642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.202667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.202750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.202840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.202865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.202963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.203071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.203096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.862 qpair failed and we were unable to recover it. 00:30:20.862 [2024-11-27 03:25:23.203185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.862 [2024-11-27 03:25:23.203296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.203320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.203435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.203521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.203553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.203634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.203715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.203739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.203837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.203913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.203937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.204022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.204160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.204184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.204274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.204417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.204442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.204537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.204623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.204648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.204729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.204883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.204907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.204994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.205209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.205409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.205633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.205838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.205940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.206021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.206237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.206419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.206613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.206821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.206958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.207071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.207251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.207475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.207674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.207867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.207973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.208056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.208306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.208502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.208695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.208891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.208993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.209073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.209158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.209182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.863 qpair failed and we were unable to recover it. 00:30:20.863 [2024-11-27 03:25:23.209261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.863 [2024-11-27 03:25:23.209397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.209421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.209499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.209595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.209620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.209700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.209782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.209807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.209890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.210107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.210363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.210631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.210834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.210944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.211035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.211251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.211471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.211671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.211862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.211966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.212080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.212187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.212211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.212303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.212380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.212403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.212519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.212607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.212631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.212753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.212850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.212874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.212968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.213165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.213383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.213572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.213789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.213892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.214006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.214088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.214113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.214233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.214312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.214337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.214430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.214511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.214541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.864 qpair failed and we were unable to recover it. 00:30:20.864 [2024-11-27 03:25:23.214634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.864 [2024-11-27 03:25:23.214720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.214744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.214843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.214927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.214952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.215058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.215145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.215169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.215253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.215380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.215406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.215485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.215602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.215628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.215738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.215815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.215840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.215929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.216136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.216331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.216541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.216789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.216929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.217005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.217194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.217427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.217653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.217854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.217998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.218094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.218170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.218194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.218272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.218384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.218409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.218496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.218624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.218649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.218742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.218851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.218875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.218992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.219176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.219377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.219575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.219818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.219956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.220044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.220129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.220154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.220236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.220345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.220370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.220456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.220568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.220593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.220682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.220798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.865 [2024-11-27 03:25:23.220823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.865 qpair failed and we were unable to recover it. 00:30:20.865 [2024-11-27 03:25:23.220902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.220982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.221007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.221096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.221174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.221198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.221277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.221405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.221430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.221523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.221624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.221648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.221723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.221820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.221849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.221941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.222136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.222321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.222514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.222744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.222908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.222992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.223185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.223384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.223579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.223796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.223909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.223992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.224211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.224463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.224659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.224852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.224959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.225043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.225253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.225443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.225664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.225858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.225993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.226080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.226152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.226176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.226272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.226354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.226378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.226498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.226595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.226619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.226706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.226786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.866 [2024-11-27 03:25:23.226811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.866 qpair failed and we were unable to recover it. 00:30:20.866 [2024-11-27 03:25:23.226908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.227157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.227349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.227572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.227757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.227874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.227965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.228181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.228375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.228593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.228783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.228890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.228971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.229194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.229406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.229604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.229827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.229961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.230072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.230270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.230470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.230662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.230875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.230982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.231071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.231154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.231179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.231270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.231350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.231374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.231462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.231556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.231582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.231676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.231750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.231775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.231898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.231981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.232005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.232088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.232205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.232229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.232312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.232421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.232452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.232567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.232648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.232672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.232757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.232846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.232872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.867 qpair failed and we were unable to recover it. 00:30:20.867 [2024-11-27 03:25:23.232950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.867 [2024-11-27 03:25:23.233038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.233063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.233143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.233220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.233245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.233325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.233405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.233429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.233519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.233603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.233628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.233712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.233807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.233840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.233923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.234165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.234350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.234584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.234783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.234916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.235000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.235196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.235379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.235600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.235786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.235894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.235984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.236179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.236363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.236637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.236833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.236975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.237056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.237193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.237218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.237337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.237420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.237446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.237548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.237637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.237663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.237744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.237836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.237860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.237944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.238031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.238055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.238148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.238230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.868 [2024-11-27 03:25:23.238254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.868 qpair failed and we were unable to recover it. 00:30:20.868 [2024-11-27 03:25:23.238339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.238417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.238441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.238570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.238654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.238679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.238766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.238885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.238910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.239025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.239243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.239448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.239670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.239890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.239999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.240089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.240165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.240189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.240274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.240352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.240376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.240465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.240560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.240585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.240671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.240783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.240807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.240917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.241146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.241346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.241572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.241795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.241932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.242024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.242215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.242440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.242632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.242833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.242939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.243021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.243205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.243428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.243613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.243837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.243947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.244063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.244143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.244169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.869 qpair failed and we were unable to recover it. 00:30:20.869 [2024-11-27 03:25:23.244251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.869 [2024-11-27 03:25:23.244329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.244354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.244482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.244570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.244594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.244689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.244772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.244796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.244909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.244989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.245013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.245126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.245231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.245261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.245343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.245452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.245477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.245567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.245655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.245679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.245761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.245855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.245880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.245998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.246185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.246381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.246592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.246784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.246899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.247017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.247206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.247437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.247646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.247838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.247956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.248075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.248180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.248205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.248285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.248365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.248389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.248476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.248559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.248584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.248666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.248784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.248808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.248923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.248999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.249023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.249119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.249226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.249251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.249330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.249418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.249443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.249538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.249620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.249644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.249752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.249842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.249866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.249992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.250085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.250110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.250213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.250304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.250328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.870 qpair failed and we were unable to recover it. 00:30:20.870 [2024-11-27 03:25:23.250408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.870 [2024-11-27 03:25:23.250484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.250509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.250598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.250676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.250700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.250816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.250892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.250916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.251027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.251247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.251434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.251662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.251853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.251987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.252100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.252173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.252197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.252310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.252390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.252414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.252531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.252616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.252641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.252726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.252807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.252835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.252912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.252996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.253020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.253141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.253227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.253251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.253338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.253448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.253472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.253568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.253650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.253674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.253783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.253873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.253898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.253995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.254186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.254400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.254655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.254882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.254985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.255094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.255171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.255195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.255282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.255365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.255389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.255472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.255593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.255619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.255701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.255785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.255809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.255918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.255998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.256026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.256142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.256228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.256253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.256333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.256451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.256475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.871 qpair failed and we were unable to recover it. 00:30:20.871 [2024-11-27 03:25:23.256565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.871 [2024-11-27 03:25:23.256674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.256698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.256779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.256895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.256920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.257001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.257203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.257427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.257646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.257848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.257983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.258092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.258171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.258196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.258285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.258369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.258394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.258506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.258628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.258653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.258732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.258854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.258879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.259019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.259248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.259468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.259673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.259887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.259994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.260076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.260188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.260213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.260300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.260375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.260400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.260510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.260605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.260629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.260713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.260791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.260816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.260905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.260982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.261093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.261276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.261470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.261676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.261877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.261984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.262101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.262178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.262202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.262283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.262361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.262386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.262483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.262587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.262612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.872 qpair failed and we were unable to recover it. 00:30:20.872 [2024-11-27 03:25:23.262700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.872 [2024-11-27 03:25:23.262781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.262806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.262926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.263143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.263331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.263579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.263777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.263909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.263994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.264193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.264377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.264604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.264812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.264913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.264993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.265225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.265408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.265627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.265819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.265927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.266018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.266099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.266124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.266235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.266315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.266339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.266426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.266506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.266536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.266664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.266742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.266771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.266862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.266977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.267001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.267094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.267239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.267263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.267347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.267456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.267480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.267566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.267657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.267681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.267794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.267902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.267926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.873 [2024-11-27 03:25:23.268012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.268090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.873 [2024-11-27 03:25:23.268114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.873 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.268197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.268312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.268337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.268417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.268497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.268522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.268619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.268711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.268735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.268849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.268938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.268962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.269046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.269165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.269189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.269300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.269441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.269465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.269562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.269642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.269667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.269760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.269837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.269863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.269946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.270136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.270350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.270558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.270747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.270862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.270984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.271180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.271388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.271609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.271827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.271927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.272009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.272208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.272405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.272601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.272792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.272930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.273010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.273197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.273378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.273582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.273775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.273882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.874 [2024-11-27 03:25:23.273991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.274102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.874 [2024-11-27 03:25:23.274126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.874 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.274205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.274287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.274312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.274432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.274520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.274551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.274635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.274717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.274743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.274829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.274905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.274928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.275047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.275126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.275150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.275233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.275315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.275339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.275450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.275538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.275564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.275649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.275727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.275752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.275898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.275978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.276084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.276281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.276504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.276697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.276894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.276989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.277126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.277308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.277535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.277723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.277912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.277996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.278020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.278099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.278179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.278203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.278358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.278437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.278461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.278556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.278640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.278664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.278744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.278829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.278853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.278935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.279160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.279353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.279541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.279757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.279889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.875 [2024-11-27 03:25:23.279968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.280050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.875 [2024-11-27 03:25:23.280074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.875 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.280181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.280297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.280323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.280404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.280548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.280573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.280656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.280740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.280765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.280909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.280989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.281092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.281292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.281470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.281709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.281907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.281995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.282101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.282299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.282515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.282714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.282905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.282994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.283018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.283130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.283205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.283229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.283314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.283422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.283446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.283560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.283653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.283678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.283761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.283846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.283871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.283961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.284043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.284068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.284152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.284231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.284255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.284420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.284506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.284535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.284643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.284758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.284782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.284903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.284983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.285008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.285094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.285181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.285207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.285319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.285408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.285433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.285513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.285599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.285624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.285702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.285819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.285843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.285930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.286064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.286089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.876 [2024-11-27 03:25:23.286170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.286252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.876 [2024-11-27 03:25:23.286277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.876 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.286385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.286468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.286493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.286588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.286670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.286694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.286785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.286904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.286929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.287019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.287098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.287124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.287203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.287336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.287361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.287454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.287560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.287585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.287676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.287753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.287777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.287893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.288105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.288301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.288533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.288751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.288857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.288939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.289046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.289071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.289155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.289238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.289263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.289426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.289539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.289564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.289649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.289757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.289782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.289897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.290139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.290365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.290619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.290840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.290950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.291033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.291135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.291160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.291247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.291325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.291350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.291436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.291623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.291650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.291766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.291847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.291872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.877 [2024-11-27 03:25:23.291957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.292063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.877 [2024-11-27 03:25:23.292087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.877 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.292198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.292281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.292306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.292410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.292493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.292517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.292607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.292723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.292748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.292848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.292924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.292949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.293067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.293173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.293198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.293279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.293365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.293391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.293514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.293637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.293661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.293748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.293834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.293858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.293966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.294218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.294425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.294643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.294831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.294936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.295048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.295243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.295427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.295663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.295879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.295981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.296072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.296266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.296463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.296682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.296874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.296986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.297108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.297194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.297220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.297337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.297422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.297448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.297539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.297618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.297643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.297725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.297810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.297834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.297925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.298033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.298057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.878 [2024-11-27 03:25:23.298145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.298228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.878 [2024-11-27 03:25:23.298253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.878 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.298363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.298440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.298463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.298551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.298647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.298671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.298758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.298848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.298873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.298950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.299179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.299373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.299648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.299840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.299941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.300045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.300239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.300413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.300606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.300864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.300984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.301071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.301155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.301179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.301298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.301375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.301403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.301485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.301575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.301600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.301681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.301795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.301820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.301930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.302127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.302345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.302587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.302780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.302884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.302998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.303107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.303132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.303221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.303312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.303338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.303464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.303558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.303583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.303681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.303763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.303787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.303910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.303994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.304018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.304100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.304218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.304243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.879 [2024-11-27 03:25:23.304333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.304415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.879 [2024-11-27 03:25:23.304439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.879 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.304516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.304605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.304630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.304713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.304796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.304820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.304926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.305116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.305322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.305517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.305719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.305905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.305980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.306005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.306088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.306166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.306190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.306276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.306417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.306443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.306532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.306612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.306637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.306723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.306810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.306834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.306915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.307141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.307330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.307557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.307798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.307971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.308050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.308241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.308443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.308635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.308863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.308968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.309050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.309279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.309502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.309697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.309889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.309993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.310076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.310162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.310187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.880 [2024-11-27 03:25:23.310264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.310341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.880 [2024-11-27 03:25:23.310366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.880 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.310479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.310562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.310587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.310669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.310756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.310781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.310899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.310976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.311001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.311111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.311195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.311220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.311306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.311389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.311414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.311502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.311609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.311635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.311751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.311862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.311887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.312013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.312208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.312404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.312605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.312790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.312905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.312981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.313160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.313348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.313533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.313765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.313874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.314040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.314258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.314455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.314681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.314890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.314994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.315074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.315204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.315229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.315304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.315395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.315420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.315534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.315620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.315646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.315765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.315876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.315901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.315986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.316062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.316087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.316196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.316279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.316305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.881 [2024-11-27 03:25:23.316404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.316481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.881 [2024-11-27 03:25:23.316505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.881 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.316623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.316702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.316727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.316808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.316886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.316910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.316992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.317205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.317410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.317630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.317855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.317957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.318048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.318128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.318152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.318262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.318341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.318367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.318462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.318553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.318578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.318660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.318742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.318767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.318876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.318996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.319021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.319097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.319175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.319199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.319341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.319423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.319447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.319535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.319645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.319671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.319786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.319871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.319896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.319977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.320068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.320093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.320177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.320267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.320291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.320375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.320483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.320508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.320634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.320731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.320755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.320834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.320981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.321006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.321101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.321176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.321201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.321282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.321367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.321391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.321476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.321554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.321579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.321666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.321780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.321805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.882 qpair failed and we were unable to recover it. 00:30:20.882 [2024-11-27 03:25:23.321888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.882 [2024-11-27 03:25:23.322001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.322027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.322106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.322184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.322208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.322325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.322430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.322455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.322570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.322659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.322686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.322769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.322886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.322914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.323007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.323086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.323111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.323235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.323341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.323366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.323443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.323529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.323555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.323667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.323742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.323766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.323891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.323998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.324099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.324329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.324530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.324720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.324915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.324989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.325017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.325094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.325207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.325231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.325318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.325425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.325449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.325538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.325620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.325646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.325738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.325821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.325845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.325940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.326158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.326354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.326543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.326767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.326878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.326964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.327156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.327399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.327612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.327807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.327918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.883 qpair failed and we were unable to recover it. 00:30:20.883 [2024-11-27 03:25:23.328003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.883 [2024-11-27 03:25:23.328111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.328135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.328227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.328334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.328359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.328442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.328523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.328553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.328637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.328743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.328768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.328854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.328972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.328996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.329079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.329190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.329215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.329313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.329397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.329423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.329512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.329597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.329622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.329740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.329823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.329847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.329929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.330122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.330332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.330590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.330780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.330883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.330991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.331189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.331402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.331634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.331822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.331928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.332013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.332100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.332126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.332248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.332332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.332358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.332450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.332538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.332563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.332682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.332761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.332786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.332895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.332976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.333079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.333299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.333485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.333687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.333880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.333988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.884 qpair failed and we were unable to recover it. 00:30:20.884 [2024-11-27 03:25:23.334071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.884 [2024-11-27 03:25:23.334160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.334185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.334299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.334388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.334414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.334495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.334589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.334615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.334699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.334774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.334799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.334881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.334993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.335018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.335114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.335204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.335229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.335312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.335391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.335415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.335552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.335667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.335698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.335816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.335899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.335925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.336006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.336145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.336169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.336252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.336362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.336386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.336508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.336592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.336617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.336706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.336855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.336879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.336966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.337164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.337363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.337596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.337813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.337949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.338040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.338271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.338468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.338673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.338871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.338971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.339053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.339241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.339435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.339633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.339835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.339937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.340023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.340099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.340124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.885 qpair failed and we were unable to recover it. 00:30:20.885 [2024-11-27 03:25:23.340220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.885 [2024-11-27 03:25:23.340330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.340355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.340461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.340539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.340564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.340645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.340721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.340745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.340831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.340942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.340966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.341045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.341154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.341179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.341262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.341349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.341374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.341491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.341585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.341609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.341693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.341774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.341798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.341876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.341991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.342016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.342100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.342216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.342241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.342354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.342438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.342461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.342543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.342656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.342681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.342764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.342847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.342872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.342952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.343206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.343390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.343607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.343802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.343914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.344021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.344223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.344417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.344638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.344822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.344937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.345048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.345159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.345184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.345272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.345352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.345376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.345486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.345574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.345599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.886 qpair failed and we were unable to recover it. 00:30:20.886 [2024-11-27 03:25:23.345737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.886 [2024-11-27 03:25:23.345816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.345840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.345925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.346122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.346343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.346547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.346750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.346861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.346936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.347153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.347344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.347522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.347739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.347848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.347925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.348120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.348344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.348548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.348765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.348919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.349001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.349109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.349133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.349245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.349329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.349353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.349468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.349547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.349573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.349654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.349733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.349757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.349866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.349982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.350119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.350318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.350511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.350717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.350895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.350983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.351007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.351116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.351205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.351230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.351312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.351386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.351411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.351493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.351607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.351634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.887 qpair failed and we were unable to recover it. 00:30:20.887 [2024-11-27 03:25:23.351746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.887 [2024-11-27 03:25:23.351827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.351851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.351932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.352159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.352343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.352576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.352841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.352946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.353030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.353165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.353191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.353275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.353383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.353408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.353485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.353577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.353604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.353694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.353770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.353795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.353908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.353985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.354010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.354092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.354175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.354199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.354307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.354392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.354419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.354510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.354601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.354626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.354713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.354793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.354818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.354932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.355118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.355311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.355486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.355745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.355851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.355931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.356165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.356381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.356561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.356788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.356926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.357011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.357087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.357116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.357207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.357317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.357341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.357430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.357515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.357546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.357633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.357716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.357740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.888 qpair failed and we were unable to recover it. 00:30:20.888 [2024-11-27 03:25:23.357821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.888 [2024-11-27 03:25:23.357901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.357926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.358009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.358244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.358458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.358644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.358870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.358970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.359050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.359126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.359156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.359236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.359353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.359377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.359485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.359576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.359601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.359684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.359764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.359789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.359871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.359977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.360002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.360084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.360168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.360193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.360278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.360393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.360417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.360505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.360589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.360613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.360701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.360783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.360809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.360891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.361113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.361312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.361535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.361741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.361846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.361938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.362121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.362351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.362556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.362745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.362886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.362974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.363085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.363110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.363193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.363299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.363324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.363417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.363553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.363579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.889 qpair failed and we were unable to recover it. 00:30:20.889 [2024-11-27 03:25:23.363664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.363772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.889 [2024-11-27 03:25:23.363797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.363879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.363966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.363992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.364075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.364268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.364461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.364650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.364838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.364939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.365026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.365215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.365407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.365639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.365839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.365951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.366062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.366245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.366433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.366626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.366863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.366973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.367057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.367282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.367470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.367664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.367859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.367996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.368107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.368219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.368244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.368356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.368439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.368464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.368552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.368635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.368659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.368772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.368852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.368876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.368956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.369155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.369373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.369602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.369804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.369934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.370014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.370100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.890 [2024-11-27 03:25:23.370125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.890 qpair failed and we were unable to recover it. 00:30:20.890 [2024-11-27 03:25:23.370245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.370319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.370344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.370421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.370515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.370552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.370635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.370719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.370743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.370837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.370951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.370975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.371063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.371173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.371197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.371275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.371356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.371380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.371496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.371586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.371611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.371694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.371771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.371795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.371878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.371988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.372013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.372096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.372182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.372206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.372323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.372435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.372460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.372545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.372630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.372656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.372736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.372825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.372849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.372931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.373146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.373367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.373555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.373745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.373892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.373980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.374156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.374414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.374611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.374792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.374927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.375012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.375091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.375114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.375211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.375325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.375351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.375437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.375521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.375572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.375670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.375760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.891 [2024-11-27 03:25:23.375785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.891 qpair failed and we were unable to recover it. 00:30:20.891 [2024-11-27 03:25:23.375873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.375956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.375980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.376075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.376158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.376181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.376265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.376374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.376398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.376491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.376581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.376606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.376696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.376785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.376809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.376926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.377116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.377310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.377513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.377714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.377852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.377940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.378160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.378347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.378547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.378744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.378855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.378949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.379141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.379326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.379518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.379714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.379897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.379976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.380000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.380086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.380176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.892 [2024-11-27 03:25:23.380205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.892 qpair failed and we were unable to recover it. 00:30:20.892 [2024-11-27 03:25:23.380283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.380371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.380394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.380496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.380612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.380637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.380725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.380813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.380838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.380915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.381141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.381332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.381547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.381763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.381873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.381954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.382142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.382324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.382541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.382749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.382850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.382938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.383128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.383328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.383552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.383750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.383864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.383979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.384201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.384392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.384583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.384764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.384866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.384953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.385175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.385367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.385555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.385755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.385863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.385940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.386030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.386054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.386145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.386223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.386248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.386294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c32980 (9): Bad file descriptor 00:30:20.893 [2024-11-27 03:25:23.386415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.386511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.386544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.386637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.386718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.386743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.893 qpair failed and we were unable to recover it. 00:30:20.893 [2024-11-27 03:25:23.386831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.893 [2024-11-27 03:25:23.386910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.386936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.387046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.387239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.387436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.387658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.387850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.387962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.388054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.388130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.388154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.388247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.388363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.388388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.388475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.388566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.388590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.388707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.388798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.388823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.388905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.388987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.389101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.389280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.389495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.389688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.389904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.389982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.390096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.390313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.390537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.390727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.390919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.390997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.391110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.391296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.391497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.391695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.391877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.391987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.392071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.392186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.392211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 03:25:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:20.894 [2024-11-27 03:25:23.392302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.392383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.392408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.392502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.392609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 03:25:23 -- common/autotest_common.sh@862 -- # return 0 00:30:20.894 [2024-11-27 03:25:23.392635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.392717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.392793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 [2024-11-27 03:25:23.392817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.894 qpair failed and we were unable to recover it. 00:30:20.894 [2024-11-27 03:25:23.392900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.894 03:25:23 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:20.894 [2024-11-27 03:25:23.392980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.393005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.393102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.393231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 03:25:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:20.895 [2024-11-27 03:25:23.393260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.393350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.393440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.393467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 03:25:23 -- common/autotest_common.sh@10 -- # set +x 00:30:20.895 [2024-11-27 03:25:23.393582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.393665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.393689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.393772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.393890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.393917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.394006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.394147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.394172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.394270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.394379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.394404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.394484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.394577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.394610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.394695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.394783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.394808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.394931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.395155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.395373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.395583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.395773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.395881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.396002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.396257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.396448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.396650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.396858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.396972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.397080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.397155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.397180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.397297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.397371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.397395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.397513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.397608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.397633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.397716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.397790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.397815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.397925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.398008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.398034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.398120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.398377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.398405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.398488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.398575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.398600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.398722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.398803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.398828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.398938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.399047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.399073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.895 [2024-11-27 03:25:23.399167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.399248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.895 [2024-11-27 03:25:23.399273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.895 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.399385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.399464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.399488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.399579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.399700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.399725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.399813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.399913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.399947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.400028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.400143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.400169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.400277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.400395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.400419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.400538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.400629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.400655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.400764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.400847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.400872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.400983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.401215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.401474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.401663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.401887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.401991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.402076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.402162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.402186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.402275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.402389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.402415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.402492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.402609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.402635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.402717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.402832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.402858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.402968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.403153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.403344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.403583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.403773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.403938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.404020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.404134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.404159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.404244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.404325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.404349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.404463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.404541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.404571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.404680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.404827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.404851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.404934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.405124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.405348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.405584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.405772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.405877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.405956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.406038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.406063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.406139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.406223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.896 [2024-11-27 03:25:23.406249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.896 qpair failed and we were unable to recover it. 00:30:20.896 [2024-11-27 03:25:23.406360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.406441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.406467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.406550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.406645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.406670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.406750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.406865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.406893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.407012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.407125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.407150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.407258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.407371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.407396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.407487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.407578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.407603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.407689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.407773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.407807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.407894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.408109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.408328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.408547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.408762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.408876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.408957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.409184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.409378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.409616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.409815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.409920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.410019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.410130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.410156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.410245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.410357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.410383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.410496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.410580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.410605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.410686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.410774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.410800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.410882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.411159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.411357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.411550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.411739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.411842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.411927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.412165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.412393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.412592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.412810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.412911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.413002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.413112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.413137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.413243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.413333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.413357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.897 qpair failed and we were unable to recover it. 00:30:20.897 [2024-11-27 03:25:23.413447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.897 [2024-11-27 03:25:23.413539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.413565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.413646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.413759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.413784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.413914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.413995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.414020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.414129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.414208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.414234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.414337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.414437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.414467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.414581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.414686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.414713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.414801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.414881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.414907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.414988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.415207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.415399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.415635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.415857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.415963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.416087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.416202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.416228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.416334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.416416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.416442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.416529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.416627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.416653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.898 03:25:23 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.416759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.416863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.416894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 03:25:23 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:20.898 [2024-11-27 03:25:23.417010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.417130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.417154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.417239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 03:25:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:20.898 [2024-11-27 03:25:23.417330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.417355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.417447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.417535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.417561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c24f20 with addr=10.0.0.2, port=4420 00:30:20.898 03:25:23 -- common/autotest_common.sh@10 -- # set +x 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.417682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.417768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.417793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.417871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.417980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.418005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.418115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.418194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.418219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.418334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.418447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.418472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.418585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.418672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.418702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.418794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.418881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.418906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.419015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.419098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.419124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.419205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.419328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.419353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.419434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.419549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.419573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.419660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.419741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.419765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.419920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.420030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.420054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.420135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.420244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.420269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.420356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.420435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.420459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.420557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.420782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.898 [2024-11-27 03:25:23.420807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.898 qpair failed and we were unable to recover it. 00:30:20.898 [2024-11-27 03:25:23.420956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.421165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.421359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.421554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.421782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.421915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.422000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.422105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.422129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.422250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.422360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.422385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.422473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.422566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.422592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.422710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.422805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.422832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.422926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.423182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.423380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.423579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.423790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.423903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.424011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.424104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.424128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.424207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.424289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.424313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.424397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.424510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.424561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.424653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.424791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.424817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.424934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.425159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.425379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.425611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.425862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.425968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.426079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.426199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.426225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.426313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.426405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.426431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.426545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.426668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.426695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.426809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.426900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.426926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.427008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.427089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.427115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.427206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.427350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.427376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.899 [2024-11-27 03:25:23.427461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.427576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.899 [2024-11-27 03:25:23.427603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.899 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.427696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.427779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.427805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.427894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.427981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.428007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.428097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.428185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.428212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.428357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.428439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.428465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.428546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.428641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.428667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.428752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.428839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.428865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.428977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.429120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.429146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.429231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.429358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.429384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.429477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.429595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.429621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.429727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.429818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.429844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.429933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.430174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.430377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.430588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.430788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.430889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.431005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.431200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.431393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.431606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.431814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.431965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.432054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.432168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.432194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.432281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.432361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.432386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.432487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.432640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.432667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.432751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.432856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.432883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.432978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.433185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.433408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.433624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.433852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.433990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.434102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.434190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.434216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.434300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.434418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.434444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.434540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.434649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.434676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.434757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.434837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.434863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.900 qpair failed and we were unable to recover it. 00:30:20.900 [2024-11-27 03:25:23.434972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.435066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:20.900 [2024-11-27 03:25:23.435091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:20.901 qpair failed and we were unable to recover it. 00:30:20.901 [2024-11-27 03:25:23.435177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.435292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.435319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.435403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.435487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.435514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.435633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.435721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.435747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.435830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.435944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.435970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.436057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.436158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.436185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.436266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.436376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.436402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.436516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.436634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.436660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.436749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.436864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.436891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.436986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.437190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.437420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.437629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.437821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.437933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.438021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.438108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.438135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.438234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.438328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.438353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.438470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.438555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.438581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.165 [2024-11-27 03:25:23.438675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.438772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.165 [2024-11-27 03:25:23.438797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.165 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.438893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.438982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.439008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.439106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.439228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.439254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.439334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.439435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.439461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.439546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.439631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.439658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.439744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.439844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.439870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.439962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.440183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.440374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.440585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.440826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.440932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.441049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.441129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.441155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.441245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.441330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.441356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.441503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.441597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.441624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.441725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.441808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.441833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.441922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.442155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.442351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.442560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.442778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.442923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.443129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.443241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.443266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.443353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.443448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.443473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.443562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.443692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.443718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.443805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.443888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.443914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.444030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.444115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.444140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.444252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.444371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.444396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.444485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.444598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.444625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.444719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.444801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 [2024-11-27 03:25:23.444825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.166 qpair failed and we were unable to recover it. 00:30:21.166 [2024-11-27 03:25:23.444905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.166 Malloc0 00:30:21.167 03:25:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.167 03:25:23 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:21.167 03:25:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:21.167 03:25:23 -- common/autotest_common.sh@10 -- # set +x 00:30:21.167 [2024-11-27 03:25:23.446051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.446082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.446205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.446328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.446353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.446455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.446545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.446584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.446683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.446773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.446799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.446890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.446981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.447007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.447131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.447250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.447276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.447361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.447442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.447468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.447587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.447720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.447746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.447834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.447921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.447946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.448035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.448116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.448141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.448228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.448348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.448372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.448453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.448539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.448565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.448661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.448774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.448801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.448852] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:21.167 [2024-11-27 03:25:23.448903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.448983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.449007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.449108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.449206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.449229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.449347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.449439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.449464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.449550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.449679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.449704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.449791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.449877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.449902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.449986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.450096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.450121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.450241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.450331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.450357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.450468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.450561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.450587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.450682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.450759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.450783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.450898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.450997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.451027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.451112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.451196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.451222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.451335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.451419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.451444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.451550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.451647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.451672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.167 qpair failed and we were unable to recover it. 00:30:21.167 [2024-11-27 03:25:23.451760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.167 [2024-11-27 03:25:23.451845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.451870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.451953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.452167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.452424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.452674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.452873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.452986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.453075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.453196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.453228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.453325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.453404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.453430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.453530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.453618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.453643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.453735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.453849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.453875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.453985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.454071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.454098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.454184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.454303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.454328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.454413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.454501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.454535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.454680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.454767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.454793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.454874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.454990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.455016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.455108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.455229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.455255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.455346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.455432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.455462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.455588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.455674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.455700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.455817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.455901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.455926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.456042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.456130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.456155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.456236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.456328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.456353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.456449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.456532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.456559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.456642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.456725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.456750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 03:25:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.168 03:25:23 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:21.168 03:25:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:21.168 03:25:23 -- common/autotest_common.sh@10 -- # set +x 00:30:21.168 [2024-11-27 03:25:23.457510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.457651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.457679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.457774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.457893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.457919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.458031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.458113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.458138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.168 [2024-11-27 03:25:23.458234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.458322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.168 [2024-11-27 03:25:23.458346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.168 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.458432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.458518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.458549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.458632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.458756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.458782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.458872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.458985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.459010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.459150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.459228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.459252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.459338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.459424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.459449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.459551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.459649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.459678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.459765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.459850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.459875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.459962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.460192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.460426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.460665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.460857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.460969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.461059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.461158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.461184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.461299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.461421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.461446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.461559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.461649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.461676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.461764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.461852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.461879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.461992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.462217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.462443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.462678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.462877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.462986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.463104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.463189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.463215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.463307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.463420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.463446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.463533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.463612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.463638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.463758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.463841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.463867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.463979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.464066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.464092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.464172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.464287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.169 [2024-11-27 03:25:23.464313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.169 qpair failed and we were unable to recover it. 00:30:21.169 [2024-11-27 03:25:23.464400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.464484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.464510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.464607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.464719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.464744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 03:25:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.170 03:25:23 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:21.170 03:25:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:21.170 03:25:23 -- common/autotest_common.sh@10 -- # set +x 00:30:21.170 [2024-11-27 03:25:23.465550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.465677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.465705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.465805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.465892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.465917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.465997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.466238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.466425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.466629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.466824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.466925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.467015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.467202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.467390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.467680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.467870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.467972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.468053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.468164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.468188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.468298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.468381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.468406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.468489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.468610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.468636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.468722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.468813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.468837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.468925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.469011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.469035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.469128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.469214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.469239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.469355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.469475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.469499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.469625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.469715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.469748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.170 qpair failed and we were unable to recover it. 00:30:21.170 [2024-11-27 03:25:23.469836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.170 [2024-11-27 03:25:23.469958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.469984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.470073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.470185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.470210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.470298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.470382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.470407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.470502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.470598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.470623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.470706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.470793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.470818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.471049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.471136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.471160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.471245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.471331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.471356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.471448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.471563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.471589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.471679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.471791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.471817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.471907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.472168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.472397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.472605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.472858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.472971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.473081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 03:25:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.171 [2024-11-27 03:25:23.473165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.473190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 03:25:23 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:21.171 [2024-11-27 03:25:23.473276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.473382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 03:25:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:21.171 [2024-11-27 03:25:23.473407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 03:25:23 -- common/autotest_common.sh@10 -- # set +x 00:30:21.171 [2024-11-27 03:25:23.473499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.473597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.473623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.473718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.473829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.473854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.473958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.474199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.474411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.474679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.474871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.474984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.475074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.475159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.475185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.475268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.475353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.475378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaac000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.475545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.475669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.475698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.171 [2024-11-27 03:25:23.475817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.475936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.171 [2024-11-27 03:25:23.475962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.171 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.476048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.476132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.476158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.476268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.476376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.476402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.476492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.476581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.476607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.476699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.476785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.476810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.476898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.476981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:21.172 [2024-11-27 03:25:23.477007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fdaa4000b90 with addr=10.0.0.2, port=4420 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.477130] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:21.172 [2024-11-27 03:25:23.479588] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 [2024-11-27 03:25:23.479705] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.479733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.479748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.479761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.172 [2024-11-27 03:25:23.479799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 03:25:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.172 03:25:23 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:21.172 03:25:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:21.172 03:25:23 -- common/autotest_common.sh@10 -- # set +x 00:30:21.172 03:25:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:21.172 [2024-11-27 03:25:23.489415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 03:25:23 -- host/target_disconnect.sh@58 -- # wait 2587434 00:30:21.172 [2024-11-27 03:25:23.489507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.489549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.489565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.489577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.172 [2024-11-27 03:25:23.489608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.499437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 [2024-11-27 03:25:23.499538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.499564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.499584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.499598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.172 [2024-11-27 03:25:23.499629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.509411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 [2024-11-27 03:25:23.509504] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.509539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.509555] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.509568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.172 [2024-11-27 03:25:23.509598] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.519399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 [2024-11-27 03:25:23.519488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.519515] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.519536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.519551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.172 [2024-11-27 03:25:23.519594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.529455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 [2024-11-27 03:25:23.529558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.529584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.529599] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.529611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.172 [2024-11-27 03:25:23.529641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.539476] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 [2024-11-27 03:25:23.539577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.539603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.539617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.539630] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.172 [2024-11-27 03:25:23.539673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.549491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 [2024-11-27 03:25:23.549602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.549629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.549642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.549655] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.172 [2024-11-27 03:25:23.549687] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.559499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 [2024-11-27 03:25:23.559603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.559630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.559644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.559657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.172 [2024-11-27 03:25:23.559687] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.172 qpair failed and we were unable to recover it. 00:30:21.172 [2024-11-27 03:25:23.569514] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.172 [2024-11-27 03:25:23.569616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.172 [2024-11-27 03:25:23.569642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.172 [2024-11-27 03:25:23.569656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.172 [2024-11-27 03:25:23.569668] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.569699] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.579724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.579838] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.579864] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.579878] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.579891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.579922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.589635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.589744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.589769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.589790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.589803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.589833] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.599618] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.599710] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.599736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.599750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.599763] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.599793] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.609665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.609755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.609781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.609795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.609808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.609837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.619664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.619754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.619779] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.619792] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.619805] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.619835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.629687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.629781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.629807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.629821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.629833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.629863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.639710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.639836] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.639862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.639877] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.639891] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.639921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.649739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.649834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.649860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.649874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.649886] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.649916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.659790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.659880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.659906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.659919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.659932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.659961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.669812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.669917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.669943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.669957] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.669970] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.670001] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.679829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.679959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.680000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.680014] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.680027] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.680059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.689852] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.173 [2024-11-27 03:25:23.689942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.173 [2024-11-27 03:25:23.689968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.173 [2024-11-27 03:25:23.689981] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.173 [2024-11-27 03:25:23.689993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.173 [2024-11-27 03:25:23.690022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.173 qpair failed and we were unable to recover it. 00:30:21.173 [2024-11-27 03:25:23.699923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.174 [2024-11-27 03:25:23.700043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.174 [2024-11-27 03:25:23.700069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.174 [2024-11-27 03:25:23.700083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.174 [2024-11-27 03:25:23.700096] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.174 [2024-11-27 03:25:23.700125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.174 qpair failed and we were unable to recover it. 00:30:21.174 [2024-11-27 03:25:23.709962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.174 [2024-11-27 03:25:23.710085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.174 [2024-11-27 03:25:23.710110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.174 [2024-11-27 03:25:23.710124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.174 [2024-11-27 03:25:23.710136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.174 [2024-11-27 03:25:23.710165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.174 qpair failed and we were unable to recover it. 00:30:21.174 [2024-11-27 03:25:23.719969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.174 [2024-11-27 03:25:23.720092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.174 [2024-11-27 03:25:23.720118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.174 [2024-11-27 03:25:23.720132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.174 [2024-11-27 03:25:23.720145] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.174 [2024-11-27 03:25:23.720181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.174 qpair failed and we were unable to recover it. 00:30:21.174 [2024-11-27 03:25:23.729971] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.174 [2024-11-27 03:25:23.730059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.174 [2024-11-27 03:25:23.730084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.174 [2024-11-27 03:25:23.730097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.174 [2024-11-27 03:25:23.730109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.174 [2024-11-27 03:25:23.730140] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.174 qpair failed and we were unable to recover it. 00:30:21.174 [2024-11-27 03:25:23.739995] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.174 [2024-11-27 03:25:23.740078] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.174 [2024-11-27 03:25:23.740104] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.174 [2024-11-27 03:25:23.740118] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.174 [2024-11-27 03:25:23.740131] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.174 [2024-11-27 03:25:23.740161] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.174 qpair failed and we were unable to recover it. 00:30:21.174 [2024-11-27 03:25:23.750035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.174 [2024-11-27 03:25:23.750132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.174 [2024-11-27 03:25:23.750158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.174 [2024-11-27 03:25:23.750173] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.174 [2024-11-27 03:25:23.750185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.174 [2024-11-27 03:25:23.750216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.174 qpair failed and we were unable to recover it. 00:30:21.174 [2024-11-27 03:25:23.760090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.174 [2024-11-27 03:25:23.760189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.174 [2024-11-27 03:25:23.760214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.174 [2024-11-27 03:25:23.760228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.174 [2024-11-27 03:25:23.760240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.174 [2024-11-27 03:25:23.760269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.174 qpair failed and we were unable to recover it. 00:30:21.174 [2024-11-27 03:25:23.770078] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.174 [2024-11-27 03:25:23.770166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.174 [2024-11-27 03:25:23.770197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.174 [2024-11-27 03:25:23.770212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.174 [2024-11-27 03:25:23.770224] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.174 [2024-11-27 03:25:23.770254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.174 qpair failed and we were unable to recover it. 00:30:21.434 [2024-11-27 03:25:23.780133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.434 [2024-11-27 03:25:23.780223] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.434 [2024-11-27 03:25:23.780250] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.434 [2024-11-27 03:25:23.780267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.434 [2024-11-27 03:25:23.780281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.780313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.790169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.790261] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.790287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.790301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.790314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.790344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.800188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.800279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.800305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.800318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.800331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.800360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.810223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.810314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.810339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.810355] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.810368] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.810404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.820261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.820345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.820371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.820385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.820397] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.820428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.830262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.830364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.830390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.830404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.830416] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.830445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.840316] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.840403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.840429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.840443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.840456] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.840485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.850363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.850459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.850486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.850500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.850512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.850548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.860415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.860508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.860543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.860558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.860571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.860601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.870397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.870488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.870517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.870539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.870552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.870594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.880411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.880507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.880542] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.880557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.880570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.880600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.890438] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.890592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.435 [2024-11-27 03:25:23.890618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.435 [2024-11-27 03:25:23.890633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.435 [2024-11-27 03:25:23.890645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.435 [2024-11-27 03:25:23.890676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.435 qpair failed and we were unable to recover it. 00:30:21.435 [2024-11-27 03:25:23.900455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.435 [2024-11-27 03:25:23.900550] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.900576] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.900589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.900608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.900639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:23.910497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:23.910598] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.910624] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.910637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.910649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.910680] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:23.920521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:23.920643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.920669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.920683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.920695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.920726] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:23.930549] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:23.930635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.930661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.930675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.930687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.930717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:23.940596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:23.940679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.940704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.940718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.940730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.940761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:23.950636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:23.950751] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.950780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.950796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.950809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.950839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:23.960650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:23.960744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.960770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.960783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.960796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.960826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:23.970663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:23.970744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.970770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.970783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.970796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.970827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:23.980677] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:23.980759] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.980784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.980798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.980810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.980841] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:23.990795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:23.990900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:23.990926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:23.990946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:23.990960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:23.990990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:24.000768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:24.000869] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:24.000895] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:24.000908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:24.000921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:24.000961] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.436 [2024-11-27 03:25:24.010785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.436 [2024-11-27 03:25:24.010875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.436 [2024-11-27 03:25:24.010900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.436 [2024-11-27 03:25:24.010913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.436 [2024-11-27 03:25:24.010926] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.436 [2024-11-27 03:25:24.010955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.436 qpair failed and we were unable to recover it. 00:30:21.437 [2024-11-27 03:25:24.020832] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.437 [2024-11-27 03:25:24.020942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.437 [2024-11-27 03:25:24.020968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.437 [2024-11-27 03:25:24.020982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.437 [2024-11-27 03:25:24.020994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.437 [2024-11-27 03:25:24.021036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.437 qpair failed and we were unable to recover it. 00:30:21.437 [2024-11-27 03:25:24.030868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.437 [2024-11-27 03:25:24.030965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.437 [2024-11-27 03:25:24.030994] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.437 [2024-11-27 03:25:24.031008] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.437 [2024-11-27 03:25:24.031021] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.437 [2024-11-27 03:25:24.031053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.437 qpair failed and we were unable to recover it. 00:30:21.437 [2024-11-27 03:25:24.040859] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.437 [2024-11-27 03:25:24.040955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.437 [2024-11-27 03:25:24.040984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.437 [2024-11-27 03:25:24.040999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.437 [2024-11-27 03:25:24.041012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.437 [2024-11-27 03:25:24.041042] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.437 qpair failed and we were unable to recover it. 00:30:21.437 [2024-11-27 03:25:24.050895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.437 [2024-11-27 03:25:24.050986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.437 [2024-11-27 03:25:24.051016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.437 [2024-11-27 03:25:24.051032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.437 [2024-11-27 03:25:24.051045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.437 [2024-11-27 03:25:24.051076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.437 qpair failed and we were unable to recover it. 00:30:21.697 [2024-11-27 03:25:24.060925] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.697 [2024-11-27 03:25:24.061006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.697 [2024-11-27 03:25:24.061032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.697 [2024-11-27 03:25:24.061046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.697 [2024-11-27 03:25:24.061059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.697 [2024-11-27 03:25:24.061088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.697 qpair failed and we were unable to recover it. 00:30:21.697 [2024-11-27 03:25:24.071002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.697 [2024-11-27 03:25:24.071098] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.697 [2024-11-27 03:25:24.071128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.697 [2024-11-27 03:25:24.071143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.697 [2024-11-27 03:25:24.071155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.697 [2024-11-27 03:25:24.071186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.697 qpair failed and we were unable to recover it. 00:30:21.697 [2024-11-27 03:25:24.081014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.697 [2024-11-27 03:25:24.081125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.697 [2024-11-27 03:25:24.081151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.697 [2024-11-27 03:25:24.081171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.697 [2024-11-27 03:25:24.081185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.697 [2024-11-27 03:25:24.081215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.697 qpair failed and we were unable to recover it. 00:30:21.697 [2024-11-27 03:25:24.091025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.697 [2024-11-27 03:25:24.091112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.697 [2024-11-27 03:25:24.091138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.697 [2024-11-27 03:25:24.091152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.697 [2024-11-27 03:25:24.091164] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.697 [2024-11-27 03:25:24.091194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.697 qpair failed and we were unable to recover it. 00:30:21.697 [2024-11-27 03:25:24.101065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.697 [2024-11-27 03:25:24.101153] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.697 [2024-11-27 03:25:24.101179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.697 [2024-11-27 03:25:24.101193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.697 [2024-11-27 03:25:24.101205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.697 [2024-11-27 03:25:24.101236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.697 qpair failed and we were unable to recover it. 00:30:21.697 [2024-11-27 03:25:24.111076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.697 [2024-11-27 03:25:24.111165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.697 [2024-11-27 03:25:24.111191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.697 [2024-11-27 03:25:24.111205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.697 [2024-11-27 03:25:24.111217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.697 [2024-11-27 03:25:24.111247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.697 qpair failed and we were unable to recover it. 00:30:21.697 [2024-11-27 03:25:24.121111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.697 [2024-11-27 03:25:24.121228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.697 [2024-11-27 03:25:24.121253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.697 [2024-11-27 03:25:24.121267] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.697 [2024-11-27 03:25:24.121280] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.121310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.131120] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.131207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.131232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.131246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.131258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.131290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.141153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.141262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.141287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.141301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.141314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.141344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.151191] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.151283] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.151308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.151323] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.151335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.151367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.161211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.161303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.161332] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.161346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.161359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.161390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.171227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.171315] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.171349] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.171364] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.171376] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.171406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.181242] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.181325] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.181351] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.181365] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.181377] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.181406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.191298] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.191388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.191414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.191428] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.191440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.191471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.201342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.201431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.201457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.201471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.201484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.201513] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.211360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.211451] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.211477] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.211490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.211503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.211547] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.221361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.221450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.221475] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.221489] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.221502] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.221538] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.231409] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.698 [2024-11-27 03:25:24.231521] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.698 [2024-11-27 03:25:24.231553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.698 [2024-11-27 03:25:24.231567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.698 [2024-11-27 03:25:24.231580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.698 [2024-11-27 03:25:24.231610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.698 qpair failed and we were unable to recover it. 00:30:21.698 [2024-11-27 03:25:24.241432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.699 [2024-11-27 03:25:24.241537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.699 [2024-11-27 03:25:24.241563] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.699 [2024-11-27 03:25:24.241576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.699 [2024-11-27 03:25:24.241589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.699 [2024-11-27 03:25:24.241620] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.699 qpair failed and we were unable to recover it. 00:30:21.699 [2024-11-27 03:25:24.251474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.699 [2024-11-27 03:25:24.251573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.699 [2024-11-27 03:25:24.251598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.699 [2024-11-27 03:25:24.251612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.699 [2024-11-27 03:25:24.251625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.699 [2024-11-27 03:25:24.251655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.699 qpair failed and we were unable to recover it. 00:30:21.699 [2024-11-27 03:25:24.261548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.699 [2024-11-27 03:25:24.261644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.699 [2024-11-27 03:25:24.261674] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.699 [2024-11-27 03:25:24.261689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.699 [2024-11-27 03:25:24.261702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.699 [2024-11-27 03:25:24.261732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.699 qpair failed and we were unable to recover it. 00:30:21.699 [2024-11-27 03:25:24.271545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.699 [2024-11-27 03:25:24.271641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.699 [2024-11-27 03:25:24.271671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.699 [2024-11-27 03:25:24.271686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.699 [2024-11-27 03:25:24.271699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.699 [2024-11-27 03:25:24.271729] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.699 qpair failed and we were unable to recover it. 00:30:21.699 [2024-11-27 03:25:24.281589] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.699 [2024-11-27 03:25:24.281693] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.699 [2024-11-27 03:25:24.281719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.699 [2024-11-27 03:25:24.281733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.699 [2024-11-27 03:25:24.281745] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.699 [2024-11-27 03:25:24.281776] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.699 qpair failed and we were unable to recover it. 00:30:21.699 [2024-11-27 03:25:24.291564] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.699 [2024-11-27 03:25:24.291653] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.699 [2024-11-27 03:25:24.291679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.699 [2024-11-27 03:25:24.291693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.699 [2024-11-27 03:25:24.291706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.699 [2024-11-27 03:25:24.291737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.699 qpair failed and we were unable to recover it. 00:30:21.699 [2024-11-27 03:25:24.301603] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.699 [2024-11-27 03:25:24.301687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.699 [2024-11-27 03:25:24.301713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.699 [2024-11-27 03:25:24.301727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.699 [2024-11-27 03:25:24.301740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.699 [2024-11-27 03:25:24.301788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.699 qpair failed and we were unable to recover it. 00:30:21.699 [2024-11-27 03:25:24.311636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.699 [2024-11-27 03:25:24.311739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.699 [2024-11-27 03:25:24.311765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.699 [2024-11-27 03:25:24.311778] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.699 [2024-11-27 03:25:24.311791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.699 [2024-11-27 03:25:24.311825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.699 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.321653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.321740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.321766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.321780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.321793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.321822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.331727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.331815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.331841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.331855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.331868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.331897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.341763] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.341867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.341893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.341907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.341920] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.341949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.351809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.351918] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.351950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.351964] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.351977] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.352008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.361768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.361858] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.361884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.361898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.361909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.361938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.371802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.371893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.371919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.371933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.371945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.371974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.381813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.381901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.381926] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.381940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.381953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.381982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.391872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.391965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.391991] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.392004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.392023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.392054] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.401870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.401961] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.401986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.402000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.402013] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.402044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.411915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.412028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.412054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.412067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.961 [2024-11-27 03:25:24.412080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.961 [2024-11-27 03:25:24.412123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.961 qpair failed and we were unable to recover it. 00:30:21.961 [2024-11-27 03:25:24.421949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.961 [2024-11-27 03:25:24.422036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.961 [2024-11-27 03:25:24.422063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.961 [2024-11-27 03:25:24.422076] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.422089] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.422119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.431978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.432071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.432096] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.432110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.432122] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.432153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.442025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.442129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.442158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.442174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.442187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.442230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.452020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.452154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.452179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.452192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.452204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.452233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.462085] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.462168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.462193] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.462207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.462219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.462250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.472109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.472203] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.472228] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.472242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.472255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.472285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.482114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.482205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.482231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.482245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.482264] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.482294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.492141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.492235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.492261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.492274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.492287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.492317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.502195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.502276] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.502302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.502316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.502329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.502357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.512220] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.512319] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.512345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.512359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.512372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.512401] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.522225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.522330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.522355] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.962 [2024-11-27 03:25:24.522369] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.962 [2024-11-27 03:25:24.522382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.962 [2024-11-27 03:25:24.522413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.962 qpair failed and we were unable to recover it. 00:30:21.962 [2024-11-27 03:25:24.532261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.962 [2024-11-27 03:25:24.532348] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.962 [2024-11-27 03:25:24.532373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.963 [2024-11-27 03:25:24.532387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.963 [2024-11-27 03:25:24.532399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.963 [2024-11-27 03:25:24.532429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.963 qpair failed and we were unable to recover it. 00:30:21.963 [2024-11-27 03:25:24.542286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.963 [2024-11-27 03:25:24.542372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.963 [2024-11-27 03:25:24.542398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.963 [2024-11-27 03:25:24.542412] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.963 [2024-11-27 03:25:24.542424] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.963 [2024-11-27 03:25:24.542455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.963 qpair failed and we were unable to recover it. 00:30:21.963 [2024-11-27 03:25:24.552330] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.963 [2024-11-27 03:25:24.552420] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.963 [2024-11-27 03:25:24.552446] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.963 [2024-11-27 03:25:24.552460] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.963 [2024-11-27 03:25:24.552473] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.963 [2024-11-27 03:25:24.552503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.963 qpair failed and we were unable to recover it. 00:30:21.963 [2024-11-27 03:25:24.562343] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.963 [2024-11-27 03:25:24.562439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.963 [2024-11-27 03:25:24.562465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.963 [2024-11-27 03:25:24.562479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.963 [2024-11-27 03:25:24.562491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.963 [2024-11-27 03:25:24.562522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.963 qpair failed and we were unable to recover it. 00:30:21.963 [2024-11-27 03:25:24.572385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:21.963 [2024-11-27 03:25:24.572499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:21.963 [2024-11-27 03:25:24.572531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:21.963 [2024-11-27 03:25:24.572554] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:21.963 [2024-11-27 03:25:24.572568] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:21.963 [2024-11-27 03:25:24.572600] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:21.963 qpair failed and we were unable to recover it. 00:30:22.223 [2024-11-27 03:25:24.582401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.223 [2024-11-27 03:25:24.582508] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.223 [2024-11-27 03:25:24.582543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.223 [2024-11-27 03:25:24.582558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.223 [2024-11-27 03:25:24.582571] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.223 [2024-11-27 03:25:24.582601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.223 qpair failed and we were unable to recover it. 00:30:22.223 [2024-11-27 03:25:24.592461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.223 [2024-11-27 03:25:24.592577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.223 [2024-11-27 03:25:24.592603] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.223 [2024-11-27 03:25:24.592617] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.223 [2024-11-27 03:25:24.592629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.223 [2024-11-27 03:25:24.592671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.223 qpair failed and we were unable to recover it. 00:30:22.223 [2024-11-27 03:25:24.602482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.223 [2024-11-27 03:25:24.602580] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.223 [2024-11-27 03:25:24.602606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.223 [2024-11-27 03:25:24.602620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.223 [2024-11-27 03:25:24.602634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.223 [2024-11-27 03:25:24.602664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.223 qpair failed and we were unable to recover it. 00:30:22.223 [2024-11-27 03:25:24.612512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.223 [2024-11-27 03:25:24.612626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.223 [2024-11-27 03:25:24.612651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.223 [2024-11-27 03:25:24.612665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.223 [2024-11-27 03:25:24.612677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.223 [2024-11-27 03:25:24.612707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.223 qpair failed and we were unable to recover it. 00:30:22.223 [2024-11-27 03:25:24.622544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.223 [2024-11-27 03:25:24.622677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.223 [2024-11-27 03:25:24.622703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.223 [2024-11-27 03:25:24.622717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.223 [2024-11-27 03:25:24.622729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.223 [2024-11-27 03:25:24.622760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.223 qpair failed and we were unable to recover it. 00:30:22.223 [2024-11-27 03:25:24.632581] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.223 [2024-11-27 03:25:24.632712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.223 [2024-11-27 03:25:24.632738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.223 [2024-11-27 03:25:24.632752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.223 [2024-11-27 03:25:24.632764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.223 [2024-11-27 03:25:24.632794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.223 qpair failed and we were unable to recover it. 00:30:22.223 [2024-11-27 03:25:24.642586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.223 [2024-11-27 03:25:24.642677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.642702] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.642716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.642729] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.642759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.652609] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.652714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.652740] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.652754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.652766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.652796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.662647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.662741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.662772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.662787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.662799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.662828] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.672726] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.672837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.672866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.672880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.672893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.672923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.682720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.682841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.682867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.682881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.682893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.682923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.692741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.692840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.692866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.692880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.692892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.692921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.702773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.702859] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.702884] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.702898] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.702910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.702939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.712802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.712900] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.712925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.712939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.712951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.712980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.722822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.722948] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.722973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.722987] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.722999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.723029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.732857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.732991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.733017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.733031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.733043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.733072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.742872] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.742959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.742985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.742999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.743011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.743041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.224 [2024-11-27 03:25:24.752912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.224 [2024-11-27 03:25:24.753003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.224 [2024-11-27 03:25:24.753034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.224 [2024-11-27 03:25:24.753049] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.224 [2024-11-27 03:25:24.753062] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.224 [2024-11-27 03:25:24.753092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.224 qpair failed and we were unable to recover it. 00:30:22.225 [2024-11-27 03:25:24.762932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.225 [2024-11-27 03:25:24.763019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.225 [2024-11-27 03:25:24.763045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.225 [2024-11-27 03:25:24.763059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.225 [2024-11-27 03:25:24.763072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.225 [2024-11-27 03:25:24.763101] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.225 qpair failed and we were unable to recover it. 00:30:22.225 [2024-11-27 03:25:24.772952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.225 [2024-11-27 03:25:24.773050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.225 [2024-11-27 03:25:24.773075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.225 [2024-11-27 03:25:24.773089] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.225 [2024-11-27 03:25:24.773101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.225 [2024-11-27 03:25:24.773143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.225 qpair failed and we were unable to recover it. 00:30:22.225 [2024-11-27 03:25:24.783030] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.225 [2024-11-27 03:25:24.783142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.225 [2024-11-27 03:25:24.783168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.225 [2024-11-27 03:25:24.783182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.225 [2024-11-27 03:25:24.783195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.225 [2024-11-27 03:25:24.783225] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.225 qpair failed and we were unable to recover it. 00:30:22.225 [2024-11-27 03:25:24.793052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.225 [2024-11-27 03:25:24.793180] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.225 [2024-11-27 03:25:24.793206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.225 [2024-11-27 03:25:24.793219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.225 [2024-11-27 03:25:24.793232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.225 [2024-11-27 03:25:24.793268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.225 qpair failed and we were unable to recover it. 00:30:22.225 [2024-11-27 03:25:24.803052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.225 [2024-11-27 03:25:24.803142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.225 [2024-11-27 03:25:24.803168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.225 [2024-11-27 03:25:24.803181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.225 [2024-11-27 03:25:24.803194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.225 [2024-11-27 03:25:24.803224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.225 qpair failed and we were unable to recover it. 00:30:22.225 [2024-11-27 03:25:24.813079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.225 [2024-11-27 03:25:24.813167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.225 [2024-11-27 03:25:24.813192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.225 [2024-11-27 03:25:24.813206] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.225 [2024-11-27 03:25:24.813218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.225 [2024-11-27 03:25:24.813248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.225 qpair failed and we were unable to recover it. 00:30:22.225 [2024-11-27 03:25:24.823090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.225 [2024-11-27 03:25:24.823186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.225 [2024-11-27 03:25:24.823212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.225 [2024-11-27 03:25:24.823226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.225 [2024-11-27 03:25:24.823238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.225 [2024-11-27 03:25:24.823269] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.225 qpair failed and we were unable to recover it. 00:30:22.225 [2024-11-27 03:25:24.833146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.225 [2024-11-27 03:25:24.833273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.225 [2024-11-27 03:25:24.833302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.225 [2024-11-27 03:25:24.833317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.225 [2024-11-27 03:25:24.833330] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.225 [2024-11-27 03:25:24.833373] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.225 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.843222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.843370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.843402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.843416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.843429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.843460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.853239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.853321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.853347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.853361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.853374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.853404] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.863209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.863296] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.863323] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.863337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.863349] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.863392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.873252] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.873346] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.873371] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.873385] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.873398] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.873430] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.883324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.883439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.883468] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.883483] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.883506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.883549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.893325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.893415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.893442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.893462] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.893476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.893506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.903369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.903479] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.903505] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.903518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.903540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.903573] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.913399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.913492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.913517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.913539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.913553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.913583] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.923390] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.923484] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.923510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.923530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.923546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.923575] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.933443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.933591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.933618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.487 [2024-11-27 03:25:24.933631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.487 [2024-11-27 03:25:24.933645] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.487 [2024-11-27 03:25:24.933674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.487 qpair failed and we were unable to recover it. 00:30:22.487 [2024-11-27 03:25:24.943425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.487 [2024-11-27 03:25:24.943513] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.487 [2024-11-27 03:25:24.943548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:24.943563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:24.943576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.488 [2024-11-27 03:25:24.943607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:24.953489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:24.953586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:24.953612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:24.953626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:24.953639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.488 [2024-11-27 03:25:24.953669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:24.963497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:24.963594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:24.963621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:24.963635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:24.963647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.488 [2024-11-27 03:25:24.963690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:24.973587] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:24.973678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:24.973704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:24.973718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:24.973736] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.488 [2024-11-27 03:25:24.973767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:24.983556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:24.983642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:24.983668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:24.983681] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:24.983694] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.488 [2024-11-27 03:25:24.983725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:24.993624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:24.993714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:24.993741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:24.993754] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:24.993767] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.488 [2024-11-27 03:25:24.993808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:25.003635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:25.003727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:25.003756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:25.003771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:25.003784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.488 [2024-11-27 03:25:25.003814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:25.013721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:25.013808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:25.013834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:25.013848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:25.013861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:22.488 [2024-11-27 03:25:25.013891] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:25.023708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:25.023801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:25.023835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:25.023851] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:25.023865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.488 [2024-11-27 03:25:25.023896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:25.033734] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:25.033832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:25.033860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:25.033874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:25.033887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.488 [2024-11-27 03:25:25.033918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:25.043737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:25.043832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:25.043860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:25.043874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:25.043887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.488 [2024-11-27 03:25:25.043918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:25.053774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.488 [2024-11-27 03:25:25.053896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.488 [2024-11-27 03:25:25.053923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.488 [2024-11-27 03:25:25.053937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.488 [2024-11-27 03:25:25.053950] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.488 [2024-11-27 03:25:25.053979] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.488 qpair failed and we were unable to recover it. 00:30:22.488 [2024-11-27 03:25:25.063823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.489 [2024-11-27 03:25:25.063953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.489 [2024-11-27 03:25:25.063980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.489 [2024-11-27 03:25:25.064001] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.489 [2024-11-27 03:25:25.064014] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.489 [2024-11-27 03:25:25.064044] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.489 qpair failed and we were unable to recover it. 00:30:22.489 [2024-11-27 03:25:25.073810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.489 [2024-11-27 03:25:25.073899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.489 [2024-11-27 03:25:25.073925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.489 [2024-11-27 03:25:25.073940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.489 [2024-11-27 03:25:25.073953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.489 [2024-11-27 03:25:25.073983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.489 qpair failed and we were unable to recover it. 00:30:22.489 [2024-11-27 03:25:25.083914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.489 [2024-11-27 03:25:25.084058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.489 [2024-11-27 03:25:25.084085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.489 [2024-11-27 03:25:25.084098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.489 [2024-11-27 03:25:25.084111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.489 [2024-11-27 03:25:25.084143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.489 qpair failed and we were unable to recover it. 00:30:22.489 [2024-11-27 03:25:25.093891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.489 [2024-11-27 03:25:25.093981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.489 [2024-11-27 03:25:25.094008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.489 [2024-11-27 03:25:25.094022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.489 [2024-11-27 03:25:25.094035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.489 [2024-11-27 03:25:25.094065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.489 qpair failed and we were unable to recover it. 00:30:22.749 [2024-11-27 03:25:25.103891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.749 [2024-11-27 03:25:25.103986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.749 [2024-11-27 03:25:25.104013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.749 [2024-11-27 03:25:25.104028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.749 [2024-11-27 03:25:25.104041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.749 [2024-11-27 03:25:25.104071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.749 qpair failed and we were unable to recover it. 00:30:22.749 [2024-11-27 03:25:25.113933] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.749 [2024-11-27 03:25:25.114025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.749 [2024-11-27 03:25:25.114052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.749 [2024-11-27 03:25:25.114066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.749 [2024-11-27 03:25:25.114079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.749 [2024-11-27 03:25:25.114110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.749 qpair failed and we were unable to recover it. 00:30:22.749 [2024-11-27 03:25:25.124025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.749 [2024-11-27 03:25:25.124118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.749 [2024-11-27 03:25:25.124146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.749 [2024-11-27 03:25:25.124165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.749 [2024-11-27 03:25:25.124178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.749 [2024-11-27 03:25:25.124208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.749 qpair failed and we were unable to recover it. 00:30:22.749 [2024-11-27 03:25:25.134009] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.749 [2024-11-27 03:25:25.134099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.749 [2024-11-27 03:25:25.134127] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.749 [2024-11-27 03:25:25.134141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.749 [2024-11-27 03:25:25.134154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.749 [2024-11-27 03:25:25.134198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.749 qpair failed and we were unable to recover it. 00:30:22.749 [2024-11-27 03:25:25.144034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.749 [2024-11-27 03:25:25.144127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.749 [2024-11-27 03:25:25.144154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.749 [2024-11-27 03:25:25.144169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.144182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.144211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.154074] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.154168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.154197] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.154225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.154239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.154270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.164064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.164150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.164178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.164192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.164204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.164237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.174110] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.174198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.174226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.174240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.174252] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.174283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.184117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.184209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.184235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.184249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.184261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.184290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.194154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.194294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.194320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.194334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.194346] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.194377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.204237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.204327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.204353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.204368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.204381] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.204410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.214222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.214308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.214334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.214349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.214361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.214391] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.224227] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.224313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.224339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.224353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.224366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.224396] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.234295] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.234384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.234411] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.234425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.234437] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.234480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.244342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.244435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.244479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.244499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.244512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.244553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.254325] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.750 [2024-11-27 03:25:25.254410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.750 [2024-11-27 03:25:25.254437] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.750 [2024-11-27 03:25:25.254451] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.750 [2024-11-27 03:25:25.254464] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.750 [2024-11-27 03:25:25.254494] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.750 qpair failed and we were unable to recover it. 00:30:22.750 [2024-11-27 03:25:25.264356] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.264444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.264471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.264485] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.264497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.264548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.274371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.274463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.274490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.274504] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.274516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.274561] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.284419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.284506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.284545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.284561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.284574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.284610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.294478] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.294579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.294606] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.294620] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.294633] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.294664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.304474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.304562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.304590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.304603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.304617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.304648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.314501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.314603] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.314630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.314644] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.314657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.314686] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.324558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.324658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.324684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.324699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.324711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.324742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.334560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.334647] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.334679] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.334694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.334707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.334737] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.344576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.344674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.344701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.344714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.344727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.344757] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.354665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.354760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.354787] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.354801] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.354814] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.354844] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:22.751 [2024-11-27 03:25:25.364637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:22.751 [2024-11-27 03:25:25.364733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:22.751 [2024-11-27 03:25:25.364760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:22.751 [2024-11-27 03:25:25.364775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:22.751 [2024-11-27 03:25:25.364795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:22.751 [2024-11-27 03:25:25.364824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:22.751 qpair failed and we were unable to recover it. 00:30:23.011 [2024-11-27 03:25:25.374666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.011 [2024-11-27 03:25:25.374761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.011 [2024-11-27 03:25:25.374788] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.011 [2024-11-27 03:25:25.374802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.011 [2024-11-27 03:25:25.374815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.011 [2024-11-27 03:25:25.374852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.011 qpair failed and we were unable to recover it. 00:30:23.011 [2024-11-27 03:25:25.384710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.011 [2024-11-27 03:25:25.384802] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.011 [2024-11-27 03:25:25.384828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.011 [2024-11-27 03:25:25.384843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.011 [2024-11-27 03:25:25.384856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.011 [2024-11-27 03:25:25.384886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.011 qpair failed and we were unable to recover it. 00:30:23.011 [2024-11-27 03:25:25.394739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.011 [2024-11-27 03:25:25.394831] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.011 [2024-11-27 03:25:25.394858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.011 [2024-11-27 03:25:25.394871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.011 [2024-11-27 03:25:25.394884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.011 [2024-11-27 03:25:25.394915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.011 qpair failed and we were unable to recover it. 00:30:23.011 [2024-11-27 03:25:25.404800] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.011 [2024-11-27 03:25:25.404925] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.011 [2024-11-27 03:25:25.404951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.011 [2024-11-27 03:25:25.404965] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.011 [2024-11-27 03:25:25.404978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.011 [2024-11-27 03:25:25.405008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.011 qpair failed and we were unable to recover it. 00:30:23.011 [2024-11-27 03:25:25.414868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.011 [2024-11-27 03:25:25.414976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.011 [2024-11-27 03:25:25.415002] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.011 [2024-11-27 03:25:25.415017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.011 [2024-11-27 03:25:25.415029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.011 [2024-11-27 03:25:25.415058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.011 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.424810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.424898] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.424925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.424940] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.424952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.424983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.434905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.435004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.435031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.435046] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.435059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.435088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.444895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.444982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.445008] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.445023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.445036] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.445065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.454911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.455002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.455027] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.455041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.455053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.455082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.464959] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.465041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.465069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.465083] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.465101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.465145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.475020] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.475120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.475146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.475161] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.475174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.475204] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.485073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.485167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.485194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.485207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.485220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.485250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.495086] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.495179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.495205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.495219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.495232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.495262] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.505075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.505170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.505200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.505215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.505227] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.505256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.515092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.515188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.515214] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.515228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.515241] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.515272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.525143] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.525233] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.525260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.525274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.525286] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.012 [2024-11-27 03:25:25.525317] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.012 qpair failed and we were unable to recover it. 00:30:23.012 [2024-11-27 03:25:25.535126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.012 [2024-11-27 03:25:25.535210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.012 [2024-11-27 03:25:25.535237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.012 [2024-11-27 03:25:25.535251] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.012 [2024-11-27 03:25:25.535263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.535294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.013 [2024-11-27 03:25:25.545166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.013 [2024-11-27 03:25:25.545255] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.013 [2024-11-27 03:25:25.545281] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.013 [2024-11-27 03:25:25.545295] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.013 [2024-11-27 03:25:25.545308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.545339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.013 [2024-11-27 03:25:25.555273] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.013 [2024-11-27 03:25:25.555370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.013 [2024-11-27 03:25:25.555396] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.013 [2024-11-27 03:25:25.555416] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.013 [2024-11-27 03:25:25.555430] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.555459] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.013 [2024-11-27 03:25:25.565245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.013 [2024-11-27 03:25:25.565343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.013 [2024-11-27 03:25:25.565369] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.013 [2024-11-27 03:25:25.565383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.013 [2024-11-27 03:25:25.565396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.565426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.013 [2024-11-27 03:25:25.575246] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.013 [2024-11-27 03:25:25.575356] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.013 [2024-11-27 03:25:25.575382] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.013 [2024-11-27 03:25:25.575395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.013 [2024-11-27 03:25:25.575408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.575438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.013 [2024-11-27 03:25:25.585282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.013 [2024-11-27 03:25:25.585369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.013 [2024-11-27 03:25:25.585395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.013 [2024-11-27 03:25:25.585409] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.013 [2024-11-27 03:25:25.585422] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.585451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.013 [2024-11-27 03:25:25.595344] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.013 [2024-11-27 03:25:25.595445] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.013 [2024-11-27 03:25:25.595472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.013 [2024-11-27 03:25:25.595486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.013 [2024-11-27 03:25:25.595498] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.595536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.013 [2024-11-27 03:25:25.605339] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.013 [2024-11-27 03:25:25.605431] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.013 [2024-11-27 03:25:25.605458] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.013 [2024-11-27 03:25:25.605472] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.013 [2024-11-27 03:25:25.605485] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.605514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.013 [2024-11-27 03:25:25.615385] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.013 [2024-11-27 03:25:25.615475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.013 [2024-11-27 03:25:25.615504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.013 [2024-11-27 03:25:25.615519] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.013 [2024-11-27 03:25:25.615539] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.615571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.013 [2024-11-27 03:25:25.625412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.013 [2024-11-27 03:25:25.625499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.013 [2024-11-27 03:25:25.625532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.013 [2024-11-27 03:25:25.625558] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.013 [2024-11-27 03:25:25.625573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.013 [2024-11-27 03:25:25.625603] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.013 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.635488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.635616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.635643] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.635657] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.635670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.635713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.645473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.645561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.645588] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.645609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.645622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.645654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.655489] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.655590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.655617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.655631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.655644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.655674] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.665519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.665614] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.665640] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.665654] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.665667] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.665698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.675586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.675691] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.675717] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.675731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.675743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.675774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.685624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.685720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.685747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.685760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.685773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.685804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.695600] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.695683] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.695709] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.695723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.695735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.695766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.705641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.705728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.705754] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.705768] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.705781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.705810] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.715685] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.715778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.715808] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.715823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.715836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.715867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.725700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.725790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.725817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.725831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.725843] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.725874] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.735759] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.735844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.735876] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.273 [2024-11-27 03:25:25.735891] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.273 [2024-11-27 03:25:25.735904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.273 [2024-11-27 03:25:25.735933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.273 qpair failed and we were unable to recover it. 00:30:23.273 [2024-11-27 03:25:25.745765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.273 [2024-11-27 03:25:25.745848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.273 [2024-11-27 03:25:25.745875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.745889] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.745901] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.745931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.755847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.755953] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.755980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.755994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.756006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.756049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.765814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.765906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.765933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.765947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.765960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.765990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.775833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.775920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.775946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.775960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.775974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.776009] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.785905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.786027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.786054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.786069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.786081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.786110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.795910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.796004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.796034] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.796048] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.796061] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.796092] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.805977] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.806070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.806097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.806112] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.806124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.806153] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.816003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.816132] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.816158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.816172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.816185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.816214] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.826031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.826129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.826161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.826175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.826188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.826217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.836065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.836173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.836199] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.836213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.836226] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.836256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.846076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.846189] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.846216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.846230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.846243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.846272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.856107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.274 [2024-11-27 03:25:25.856201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.274 [2024-11-27 03:25:25.856227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.274 [2024-11-27 03:25:25.856240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.274 [2024-11-27 03:25:25.856253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.274 [2024-11-27 03:25:25.856282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.274 qpair failed and we were unable to recover it. 00:30:23.274 [2024-11-27 03:25:25.866093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.275 [2024-11-27 03:25:25.866179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.275 [2024-11-27 03:25:25.866206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.275 [2024-11-27 03:25:25.866219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.275 [2024-11-27 03:25:25.866232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.275 [2024-11-27 03:25:25.866267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.275 qpair failed and we were unable to recover it. 00:30:23.275 [2024-11-27 03:25:25.876149] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.275 [2024-11-27 03:25:25.876251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.275 [2024-11-27 03:25:25.876277] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.275 [2024-11-27 03:25:25.876292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.275 [2024-11-27 03:25:25.876304] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.275 [2024-11-27 03:25:25.876334] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.275 qpair failed and we were unable to recover it. 00:30:23.275 [2024-11-27 03:25:25.886182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.275 [2024-11-27 03:25:25.886278] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.275 [2024-11-27 03:25:25.886304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.275 [2024-11-27 03:25:25.886318] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.275 [2024-11-27 03:25:25.886331] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.275 [2024-11-27 03:25:25.886361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.275 qpair failed and we were unable to recover it. 00:30:23.534 [2024-11-27 03:25:25.896175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.534 [2024-11-27 03:25:25.896268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.534 [2024-11-27 03:25:25.896295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.534 [2024-11-27 03:25:25.896310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.534 [2024-11-27 03:25:25.896323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.534 [2024-11-27 03:25:25.896354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.534 qpair failed and we were unable to recover it. 00:30:23.534 [2024-11-27 03:25:25.906207] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.534 [2024-11-27 03:25:25.906294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.534 [2024-11-27 03:25:25.906320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.534 [2024-11-27 03:25:25.906344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.534 [2024-11-27 03:25:25.906358] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.534 [2024-11-27 03:25:25.906387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.534 qpair failed and we were unable to recover it. 00:30:23.534 [2024-11-27 03:25:25.916249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.534 [2024-11-27 03:25:25.916343] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.534 [2024-11-27 03:25:25.916378] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.534 [2024-11-27 03:25:25.916394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:25.916407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:25.916437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:25.926311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:25.926453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:25.926481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:25.926495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:25.926507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:25.926564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:25.936326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:25.936414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:25.936440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:25.936454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:25.936474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:25.936505] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:25.946334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:25.946422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:25.946449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:25.946463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:25.946476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:25.946506] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:25.956362] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:25.956457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:25.956484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:25.956498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:25.956536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:25.956570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:25.966403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:25.966490] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:25.966533] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:25.966552] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:25.966565] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:25.966607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:25.976417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:25.976502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:25.976539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:25.976563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:25.976576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:25.976607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:25.986433] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:25.986534] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:25.986568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:25.986582] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:25.986595] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:25.986625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:25.996505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:25.996633] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:25.996660] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:25.996675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:25.996687] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:25.996718] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:26.006497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:26.006611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:26.006641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:26.006656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:26.006669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:26.006700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:26.016522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:26.016617] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:26.016644] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:26.016658] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:26.016670] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:26.016700] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:26.026547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:26.026635] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.535 [2024-11-27 03:25:26.026662] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.535 [2024-11-27 03:25:26.026675] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.535 [2024-11-27 03:25:26.026688] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.535 [2024-11-27 03:25:26.026717] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.535 qpair failed and we were unable to recover it. 00:30:23.535 [2024-11-27 03:25:26.036584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.535 [2024-11-27 03:25:26.036682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.036708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.036722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.036734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.036766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.046636] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.046739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.046766] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.046779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.046798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.046829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.056626] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.056712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.056739] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.056755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.056768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.056799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.066672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.066764] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.066791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.066805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.066818] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.066847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.076740] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.076830] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.076857] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.076871] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.076884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.076926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.086747] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.086840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.086867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.086881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.086893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.086924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.096784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.096876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.096903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.096917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.096929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.096960] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.106791] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.106921] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.106948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.106962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.106975] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.107006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.116827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.116920] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.116946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.116960] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.116972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.117014] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.126837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.126930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.126956] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.126970] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.126983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.127013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.136934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.137043] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.137091] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.137120] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.137136] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:23.536 [2024-11-27 03:25:26.137179] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.536 [2024-11-27 03:25:26.146926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.536 [2024-11-27 03:25:26.147049] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.536 [2024-11-27 03:25:26.147080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.536 [2024-11-27 03:25:26.147096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.536 [2024-11-27 03:25:26.147109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.536 [2024-11-27 03:25:26.147152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.536 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.156935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.157038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.157065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.157080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.157093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.157123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.166967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.167054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.167081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.167097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.167110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.167141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.176954] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.177037] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.177063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.177077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.177090] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.177119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.186992] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.187081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.187107] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.187122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.187134] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.187165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.197059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.197150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.197177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.197191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.197204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.197235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.207121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.207216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.207242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.207256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.207269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.207300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.217129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.217246] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.217272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.217286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.217299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.217330] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.227115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.227200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.227231] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.227246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.227259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.227288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.237195] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.237300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.237326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.237340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.237354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.237385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.247186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.247285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.247311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.247324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.247337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.247368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.257269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.257379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.257406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.257420] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.257433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.257464] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.267312] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.267396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.267422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.267437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.267450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.267492] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.277301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.277397] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.277426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.277440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.277453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.277483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.287341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.287461] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.287487] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.287502] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.287514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.798 [2024-11-27 03:25:26.287552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.798 qpair failed and we were unable to recover it. 00:30:23.798 [2024-11-27 03:25:26.297372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.798 [2024-11-27 03:25:26.297477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.798 [2024-11-27 03:25:26.297502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.798 [2024-11-27 03:25:26.297517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.798 [2024-11-27 03:25:26.297536] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.297569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.307352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.307438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.307464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.307477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.307490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.307520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.317389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.317486] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.317520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.317543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.317557] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.317587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.327428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.327553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.327579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.327593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.327605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.327636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.337442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.337546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.337572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.337586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.337599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.337630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.347493] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.347591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.347617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.347631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.347644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.347675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.357554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.357655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.357680] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.357694] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.357706] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.357742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.367561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.367680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.367710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.367726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.367738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.367768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.377582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.377671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.377697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.377711] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.377723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.377753] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.387655] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.387783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.387813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.387828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.387842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.387872] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.397673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.397767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.397793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.397807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.397819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.397851] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:23.799 [2024-11-27 03:25:26.407678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:23.799 [2024-11-27 03:25:26.407769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:23.799 [2024-11-27 03:25:26.407801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:23.799 [2024-11-27 03:25:26.407816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:23.799 [2024-11-27 03:25:26.407829] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:23.799 [2024-11-27 03:25:26.407860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:23.799 qpair failed and we were unable to recover it. 00:30:24.061 [2024-11-27 03:25:26.417689] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.061 [2024-11-27 03:25:26.417785] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.061 [2024-11-27 03:25:26.417811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.061 [2024-11-27 03:25:26.417825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.061 [2024-11-27 03:25:26.417838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.061 [2024-11-27 03:25:26.417868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.061 qpair failed and we were unable to recover it. 00:30:24.061 [2024-11-27 03:25:26.427717] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.061 [2024-11-27 03:25:26.427812] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.061 [2024-11-27 03:25:26.427839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.061 [2024-11-27 03:25:26.427853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.061 [2024-11-27 03:25:26.427866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.061 [2024-11-27 03:25:26.427896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.061 qpair failed and we were unable to recover it. 00:30:24.061 [2024-11-27 03:25:26.437784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.061 [2024-11-27 03:25:26.437911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.061 [2024-11-27 03:25:26.437937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.061 [2024-11-27 03:25:26.437951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.061 [2024-11-27 03:25:26.437964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.061 [2024-11-27 03:25:26.437993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.061 qpair failed and we were unable to recover it. 00:30:24.061 [2024-11-27 03:25:26.447788] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.061 [2024-11-27 03:25:26.447892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.061 [2024-11-27 03:25:26.447917] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.061 [2024-11-27 03:25:26.447930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.061 [2024-11-27 03:25:26.447951] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.061 [2024-11-27 03:25:26.447983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.061 qpair failed and we were unable to recover it. 00:30:24.061 [2024-11-27 03:25:26.457817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.061 [2024-11-27 03:25:26.457910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.061 [2024-11-27 03:25:26.457934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.061 [2024-11-27 03:25:26.457948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.061 [2024-11-27 03:25:26.457960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.061 [2024-11-27 03:25:26.457989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.061 qpair failed and we were unable to recover it. 00:30:24.061 [2024-11-27 03:25:26.467871] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.061 [2024-11-27 03:25:26.467957] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.061 [2024-11-27 03:25:26.467982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.061 [2024-11-27 03:25:26.467996] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.061 [2024-11-27 03:25:26.468008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.061 [2024-11-27 03:25:26.468038] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.061 qpair failed and we were unable to recover it. 00:30:24.061 [2024-11-27 03:25:26.477912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.061 [2024-11-27 03:25:26.478003] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.061 [2024-11-27 03:25:26.478029] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.061 [2024-11-27 03:25:26.478043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.061 [2024-11-27 03:25:26.478056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.061 [2024-11-27 03:25:26.478086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.061 qpair failed and we were unable to recover it. 00:30:24.061 [2024-11-27 03:25:26.487900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.061 [2024-11-27 03:25:26.487991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.061 [2024-11-27 03:25:26.488016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.061 [2024-11-27 03:25:26.488030] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.061 [2024-11-27 03:25:26.488042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.061 [2024-11-27 03:25:26.488086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.061 qpair failed and we were unable to recover it. 00:30:24.061 [2024-11-27 03:25:26.497927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.061 [2024-11-27 03:25:26.498046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.061 [2024-11-27 03:25:26.498072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.061 [2024-11-27 03:25:26.498086] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.061 [2024-11-27 03:25:26.498099] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.061 [2024-11-27 03:25:26.498129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.507946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.508031] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.508057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.508071] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.508084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.508114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.518010] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.518127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.518154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.518168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.518181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.518223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.528007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.528101] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.528127] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.528141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.528154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.528185] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.538066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.538197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.538221] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.538235] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.538254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.538286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.548083] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.548210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.548237] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.548250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.548263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.548293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.558144] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.558236] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.558261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.558275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.558288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.558318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.568166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.568254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.568280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.568294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.568306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.568335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.578188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.578305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.578331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.578344] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.578357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.578387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.588181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.588270] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.588297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.588311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.588324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.588353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.598287] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.598396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.598422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.598437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.598449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.598480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.608293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.608415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.608440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.608454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.062 [2024-11-27 03:25:26.608467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.062 [2024-11-27 03:25:26.608498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.062 qpair failed and we were unable to recover it. 00:30:24.062 [2024-11-27 03:25:26.618282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.062 [2024-11-27 03:25:26.618391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.062 [2024-11-27 03:25:26.618416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.062 [2024-11-27 03:25:26.618430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.063 [2024-11-27 03:25:26.618442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.063 [2024-11-27 03:25:26.618473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.063 qpair failed and we were unable to recover it. 00:30:24.063 [2024-11-27 03:25:26.628338] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.063 [2024-11-27 03:25:26.628433] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.063 [2024-11-27 03:25:26.628459] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.063 [2024-11-27 03:25:26.628480] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.063 [2024-11-27 03:25:26.628494] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.063 [2024-11-27 03:25:26.628531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.063 qpair failed and we were unable to recover it. 00:30:24.063 [2024-11-27 03:25:26.638357] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.063 [2024-11-27 03:25:26.638454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.063 [2024-11-27 03:25:26.638484] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.063 [2024-11-27 03:25:26.638498] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.063 [2024-11-27 03:25:26.638511] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.063 [2024-11-27 03:25:26.638548] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.063 qpair failed and we were unable to recover it. 00:30:24.063 [2024-11-27 03:25:26.648380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.063 [2024-11-27 03:25:26.648491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.063 [2024-11-27 03:25:26.648517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.063 [2024-11-27 03:25:26.648540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.063 [2024-11-27 03:25:26.648555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.063 [2024-11-27 03:25:26.648586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.063 qpair failed and we were unable to recover it. 00:30:24.063 [2024-11-27 03:25:26.658464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.063 [2024-11-27 03:25:26.658564] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.063 [2024-11-27 03:25:26.658590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.063 [2024-11-27 03:25:26.658605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.063 [2024-11-27 03:25:26.658618] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.063 [2024-11-27 03:25:26.658660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.063 qpair failed and we were unable to recover it. 00:30:24.063 [2024-11-27 03:25:26.668444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.063 [2024-11-27 03:25:26.668566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.063 [2024-11-27 03:25:26.668592] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.063 [2024-11-27 03:25:26.668606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.063 [2024-11-27 03:25:26.668619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.063 [2024-11-27 03:25:26.668649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.063 qpair failed and we were unable to recover it. 00:30:24.324 [2024-11-27 03:25:26.678491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.324 [2024-11-27 03:25:26.678602] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.324 [2024-11-27 03:25:26.678627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.324 [2024-11-27 03:25:26.678641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.324 [2024-11-27 03:25:26.678653] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.324 [2024-11-27 03:25:26.678684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.324 qpair failed and we were unable to recover it. 00:30:24.324 [2024-11-27 03:25:26.688537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.324 [2024-11-27 03:25:26.688630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.324 [2024-11-27 03:25:26.688656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.688670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.688682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.688713] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.698515] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.698616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.698642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.698656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.698669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.698698] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.708617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.708711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.708738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.708752] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.708764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.708794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.718627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.718728] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.718757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.718784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.718798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.718830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.728645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.728765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.728791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.728805] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.728817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.728849] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.738652] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.738765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.738791] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.738804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.738817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.738847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.748684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.748768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.748793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.748807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.748820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.748863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.758753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.758862] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.758889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.758903] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.758916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.758958] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.768744] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.768832] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.768858] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.768872] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.768885] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.768914] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.778750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.778881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.778906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.778920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.778933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.778963] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.788795] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.788875] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.788900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.788914] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.788927] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.788969] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.325 [2024-11-27 03:25:26.798817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.325 [2024-11-27 03:25:26.798905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.325 [2024-11-27 03:25:26.798930] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.325 [2024-11-27 03:25:26.798944] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.325 [2024-11-27 03:25:26.798957] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.325 [2024-11-27 03:25:26.798987] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.325 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.808829] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.808916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.808946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.808962] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.808974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.809003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.818876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.818965] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.818990] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.819004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.819017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.819047] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.828936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.829028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.829054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.829068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.829081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.829110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.838985] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.839092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.839117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.839131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.839144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.839174] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.849008] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.849099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.849124] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.849138] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.849151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.849186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.859014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.859128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.859154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.859168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.859181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.859211] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.869034] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.869121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.869150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.869165] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.869177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.869207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.879041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.879126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.879152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.879166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.879178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.879208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.889096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.889182] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.889208] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.889222] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.889235] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.889266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.899095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.899208] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.899239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.899254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.899267] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.899296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.909133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.909217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.909243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.909256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.909269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.326 [2024-11-27 03:25:26.909299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.326 qpair failed and we were unable to recover it. 00:30:24.326 [2024-11-27 03:25:26.919170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.326 [2024-11-27 03:25:26.919258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.326 [2024-11-27 03:25:26.919284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.326 [2024-11-27 03:25:26.919298] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.326 [2024-11-27 03:25:26.919311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.327 [2024-11-27 03:25:26.919342] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.327 qpair failed and we were unable to recover it. 00:30:24.327 [2024-11-27 03:25:26.929182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.327 [2024-11-27 03:25:26.929282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.327 [2024-11-27 03:25:26.929311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.327 [2024-11-27 03:25:26.929327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.327 [2024-11-27 03:25:26.929340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.327 [2024-11-27 03:25:26.929370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.327 qpair failed and we were unable to recover it. 00:30:24.327 [2024-11-27 03:25:26.939211] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.327 [2024-11-27 03:25:26.939330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.327 [2024-11-27 03:25:26.939357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.327 [2024-11-27 03:25:26.939370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.327 [2024-11-27 03:25:26.939383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.327 [2024-11-27 03:25:26.939432] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.327 qpair failed and we were unable to recover it. 00:30:24.587 [2024-11-27 03:25:26.949258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.587 [2024-11-27 03:25:26.949341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.587 [2024-11-27 03:25:26.949366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.587 [2024-11-27 03:25:26.949381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.587 [2024-11-27 03:25:26.949394] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.587 [2024-11-27 03:25:26.949423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.587 qpair failed and we were unable to recover it. 00:30:24.587 [2024-11-27 03:25:26.959285] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.587 [2024-11-27 03:25:26.959377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.587 [2024-11-27 03:25:26.959407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.587 [2024-11-27 03:25:26.959422] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.587 [2024-11-27 03:25:26.959435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.587 [2024-11-27 03:25:26.959465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.587 qpair failed and we were unable to recover it. 00:30:24.587 [2024-11-27 03:25:26.969299] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.587 [2024-11-27 03:25:26.969392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.587 [2024-11-27 03:25:26.969417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.587 [2024-11-27 03:25:26.969432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.587 [2024-11-27 03:25:26.969444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.587 [2024-11-27 03:25:26.969474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.587 qpair failed and we were unable to recover it. 00:30:24.587 [2024-11-27 03:25:26.979333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.587 [2024-11-27 03:25:26.979425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.587 [2024-11-27 03:25:26.979451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.587 [2024-11-27 03:25:26.979465] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.587 [2024-11-27 03:25:26.979478] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.587 [2024-11-27 03:25:26.979507] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.587 qpair failed and we were unable to recover it. 00:30:24.587 [2024-11-27 03:25:26.989423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.587 [2024-11-27 03:25:26.989516] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.587 [2024-11-27 03:25:26.989549] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.587 [2024-11-27 03:25:26.989564] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.587 [2024-11-27 03:25:26.989576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.587 [2024-11-27 03:25:26.989606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.587 qpair failed and we were unable to recover it. 00:30:24.587 [2024-11-27 03:25:26.999396] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.587 [2024-11-27 03:25:26.999487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.587 [2024-11-27 03:25:26.999513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.587 [2024-11-27 03:25:26.999535] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.587 [2024-11-27 03:25:26.999549] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.587 [2024-11-27 03:25:26.999580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.587 qpair failed and we were unable to recover it. 00:30:24.587 [2024-11-27 03:25:27.009428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.587 [2024-11-27 03:25:27.009523] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.587 [2024-11-27 03:25:27.009557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.587 [2024-11-27 03:25:27.009572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.587 [2024-11-27 03:25:27.009585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.587 [2024-11-27 03:25:27.009614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.587 qpair failed and we were unable to recover it. 00:30:24.587 [2024-11-27 03:25:27.019435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.587 [2024-11-27 03:25:27.019540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.587 [2024-11-27 03:25:27.019566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.587 [2024-11-27 03:25:27.019580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.587 [2024-11-27 03:25:27.019592] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.587 [2024-11-27 03:25:27.019623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.587 qpair failed and we were unable to recover it. 00:30:24.587 [2024-11-27 03:25:27.029468] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.587 [2024-11-27 03:25:27.029555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.587 [2024-11-27 03:25:27.029581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.587 [2024-11-27 03:25:27.029595] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.587 [2024-11-27 03:25:27.029613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.029645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.039518] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.039626] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.039651] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.039665] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.039677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.039708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.049598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.049730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.049757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.049771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.049783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.049814] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.059679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.059771] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.059797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.059811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.059824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.059854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.069614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.069726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.069755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.069771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.069784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.069815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.079644] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.079743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.079769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.079783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.079796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.079826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.089674] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.089766] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.089796] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.089810] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.089823] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.089853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.099691] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.099779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.099804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.099818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.099831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.099860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.109692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.109774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.109799] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.109813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.109825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.109855] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.119738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.119833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.119859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.119879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.119893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.119923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.129812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.129916] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.129945] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.129961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.129974] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.130005] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.139811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.139927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.139953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.588 [2024-11-27 03:25:27.139967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.588 [2024-11-27 03:25:27.139981] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.588 [2024-11-27 03:25:27.140010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.588 qpair failed and we were unable to recover it. 00:30:24.588 [2024-11-27 03:25:27.149805] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.588 [2024-11-27 03:25:27.149902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.588 [2024-11-27 03:25:27.149928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.589 [2024-11-27 03:25:27.149942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.589 [2024-11-27 03:25:27.149955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.589 [2024-11-27 03:25:27.149984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.589 qpair failed and we were unable to recover it. 00:30:24.589 [2024-11-27 03:25:27.159883] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.589 [2024-11-27 03:25:27.159976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.589 [2024-11-27 03:25:27.160003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.589 [2024-11-27 03:25:27.160017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.589 [2024-11-27 03:25:27.160029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.589 [2024-11-27 03:25:27.160061] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.589 qpair failed and we were unable to recover it. 00:30:24.589 [2024-11-27 03:25:27.169898] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.589 [2024-11-27 03:25:27.169989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.589 [2024-11-27 03:25:27.170014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.589 [2024-11-27 03:25:27.170028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.589 [2024-11-27 03:25:27.170041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.589 [2024-11-27 03:25:27.170071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.589 qpair failed and we were unable to recover it. 00:30:24.589 [2024-11-27 03:25:27.179987] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.589 [2024-11-27 03:25:27.180076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.589 [2024-11-27 03:25:27.180102] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.589 [2024-11-27 03:25:27.180116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.589 [2024-11-27 03:25:27.180129] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.589 [2024-11-27 03:25:27.180158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.589 qpair failed and we were unable to recover it. 00:30:24.589 [2024-11-27 03:25:27.189964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.589 [2024-11-27 03:25:27.190091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.589 [2024-11-27 03:25:27.190117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.589 [2024-11-27 03:25:27.190131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.589 [2024-11-27 03:25:27.190144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.589 [2024-11-27 03:25:27.190173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.589 qpair failed and we were unable to recover it. 00:30:24.589 [2024-11-27 03:25:27.200050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.589 [2024-11-27 03:25:27.200143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.589 [2024-11-27 03:25:27.200169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.589 [2024-11-27 03:25:27.200183] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.589 [2024-11-27 03:25:27.200196] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.589 [2024-11-27 03:25:27.200227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.589 qpair failed and we were unable to recover it. 00:30:24.850 [2024-11-27 03:25:27.210030] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.850 [2024-11-27 03:25:27.210162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.850 [2024-11-27 03:25:27.210188] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.850 [2024-11-27 03:25:27.210210] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.850 [2024-11-27 03:25:27.210223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.850 [2024-11-27 03:25:27.210254] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.850 qpair failed and we were unable to recover it. 00:30:24.850 [2024-11-27 03:25:27.220070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.850 [2024-11-27 03:25:27.220176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.850 [2024-11-27 03:25:27.220202] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.850 [2024-11-27 03:25:27.220216] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.850 [2024-11-27 03:25:27.220228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.850 [2024-11-27 03:25:27.220259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.850 qpair failed and we were unable to recover it. 00:30:24.850 [2024-11-27 03:25:27.230057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.850 [2024-11-27 03:25:27.230181] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.850 [2024-11-27 03:25:27.230207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.850 [2024-11-27 03:25:27.230220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.850 [2024-11-27 03:25:27.230233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.850 [2024-11-27 03:25:27.230275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.850 qpair failed and we were unable to recover it. 00:30:24.850 [2024-11-27 03:25:27.240137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.850 [2024-11-27 03:25:27.240253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.850 [2024-11-27 03:25:27.240278] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.850 [2024-11-27 03:25:27.240292] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.850 [2024-11-27 03:25:27.240305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.850 [2024-11-27 03:25:27.240336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.850 qpair failed and we were unable to recover it. 00:30:24.850 [2024-11-27 03:25:27.250141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.850 [2024-11-27 03:25:27.250265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.850 [2024-11-27 03:25:27.250290] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.850 [2024-11-27 03:25:27.250304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.850 [2024-11-27 03:25:27.250317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.850 [2024-11-27 03:25:27.250359] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.850 qpair failed and we were unable to recover it. 00:30:24.850 [2024-11-27 03:25:27.260171] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.850 [2024-11-27 03:25:27.260300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.850 [2024-11-27 03:25:27.260326] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.850 [2024-11-27 03:25:27.260340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.850 [2024-11-27 03:25:27.260352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.850 [2024-11-27 03:25:27.260382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.850 qpair failed and we were unable to recover it. 00:30:24.850 [2024-11-27 03:25:27.270196] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.850 [2024-11-27 03:25:27.270285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.850 [2024-11-27 03:25:27.270311] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.850 [2024-11-27 03:25:27.270325] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.270338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.270367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.280269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.280365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.280393] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.280410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.280423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.280456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.290243] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.290330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.290356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.290370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.290383] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.290413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.300300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.300391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.300425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.300441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.300453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.300484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.310293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.310419] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.310445] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.310458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.310472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.310503] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.320317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.320410] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.320436] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.320450] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.320463] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.320493] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.330359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.330474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.330499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.330513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.330535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.330568] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.340380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.340466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.340492] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.340506] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.340519] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.340563] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.350423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.350514] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.350547] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.350561] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.350574] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.350605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.360443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.360538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.360564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.360578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.360591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.360621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.370462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.370587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.370613] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.370628] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.370640] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.370669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.380562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.380659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.851 [2024-11-27 03:25:27.380684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.851 [2024-11-27 03:25:27.380698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.851 [2024-11-27 03:25:27.380711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.851 [2024-11-27 03:25:27.380741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.851 qpair failed and we were unable to recover it. 00:30:24.851 [2024-11-27 03:25:27.390511] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.851 [2024-11-27 03:25:27.390625] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.852 [2024-11-27 03:25:27.390656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.852 [2024-11-27 03:25:27.390671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.852 [2024-11-27 03:25:27.390683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.852 [2024-11-27 03:25:27.390715] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.852 qpair failed and we were unable to recover it. 00:30:24.852 [2024-11-27 03:25:27.400582] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.852 [2024-11-27 03:25:27.400695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.852 [2024-11-27 03:25:27.400722] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.852 [2024-11-27 03:25:27.400736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.852 [2024-11-27 03:25:27.400749] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.852 [2024-11-27 03:25:27.400778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.852 qpair failed and we were unable to recover it. 00:30:24.852 [2024-11-27 03:25:27.410601] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.852 [2024-11-27 03:25:27.410689] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.852 [2024-11-27 03:25:27.410714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.852 [2024-11-27 03:25:27.410728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.852 [2024-11-27 03:25:27.410741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.852 [2024-11-27 03:25:27.410770] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.852 qpair failed and we were unable to recover it. 00:30:24.852 [2024-11-27 03:25:27.420678] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.852 [2024-11-27 03:25:27.420768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.852 [2024-11-27 03:25:27.420794] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.852 [2024-11-27 03:25:27.420807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.852 [2024-11-27 03:25:27.420820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.852 [2024-11-27 03:25:27.420850] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.852 qpair failed and we were unable to recover it. 00:30:24.852 [2024-11-27 03:25:27.430681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.852 [2024-11-27 03:25:27.430772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.852 [2024-11-27 03:25:27.430798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.852 [2024-11-27 03:25:27.430812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.852 [2024-11-27 03:25:27.430824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.852 [2024-11-27 03:25:27.430860] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.852 qpair failed and we were unable to recover it. 00:30:24.852 [2024-11-27 03:25:27.440700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.852 [2024-11-27 03:25:27.440791] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.852 [2024-11-27 03:25:27.440817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.852 [2024-11-27 03:25:27.440831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.852 [2024-11-27 03:25:27.440844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.852 [2024-11-27 03:25:27.440873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.852 qpair failed and we were unable to recover it. 00:30:24.852 [2024-11-27 03:25:27.450709] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.852 [2024-11-27 03:25:27.450803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.852 [2024-11-27 03:25:27.450829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.852 [2024-11-27 03:25:27.450843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.852 [2024-11-27 03:25:27.450856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.852 [2024-11-27 03:25:27.450886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.852 qpair failed and we were unable to recover it. 00:30:24.852 [2024-11-27 03:25:27.460755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:24.852 [2024-11-27 03:25:27.460848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:24.852 [2024-11-27 03:25:27.460872] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:24.852 [2024-11-27 03:25:27.460885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:24.852 [2024-11-27 03:25:27.460897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:24.852 [2024-11-27 03:25:27.460926] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:24.852 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.470767] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.470855] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.470881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.470895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.470908] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.470938] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.480834] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.480924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.480959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.480974] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.480987] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.481016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.490822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.490915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.490941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.490954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.490967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.490997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.500885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.501015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.501040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.501054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.501067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.501097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.510875] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.510967] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.510993] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.511007] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.511020] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.511049] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.520930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.521064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.521092] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.521107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.521126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.521158] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.530936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.531021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.531047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.531061] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.531074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.531104] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.540962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.541050] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.541075] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.541088] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.541101] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.541131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.550979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.551063] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.551089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.551103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.551116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.551146] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.561061] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.561199] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.112 [2024-11-27 03:25:27.561224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.112 [2024-11-27 03:25:27.561238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.112 [2024-11-27 03:25:27.561251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.112 [2024-11-27 03:25:27.561280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.112 qpair failed and we were unable to recover it. 00:30:25.112 [2024-11-27 03:25:27.571049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.112 [2024-11-27 03:25:27.571134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.571161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.571174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.571187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.571217] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.581102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.581194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.581220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.581234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.581247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.581276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.591094] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.591191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.591217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.591231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.591244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.591274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.601127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.601219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.601245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.601259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.601271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.601301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.611158] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.611292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.611318] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.611332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.611351] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.611382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.621185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.621273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.621299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.621313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.621325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.621367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.631236] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.631349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.631375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.631389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.631401] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.631431] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.641302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.641395] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.641420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.641434] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.641448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.641478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.651288] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.651384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.651409] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.651423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.651436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.651467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.661321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.661403] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.661431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.661445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.661458] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.661488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.671366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.671481] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.671507] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.671521] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.671546] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.671590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.681405] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.113 [2024-11-27 03:25:27.681496] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.113 [2024-11-27 03:25:27.681522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.113 [2024-11-27 03:25:27.681544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.113 [2024-11-27 03:25:27.681558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.113 [2024-11-27 03:25:27.681587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.113 qpair failed and we were unable to recover it. 00:30:25.113 [2024-11-27 03:25:27.691429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.114 [2024-11-27 03:25:27.691561] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.114 [2024-11-27 03:25:27.691587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.114 [2024-11-27 03:25:27.691601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.114 [2024-11-27 03:25:27.691614] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.114 [2024-11-27 03:25:27.691645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.114 qpair failed and we were unable to recover it. 00:30:25.114 [2024-11-27 03:25:27.701449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.114 [2024-11-27 03:25:27.701545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.114 [2024-11-27 03:25:27.701571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.114 [2024-11-27 03:25:27.701592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.114 [2024-11-27 03:25:27.701605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.114 [2024-11-27 03:25:27.701636] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.114 qpair failed and we were unable to recover it. 00:30:25.114 [2024-11-27 03:25:27.711516] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.114 [2024-11-27 03:25:27.711613] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.114 [2024-11-27 03:25:27.711639] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.114 [2024-11-27 03:25:27.711652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.114 [2024-11-27 03:25:27.711665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.114 [2024-11-27 03:25:27.711696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.114 qpair failed and we were unable to recover it. 00:30:25.114 [2024-11-27 03:25:27.721519] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.114 [2024-11-27 03:25:27.721621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.114 [2024-11-27 03:25:27.721647] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.114 [2024-11-27 03:25:27.721661] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.114 [2024-11-27 03:25:27.721674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.114 [2024-11-27 03:25:27.721704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.114 qpair failed and we were unable to recover it. 00:30:25.373 [2024-11-27 03:25:27.731560] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.373 [2024-11-27 03:25:27.731678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.373 [2024-11-27 03:25:27.731704] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.373 [2024-11-27 03:25:27.731719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.373 [2024-11-27 03:25:27.731732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.373 [2024-11-27 03:25:27.731762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.373 qpair failed and we were unable to recover it. 00:30:25.373 [2024-11-27 03:25:27.741570] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.373 [2024-11-27 03:25:27.741657] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.373 [2024-11-27 03:25:27.741683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.373 [2024-11-27 03:25:27.741697] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.373 [2024-11-27 03:25:27.741710] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.373 [2024-11-27 03:25:27.741740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.373 qpair failed and we were unable to recover it. 00:30:25.373 [2024-11-27 03:25:27.751571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.373 [2024-11-27 03:25:27.751673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.373 [2024-11-27 03:25:27.751698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.373 [2024-11-27 03:25:27.751712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.373 [2024-11-27 03:25:27.751725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.373 [2024-11-27 03:25:27.751756] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.373 qpair failed and we were unable to recover it. 00:30:25.373 [2024-11-27 03:25:27.761634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.373 [2024-11-27 03:25:27.761720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.373 [2024-11-27 03:25:27.761746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.373 [2024-11-27 03:25:27.761760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.373 [2024-11-27 03:25:27.761773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.373 [2024-11-27 03:25:27.761802] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.373 qpair failed and we were unable to recover it. 00:30:25.373 [2024-11-27 03:25:27.771632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.771720] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.771746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.771760] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.771773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.771824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.781684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.781778] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.781804] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.781818] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.781831] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.781861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.791729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.791851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.791885] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.791901] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.791914] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.791956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.801774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.801884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.801913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.801927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.801940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.801970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.811776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.811901] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.811931] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.811947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.811960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.811990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.821776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.821873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.821899] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.821913] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.821925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.821955] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.831810] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.831897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.831923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.831936] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.831949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.831984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.841912] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.842006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.842032] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.842051] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.842065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.842107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.851941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.852032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.852058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.852072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.852084] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.852114] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.861955] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.862042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.862067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.862080] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.862093] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.862123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.871964] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.872051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.872077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.872091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.872103] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.374 [2024-11-27 03:25:27.872134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.374 qpair failed and we were unable to recover it. 00:30:25.374 [2024-11-27 03:25:27.882006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.374 [2024-11-27 03:25:27.882107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.374 [2024-11-27 03:25:27.882138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.374 [2024-11-27 03:25:27.882152] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.374 [2024-11-27 03:25:27.882165] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.882194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.892003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.892094] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.892120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.892134] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.892147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.892178] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.902002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.902093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.902119] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.902133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.902146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.902177] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.912057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.912142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.912168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.912182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.912194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.912224] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.922105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.922231] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.922260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.922274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.922287] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.922323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.932111] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.932198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.932224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.932238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.932251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.932293] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.942140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.942237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.942263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.942277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.942290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.942320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.952170] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.952256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.952282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.952296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.952308] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.952339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.962190] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.962289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.962316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.962330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.962342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.962372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.972221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.972303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.972334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.972349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.972362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.972405] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.375 [2024-11-27 03:25:27.982238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.375 [2024-11-27 03:25:27.982330] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.375 [2024-11-27 03:25:27.982356] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.375 [2024-11-27 03:25:27.982370] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.375 [2024-11-27 03:25:27.982382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.375 [2024-11-27 03:25:27.982413] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.375 qpair failed and we were unable to recover it. 00:30:25.634 [2024-11-27 03:25:27.992290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:27.992379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:27.992404] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:27.992418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:27.992431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:27.992461] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.002358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.002447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.002473] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.002488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.002501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.002549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.012377] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.012469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.012495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.012508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.012537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.012571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.022413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.022511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.022544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.022559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.022572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.022602] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.032437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.032579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.032609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.032625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.032638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.032669] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.042424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.042517] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.042550] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.042565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.042578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.042608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.052490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.052590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.052615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.052629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.052642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.052673] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.062473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.062611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.062638] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.062652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.062665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.062707] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.072504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.072599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.072626] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.072640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.072652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.072683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.082571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.082663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.082689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.082702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.082715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.082746] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.092577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.092672] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.092698] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.092712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.635 [2024-11-27 03:25:28.092725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.635 [2024-11-27 03:25:28.092755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.635 qpair failed and we were unable to recover it. 00:30:25.635 [2024-11-27 03:25:28.102602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.635 [2024-11-27 03:25:28.102698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.635 [2024-11-27 03:25:28.102725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.635 [2024-11-27 03:25:28.102739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.102757] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.102788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.112627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.112718] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.112744] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.112758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.112770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.112800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.122681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.122782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.122809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.122823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.122835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.122865] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.132710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.132799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.132824] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.132838] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.132851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.132880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.142797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.142890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.142916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.142930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.142943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.142972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.152730] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.152866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.152892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.152905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.152919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.152949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.162775] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.162889] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.162914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.162929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.162941] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.162972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.172781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.172914] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.172940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.172954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.172968] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.172997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.182838] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.182923] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.182948] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.182963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.182976] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.183006] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.192822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.192909] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.192934] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.192955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.192969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.192998] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.202881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.202972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.202997] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.203010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.203023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.203065] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.212911] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.213034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.213060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.636 [2024-11-27 03:25:28.213073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.636 [2024-11-27 03:25:28.213087] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.636 [2024-11-27 03:25:28.213117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.636 qpair failed and we were unable to recover it. 00:30:25.636 [2024-11-27 03:25:28.222935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.636 [2024-11-27 03:25:28.223025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.636 [2024-11-27 03:25:28.223051] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.637 [2024-11-27 03:25:28.223066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.637 [2024-11-27 03:25:28.223079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.637 [2024-11-27 03:25:28.223107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.637 qpair failed and we were unable to recover it. 00:30:25.637 [2024-11-27 03:25:28.232940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.637 [2024-11-27 03:25:28.233034] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.637 [2024-11-27 03:25:28.233060] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.637 [2024-11-27 03:25:28.233074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.637 [2024-11-27 03:25:28.233086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.637 [2024-11-27 03:25:28.233117] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.637 qpair failed and we were unable to recover it. 00:30:25.637 [2024-11-27 03:25:28.243049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.637 [2024-11-27 03:25:28.243145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.637 [2024-11-27 03:25:28.243170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.637 [2024-11-27 03:25:28.243184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.637 [2024-11-27 03:25:28.243198] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.637 [2024-11-27 03:25:28.243227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.637 qpair failed and we were unable to recover it. 00:30:25.897 [2024-11-27 03:25:28.253072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.253200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.253229] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.253244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.253257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.253287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.263050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.263183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.263209] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.263223] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.263236] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.263267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.273130] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.273228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.273253] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.273266] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.273279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.273310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.283134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.283247] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.283276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.283297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.283311] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.283341] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.293169] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.293264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.293289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.293303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.293316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.293346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.303164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.303248] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.303273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.303286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.303299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.303329] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.313182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.313272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.313298] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.313311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.313323] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.313354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.323198] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.323328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.323354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.323367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.323380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.323410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.333290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.333383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.333408] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.333423] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.333436] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.333465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.343272] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.343366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.343391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.343405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.343418] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.343448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.353304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.353392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.353417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.353431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.898 [2024-11-27 03:25:28.353444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.898 [2024-11-27 03:25:28.353474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.898 qpair failed and we were unable to recover it. 00:30:25.898 [2024-11-27 03:25:28.363341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.898 [2024-11-27 03:25:28.363435] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.898 [2024-11-27 03:25:28.363460] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.898 [2024-11-27 03:25:28.363474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.363487] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.363517] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.373392] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.373487] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.373518] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.373543] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.373556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.373585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.383352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.383438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.383464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.383477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.383490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.383519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.393411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.393503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.393535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.393551] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.393564] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.393594] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.403417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.403539] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.403564] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.403578] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.403591] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.403621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.413471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.413577] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.413602] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.413616] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.413629] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.413665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.423530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.423623] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.423648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.423662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.423674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.423704] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.433579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.433669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.433695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.433709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.433722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.433752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.443565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.443695] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.443721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.443735] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.443748] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.443777] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.453569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.453658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.453685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.453699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.453711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.453740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.463647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.463738] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.463768] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.463782] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.463794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.463822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.473653] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.473774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.899 [2024-11-27 03:25:28.473800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.899 [2024-11-27 03:25:28.473813] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.899 [2024-11-27 03:25:28.473827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.899 [2024-11-27 03:25:28.473856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.899 qpair failed and we were unable to recover it. 00:30:25.899 [2024-11-27 03:25:28.483667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.899 [2024-11-27 03:25:28.483763] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.900 [2024-11-27 03:25:28.483789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.900 [2024-11-27 03:25:28.483803] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.900 [2024-11-27 03:25:28.483816] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.900 [2024-11-27 03:25:28.483857] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.900 qpair failed and we were unable to recover it. 00:30:25.900 [2024-11-27 03:25:28.493692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.900 [2024-11-27 03:25:28.493784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.900 [2024-11-27 03:25:28.493810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.900 [2024-11-27 03:25:28.493824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.900 [2024-11-27 03:25:28.493837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.900 [2024-11-27 03:25:28.493867] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.900 qpair failed and we were unable to recover it. 00:30:25.900 [2024-11-27 03:25:28.503729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.900 [2024-11-27 03:25:28.503813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.900 [2024-11-27 03:25:28.503839] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.900 [2024-11-27 03:25:28.503853] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.900 [2024-11-27 03:25:28.503871] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.900 [2024-11-27 03:25:28.503902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.900 qpair failed and we were unable to recover it. 00:30:25.900 [2024-11-27 03:25:28.513737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:25.900 [2024-11-27 03:25:28.513871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:25.900 [2024-11-27 03:25:28.513897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:25.900 [2024-11-27 03:25:28.513910] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:25.900 [2024-11-27 03:25:28.513923] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:25.900 [2024-11-27 03:25:28.513952] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:25.900 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.523817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.523907] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.523933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.523947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.523960] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:26.160 [2024-11-27 03:25:28.523990] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.533804] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.533897] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.533923] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.533937] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.533949] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:26.160 [2024-11-27 03:25:28.533980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.543833] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.543928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.543957] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.543971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.543984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:26.160 [2024-11-27 03:25:28.544013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.553889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.553989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.554015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.554028] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.554041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:26.160 [2024-11-27 03:25:28.554071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.563991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.564087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.564113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.564126] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.564139] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:26.160 [2024-11-27 03:25:28.564170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.573976] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.574086] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.574111] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.574125] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.574138] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa4000b90 00:30:26.160 [2024-11-27 03:25:28.574168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.583972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.584081] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.584114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.584129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.584142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:26.160 [2024-11-27 03:25:28.584173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.594024] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.594144] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.594173] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.594187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.594206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fdaa0000b90 00:30:26.160 [2024-11-27 03:25:28.594237] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.604080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.604178] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.604211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.604226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.604239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1c24f20 00:30:26.160 [2024-11-27 03:25:28.604270] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.614096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:26.160 [2024-11-27 03:25:28.614184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:26.160 [2024-11-27 03:25:28.614212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:26.160 [2024-11-27 03:25:28.614226] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:26.160 [2024-11-27 03:25:28.614239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1c24f20 00:30:26.160 [2024-11-27 03:25:28.614267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:26.160 qpair failed and we were unable to recover it. 00:30:26.160 [2024-11-27 03:25:28.614375] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:26.160 A controller has encountered a failure and is being reset. 00:30:26.160 Controller properly reset. 00:30:26.160 Initializing NVMe Controllers 00:30:26.160 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:26.160 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:26.160 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:26.161 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:26.161 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:26.161 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:26.161 Initialization complete. Launching workers. 00:30:26.161 Starting thread on core 1 00:30:26.161 Starting thread on core 2 00:30:26.161 Starting thread on core 3 00:30:26.161 Starting thread on core 0 00:30:26.161 03:25:28 -- host/target_disconnect.sh@59 -- # sync 00:30:26.161 00:30:26.161 real 0m11.440s 00:30:26.161 user 0m21.946s 00:30:26.161 sys 0m5.174s 00:30:26.161 03:25:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:26.161 03:25:28 -- common/autotest_common.sh@10 -- # set +x 00:30:26.161 ************************************ 00:30:26.161 END TEST nvmf_target_disconnect_tc2 00:30:26.161 ************************************ 00:30:26.161 03:25:28 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:26.161 03:25:28 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:26.161 03:25:28 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:26.161 03:25:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:26.161 03:25:28 -- nvmf/common.sh@116 -- # sync 00:30:26.161 03:25:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:26.161 03:25:28 -- nvmf/common.sh@119 -- # set +e 00:30:26.161 03:25:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:26.161 03:25:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:26.161 rmmod nvme_tcp 00:30:26.161 rmmod nvme_fabrics 00:30:26.161 rmmod nvme_keyring 00:30:26.161 03:25:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:26.161 03:25:28 -- nvmf/common.sh@123 -- # set -e 00:30:26.161 03:25:28 -- nvmf/common.sh@124 -- # return 0 00:30:26.161 03:25:28 -- nvmf/common.sh@477 -- # '[' -n 2587859 ']' 00:30:26.161 03:25:28 -- nvmf/common.sh@478 -- # killprocess 2587859 00:30:26.161 03:25:28 -- common/autotest_common.sh@936 -- # '[' -z 2587859 ']' 00:30:26.161 03:25:28 -- common/autotest_common.sh@940 -- # kill -0 2587859 00:30:26.161 03:25:28 -- common/autotest_common.sh@941 -- # uname 00:30:26.161 03:25:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:26.161 03:25:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2587859 00:30:26.421 03:25:28 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:26.421 03:25:28 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:26.421 03:25:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2587859' 00:30:26.421 killing process with pid 2587859 00:30:26.421 03:25:28 -- common/autotest_common.sh@955 -- # kill 2587859 00:30:26.421 03:25:28 -- common/autotest_common.sh@960 -- # wait 2587859 00:30:26.680 03:25:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:26.680 03:25:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:26.680 03:25:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:26.680 03:25:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:26.680 03:25:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:26.680 03:25:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:26.680 03:25:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:26.680 03:25:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:28.587 03:25:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:28.587 00:30:28.587 real 0m16.244s 00:30:28.587 user 0m48.160s 00:30:28.587 sys 0m7.164s 00:30:28.587 03:25:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:28.587 03:25:31 -- common/autotest_common.sh@10 -- # set +x 00:30:28.587 ************************************ 00:30:28.587 END TEST nvmf_target_disconnect 00:30:28.587 ************************************ 00:30:28.587 03:25:31 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:28.587 03:25:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:28.587 03:25:31 -- common/autotest_common.sh@10 -- # set +x 00:30:28.587 03:25:31 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:28.587 00:30:28.587 real 22m57.968s 00:30:28.587 user 66m48.613s 00:30:28.587 sys 5m25.597s 00:30:28.587 03:25:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:28.587 03:25:31 -- common/autotest_common.sh@10 -- # set +x 00:30:28.587 ************************************ 00:30:28.587 END TEST nvmf_tcp 00:30:28.587 ************************************ 00:30:28.587 03:25:31 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:28.587 03:25:31 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:28.587 03:25:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:28.587 03:25:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:28.587 03:25:31 -- common/autotest_common.sh@10 -- # set +x 00:30:28.587 ************************************ 00:30:28.587 START TEST spdkcli_nvmf_tcp 00:30:28.587 ************************************ 00:30:28.587 03:25:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:28.847 * Looking for test storage... 00:30:28.847 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:28.847 03:25:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:28.847 03:25:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:28.847 03:25:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:28.847 03:25:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:28.847 03:25:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:28.847 03:25:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:28.847 03:25:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:28.847 03:25:31 -- scripts/common.sh@335 -- # IFS=.-: 00:30:28.847 03:25:31 -- scripts/common.sh@335 -- # read -ra ver1 00:30:28.847 03:25:31 -- scripts/common.sh@336 -- # IFS=.-: 00:30:28.847 03:25:31 -- scripts/common.sh@336 -- # read -ra ver2 00:30:28.847 03:25:31 -- scripts/common.sh@337 -- # local 'op=<' 00:30:28.847 03:25:31 -- scripts/common.sh@339 -- # ver1_l=2 00:30:28.847 03:25:31 -- scripts/common.sh@340 -- # ver2_l=1 00:30:28.847 03:25:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:28.847 03:25:31 -- scripts/common.sh@343 -- # case "$op" in 00:30:28.847 03:25:31 -- scripts/common.sh@344 -- # : 1 00:30:28.847 03:25:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:28.847 03:25:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:28.847 03:25:31 -- scripts/common.sh@364 -- # decimal 1 00:30:28.847 03:25:31 -- scripts/common.sh@352 -- # local d=1 00:30:28.847 03:25:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:28.847 03:25:31 -- scripts/common.sh@354 -- # echo 1 00:30:28.847 03:25:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:28.847 03:25:31 -- scripts/common.sh@365 -- # decimal 2 00:30:28.847 03:25:31 -- scripts/common.sh@352 -- # local d=2 00:30:28.847 03:25:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:28.847 03:25:31 -- scripts/common.sh@354 -- # echo 2 00:30:28.847 03:25:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:28.847 03:25:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:28.847 03:25:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:28.847 03:25:31 -- scripts/common.sh@367 -- # return 0 00:30:28.847 03:25:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:28.847 03:25:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:28.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.847 --rc genhtml_branch_coverage=1 00:30:28.847 --rc genhtml_function_coverage=1 00:30:28.847 --rc genhtml_legend=1 00:30:28.847 --rc geninfo_all_blocks=1 00:30:28.847 --rc geninfo_unexecuted_blocks=1 00:30:28.847 00:30:28.847 ' 00:30:28.847 03:25:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:28.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.847 --rc genhtml_branch_coverage=1 00:30:28.847 --rc genhtml_function_coverage=1 00:30:28.847 --rc genhtml_legend=1 00:30:28.847 --rc geninfo_all_blocks=1 00:30:28.847 --rc geninfo_unexecuted_blocks=1 00:30:28.847 00:30:28.847 ' 00:30:28.847 03:25:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:28.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.847 --rc genhtml_branch_coverage=1 00:30:28.847 --rc genhtml_function_coverage=1 00:30:28.847 --rc genhtml_legend=1 00:30:28.847 --rc geninfo_all_blocks=1 00:30:28.847 --rc geninfo_unexecuted_blocks=1 00:30:28.847 00:30:28.847 ' 00:30:28.847 03:25:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:28.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.847 --rc genhtml_branch_coverage=1 00:30:28.847 --rc genhtml_function_coverage=1 00:30:28.847 --rc genhtml_legend=1 00:30:28.847 --rc geninfo_all_blocks=1 00:30:28.847 --rc geninfo_unexecuted_blocks=1 00:30:28.847 00:30:28.847 ' 00:30:28.847 03:25:31 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:28.847 03:25:31 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:28.847 03:25:31 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:28.847 03:25:31 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:28.847 03:25:31 -- nvmf/common.sh@7 -- # uname -s 00:30:28.847 03:25:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:28.847 03:25:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:28.847 03:25:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:28.847 03:25:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:28.848 03:25:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:28.848 03:25:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:28.848 03:25:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:28.848 03:25:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:28.848 03:25:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:28.848 03:25:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:28.848 03:25:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:28.848 03:25:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:28.848 03:25:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:28.848 03:25:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:28.848 03:25:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:28.848 03:25:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:28.848 03:25:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:28.848 03:25:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:28.848 03:25:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:28.848 03:25:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.848 03:25:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.848 03:25:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.848 03:25:31 -- paths/export.sh@5 -- # export PATH 00:30:28.848 03:25:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.848 03:25:31 -- nvmf/common.sh@46 -- # : 0 00:30:28.848 03:25:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:28.848 03:25:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:28.848 03:25:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:28.848 03:25:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:28.848 03:25:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:28.848 03:25:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:28.848 03:25:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:28.848 03:25:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:28.848 03:25:31 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:28.848 03:25:31 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:28.848 03:25:31 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:28.848 03:25:31 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:28.848 03:25:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:28.848 03:25:31 -- common/autotest_common.sh@10 -- # set +x 00:30:28.848 03:25:31 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:28.848 03:25:31 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2589093 00:30:28.848 03:25:31 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:28.848 03:25:31 -- spdkcli/common.sh@34 -- # waitforlisten 2589093 00:30:28.848 03:25:31 -- common/autotest_common.sh@829 -- # '[' -z 2589093 ']' 00:30:28.848 03:25:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:28.848 03:25:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:28.848 03:25:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:28.848 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:28.848 03:25:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:28.848 03:25:31 -- common/autotest_common.sh@10 -- # set +x 00:30:28.848 [2024-11-27 03:25:31.354417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:28.848 [2024-11-27 03:25:31.354491] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2589093 ] 00:30:28.848 EAL: No free 2048 kB hugepages reported on node 1 00:30:28.848 [2024-11-27 03:25:31.417657] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:29.106 [2024-11-27 03:25:31.503145] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:29.106 [2024-11-27 03:25:31.503369] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:29.106 [2024-11-27 03:25:31.503374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:30.044 03:25:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:30.044 03:25:32 -- common/autotest_common.sh@862 -- # return 0 00:30:30.044 03:25:32 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:30.044 03:25:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:30.044 03:25:32 -- common/autotest_common.sh@10 -- # set +x 00:30:30.044 03:25:32 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:30.044 03:25:32 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:30.044 03:25:32 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:30.044 03:25:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:30.044 03:25:32 -- common/autotest_common.sh@10 -- # set +x 00:30:30.044 03:25:32 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:30.044 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:30.044 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:30.044 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:30.044 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:30.044 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:30.044 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:30.044 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:30.044 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:30.044 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:30.044 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:30.044 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:30.044 ' 00:30:30.304 [2024-11-27 03:25:32.733654] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:32.835 [2024-11-27 03:25:34.921550] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:33.771 [2024-11-27 03:25:36.174109] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:36.308 [2024-11-27 03:25:38.493514] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:38.215 [2024-11-27 03:25:40.492292] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:39.591 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:39.591 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:39.591 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:39.591 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:39.591 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:39.591 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:39.591 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:39.591 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:39.591 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:39.591 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:39.591 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:39.591 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:39.591 03:25:42 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:39.591 03:25:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:39.591 03:25:42 -- common/autotest_common.sh@10 -- # set +x 00:30:39.591 03:25:42 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:39.591 03:25:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:39.591 03:25:42 -- common/autotest_common.sh@10 -- # set +x 00:30:39.591 03:25:42 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:39.591 03:25:42 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:40.157 03:25:42 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:40.157 03:25:42 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:40.157 03:25:42 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:40.157 03:25:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:40.157 03:25:42 -- common/autotest_common.sh@10 -- # set +x 00:30:40.157 03:25:42 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:40.157 03:25:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:40.157 03:25:42 -- common/autotest_common.sh@10 -- # set +x 00:30:40.157 03:25:42 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:40.157 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:40.157 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:40.157 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:40.157 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:40.157 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:40.157 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:40.157 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:40.157 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:40.157 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:40.157 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:40.157 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:40.157 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:40.157 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:40.157 ' 00:30:45.428 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:45.428 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:45.428 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:45.428 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:45.428 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:45.428 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:45.428 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:45.428 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:45.428 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:45.428 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:45.428 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:45.428 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:45.428 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:45.428 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:45.428 03:25:47 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:45.428 03:25:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:45.428 03:25:47 -- common/autotest_common.sh@10 -- # set +x 00:30:45.428 03:25:47 -- spdkcli/nvmf.sh@90 -- # killprocess 2589093 00:30:45.428 03:25:47 -- common/autotest_common.sh@936 -- # '[' -z 2589093 ']' 00:30:45.428 03:25:47 -- common/autotest_common.sh@940 -- # kill -0 2589093 00:30:45.428 03:25:47 -- common/autotest_common.sh@941 -- # uname 00:30:45.428 03:25:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:45.428 03:25:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2589093 00:30:45.428 03:25:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:45.428 03:25:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:45.428 03:25:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2589093' 00:30:45.428 killing process with pid 2589093 00:30:45.428 03:25:47 -- common/autotest_common.sh@955 -- # kill 2589093 00:30:45.428 [2024-11-27 03:25:47.967924] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:45.428 03:25:47 -- common/autotest_common.sh@960 -- # wait 2589093 00:30:45.686 03:25:48 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:45.686 03:25:48 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:45.686 03:25:48 -- spdkcli/common.sh@13 -- # '[' -n 2589093 ']' 00:30:45.686 03:25:48 -- spdkcli/common.sh@14 -- # killprocess 2589093 00:30:45.686 03:25:48 -- common/autotest_common.sh@936 -- # '[' -z 2589093 ']' 00:30:45.686 03:25:48 -- common/autotest_common.sh@940 -- # kill -0 2589093 00:30:45.686 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2589093) - No such process 00:30:45.686 03:25:48 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2589093 is not found' 00:30:45.686 Process with pid 2589093 is not found 00:30:45.686 03:25:48 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:45.686 03:25:48 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:45.686 03:25:48 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:45.686 00:30:45.686 real 0m17.034s 00:30:45.686 user 0m36.398s 00:30:45.686 sys 0m0.798s 00:30:45.686 03:25:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:45.686 03:25:48 -- common/autotest_common.sh@10 -- # set +x 00:30:45.686 ************************************ 00:30:45.686 END TEST spdkcli_nvmf_tcp 00:30:45.686 ************************************ 00:30:45.686 03:25:48 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:45.686 03:25:48 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:45.686 03:25:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:45.686 03:25:48 -- common/autotest_common.sh@10 -- # set +x 00:30:45.686 ************************************ 00:30:45.686 START TEST nvmf_identify_passthru 00:30:45.686 ************************************ 00:30:45.686 03:25:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:45.686 * Looking for test storage... 00:30:45.686 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:45.686 03:25:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:45.686 03:25:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:45.686 03:25:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:45.945 03:25:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:45.945 03:25:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:45.945 03:25:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:45.945 03:25:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:45.945 03:25:48 -- scripts/common.sh@335 -- # IFS=.-: 00:30:45.945 03:25:48 -- scripts/common.sh@335 -- # read -ra ver1 00:30:45.945 03:25:48 -- scripts/common.sh@336 -- # IFS=.-: 00:30:45.945 03:25:48 -- scripts/common.sh@336 -- # read -ra ver2 00:30:45.945 03:25:48 -- scripts/common.sh@337 -- # local 'op=<' 00:30:45.945 03:25:48 -- scripts/common.sh@339 -- # ver1_l=2 00:30:45.945 03:25:48 -- scripts/common.sh@340 -- # ver2_l=1 00:30:45.945 03:25:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:45.945 03:25:48 -- scripts/common.sh@343 -- # case "$op" in 00:30:45.945 03:25:48 -- scripts/common.sh@344 -- # : 1 00:30:45.945 03:25:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:45.945 03:25:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:45.945 03:25:48 -- scripts/common.sh@364 -- # decimal 1 00:30:45.945 03:25:48 -- scripts/common.sh@352 -- # local d=1 00:30:45.945 03:25:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:45.945 03:25:48 -- scripts/common.sh@354 -- # echo 1 00:30:45.945 03:25:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:45.945 03:25:48 -- scripts/common.sh@365 -- # decimal 2 00:30:45.945 03:25:48 -- scripts/common.sh@352 -- # local d=2 00:30:45.945 03:25:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:45.945 03:25:48 -- scripts/common.sh@354 -- # echo 2 00:30:45.946 03:25:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:45.946 03:25:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:45.946 03:25:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:45.946 03:25:48 -- scripts/common.sh@367 -- # return 0 00:30:45.946 03:25:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:45.946 03:25:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:45.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.946 --rc genhtml_branch_coverage=1 00:30:45.946 --rc genhtml_function_coverage=1 00:30:45.946 --rc genhtml_legend=1 00:30:45.946 --rc geninfo_all_blocks=1 00:30:45.946 --rc geninfo_unexecuted_blocks=1 00:30:45.946 00:30:45.946 ' 00:30:45.946 03:25:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:45.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.946 --rc genhtml_branch_coverage=1 00:30:45.946 --rc genhtml_function_coverage=1 00:30:45.946 --rc genhtml_legend=1 00:30:45.946 --rc geninfo_all_blocks=1 00:30:45.946 --rc geninfo_unexecuted_blocks=1 00:30:45.946 00:30:45.946 ' 00:30:45.946 03:25:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:45.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.946 --rc genhtml_branch_coverage=1 00:30:45.946 --rc genhtml_function_coverage=1 00:30:45.946 --rc genhtml_legend=1 00:30:45.946 --rc geninfo_all_blocks=1 00:30:45.946 --rc geninfo_unexecuted_blocks=1 00:30:45.946 00:30:45.946 ' 00:30:45.946 03:25:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:45.946 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.946 --rc genhtml_branch_coverage=1 00:30:45.946 --rc genhtml_function_coverage=1 00:30:45.946 --rc genhtml_legend=1 00:30:45.946 --rc geninfo_all_blocks=1 00:30:45.946 --rc geninfo_unexecuted_blocks=1 00:30:45.946 00:30:45.946 ' 00:30:45.946 03:25:48 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:45.946 03:25:48 -- nvmf/common.sh@7 -- # uname -s 00:30:45.946 03:25:48 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:45.946 03:25:48 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:45.946 03:25:48 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:45.946 03:25:48 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:45.946 03:25:48 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:45.946 03:25:48 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:45.946 03:25:48 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:45.946 03:25:48 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:45.946 03:25:48 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:45.946 03:25:48 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:45.946 03:25:48 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:45.946 03:25:48 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:45.946 03:25:48 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:45.946 03:25:48 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:45.946 03:25:48 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:45.946 03:25:48 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:45.946 03:25:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:45.946 03:25:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:45.946 03:25:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:45.946 03:25:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.946 03:25:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.946 03:25:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.946 03:25:48 -- paths/export.sh@5 -- # export PATH 00:30:45.946 03:25:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.946 03:25:48 -- nvmf/common.sh@46 -- # : 0 00:30:45.946 03:25:48 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:45.946 03:25:48 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:45.946 03:25:48 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:45.946 03:25:48 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:45.946 03:25:48 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:45.946 03:25:48 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:45.946 03:25:48 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:45.946 03:25:48 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:45.946 03:25:48 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:45.946 03:25:48 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:45.946 03:25:48 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:45.946 03:25:48 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:45.946 03:25:48 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.946 03:25:48 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.946 03:25:48 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.946 03:25:48 -- paths/export.sh@5 -- # export PATH 00:30:45.946 03:25:48 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.946 03:25:48 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:45.946 03:25:48 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:45.946 03:25:48 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:45.946 03:25:48 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:45.946 03:25:48 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:45.946 03:25:48 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:45.946 03:25:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:45.946 03:25:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:45.946 03:25:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:45.946 03:25:48 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:45.946 03:25:48 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:45.946 03:25:48 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:45.946 03:25:48 -- common/autotest_common.sh@10 -- # set +x 00:30:47.849 03:25:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:47.849 03:25:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:47.849 03:25:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:47.849 03:25:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:47.849 03:25:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:47.849 03:25:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:47.849 03:25:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:47.849 03:25:50 -- nvmf/common.sh@294 -- # net_devs=() 00:30:47.849 03:25:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:47.849 03:25:50 -- nvmf/common.sh@295 -- # e810=() 00:30:47.849 03:25:50 -- nvmf/common.sh@295 -- # local -ga e810 00:30:47.849 03:25:50 -- nvmf/common.sh@296 -- # x722=() 00:30:47.849 03:25:50 -- nvmf/common.sh@296 -- # local -ga x722 00:30:47.849 03:25:50 -- nvmf/common.sh@297 -- # mlx=() 00:30:47.849 03:25:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:47.850 03:25:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:47.850 03:25:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:47.850 03:25:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:47.850 03:25:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:47.850 03:25:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:47.850 03:25:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:47.850 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:47.850 03:25:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:47.850 03:25:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:47.850 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:47.850 03:25:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:47.850 03:25:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:47.850 03:25:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:47.850 03:25:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:47.850 03:25:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:47.850 03:25:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:47.850 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:47.850 03:25:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:47.850 03:25:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:47.850 03:25:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:47.850 03:25:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:47.850 03:25:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:47.850 03:25:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:47.850 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:47.850 03:25:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:47.850 03:25:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:47.850 03:25:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:47.850 03:25:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:47.850 03:25:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:47.850 03:25:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:47.850 03:25:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:47.850 03:25:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:47.850 03:25:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:47.850 03:25:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:47.850 03:25:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:47.850 03:25:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:47.850 03:25:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:47.850 03:25:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:47.850 03:25:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:47.850 03:25:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:47.850 03:25:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:47.850 03:25:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:47.850 03:25:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:47.850 03:25:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:47.850 03:25:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:47.850 03:25:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:47.850 03:25:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:47.850 03:25:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:47.850 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:47.850 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.315 ms 00:30:47.850 00:30:47.850 --- 10.0.0.2 ping statistics --- 00:30:47.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:47.850 rtt min/avg/max/mdev = 0.315/0.315/0.315/0.000 ms 00:30:47.850 03:25:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:47.850 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:47.850 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:30:47.850 00:30:47.850 --- 10.0.0.1 ping statistics --- 00:30:47.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:47.850 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:30:47.850 03:25:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:47.850 03:25:50 -- nvmf/common.sh@410 -- # return 0 00:30:47.850 03:25:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:47.850 03:25:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:47.850 03:25:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:47.850 03:25:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:47.850 03:25:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:47.850 03:25:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:47.850 03:25:50 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:30:47.850 03:25:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:47.850 03:25:50 -- common/autotest_common.sh@10 -- # set +x 00:30:47.850 03:25:50 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:30:47.850 03:25:50 -- common/autotest_common.sh@1519 -- # bdfs=() 00:30:47.850 03:25:50 -- common/autotest_common.sh@1519 -- # local bdfs 00:30:47.850 03:25:50 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:30:48.109 03:25:50 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:30:48.109 03:25:50 -- common/autotest_common.sh@1508 -- # bdfs=() 00:30:48.109 03:25:50 -- common/autotest_common.sh@1508 -- # local bdfs 00:30:48.109 03:25:50 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:48.109 03:25:50 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:48.109 03:25:50 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:30:48.109 03:25:50 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:30:48.109 03:25:50 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:30:48.109 03:25:50 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:30:48.109 03:25:50 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:30:48.109 03:25:50 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:30:48.109 03:25:50 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:48.109 03:25:50 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:30:48.109 03:25:50 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:30:48.109 EAL: No free 2048 kB hugepages reported on node 1 00:30:52.302 03:25:54 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:30:52.302 03:25:54 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:30:52.302 03:25:54 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:30:52.302 03:25:54 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:30:52.302 EAL: No free 2048 kB hugepages reported on node 1 00:30:56.499 03:25:58 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:30:56.499 03:25:58 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:30:56.499 03:25:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:56.499 03:25:58 -- common/autotest_common.sh@10 -- # set +x 00:30:56.499 03:25:58 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:30:56.499 03:25:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:56.499 03:25:58 -- common/autotest_common.sh@10 -- # set +x 00:30:56.499 03:25:58 -- target/identify_passthru.sh@31 -- # nvmfpid=2593897 00:30:56.499 03:25:58 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:30:56.499 03:25:58 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:56.499 03:25:58 -- target/identify_passthru.sh@35 -- # waitforlisten 2593897 00:30:56.499 03:25:58 -- common/autotest_common.sh@829 -- # '[' -z 2593897 ']' 00:30:56.499 03:25:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:56.499 03:25:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:56.499 03:25:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:56.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:56.499 03:25:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:56.499 03:25:58 -- common/autotest_common.sh@10 -- # set +x 00:30:56.499 [2024-11-27 03:25:59.000478] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:56.499 [2024-11-27 03:25:59.000585] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:56.499 EAL: No free 2048 kB hugepages reported on node 1 00:30:56.499 [2024-11-27 03:25:59.068317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:56.757 [2024-11-27 03:25:59.159058] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:56.757 [2024-11-27 03:25:59.159222] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:56.757 [2024-11-27 03:25:59.159239] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:56.757 [2024-11-27 03:25:59.159251] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:56.757 [2024-11-27 03:25:59.159302] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:56.757 [2024-11-27 03:25:59.159363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:56.757 [2024-11-27 03:25:59.159428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:56.757 [2024-11-27 03:25:59.159430] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:56.757 03:25:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:56.757 03:25:59 -- common/autotest_common.sh@862 -- # return 0 00:30:56.757 03:25:59 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:30:56.757 03:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:56.757 03:25:59 -- common/autotest_common.sh@10 -- # set +x 00:30:56.757 INFO: Log level set to 20 00:30:56.757 INFO: Requests: 00:30:56.757 { 00:30:56.757 "jsonrpc": "2.0", 00:30:56.757 "method": "nvmf_set_config", 00:30:56.757 "id": 1, 00:30:56.757 "params": { 00:30:56.757 "admin_cmd_passthru": { 00:30:56.757 "identify_ctrlr": true 00:30:56.757 } 00:30:56.757 } 00:30:56.757 } 00:30:56.757 00:30:56.757 INFO: response: 00:30:56.757 { 00:30:56.757 "jsonrpc": "2.0", 00:30:56.757 "id": 1, 00:30:56.757 "result": true 00:30:56.757 } 00:30:56.757 00:30:56.757 03:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:56.757 03:25:59 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:30:56.757 03:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:56.757 03:25:59 -- common/autotest_common.sh@10 -- # set +x 00:30:56.757 INFO: Setting log level to 20 00:30:56.757 INFO: Setting log level to 20 00:30:56.757 INFO: Log level set to 20 00:30:56.757 INFO: Log level set to 20 00:30:56.757 INFO: Requests: 00:30:56.757 { 00:30:56.757 "jsonrpc": "2.0", 00:30:56.757 "method": "framework_start_init", 00:30:56.757 "id": 1 00:30:56.757 } 00:30:56.757 00:30:56.757 INFO: Requests: 00:30:56.757 { 00:30:56.757 "jsonrpc": "2.0", 00:30:56.757 "method": "framework_start_init", 00:30:56.757 "id": 1 00:30:56.757 } 00:30:56.757 00:30:56.757 [2024-11-27 03:25:59.349904] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:30:56.757 INFO: response: 00:30:56.757 { 00:30:56.757 "jsonrpc": "2.0", 00:30:56.757 "id": 1, 00:30:56.757 "result": true 00:30:56.757 } 00:30:56.757 00:30:56.757 INFO: response: 00:30:56.757 { 00:30:56.757 "jsonrpc": "2.0", 00:30:56.757 "id": 1, 00:30:56.757 "result": true 00:30:56.757 } 00:30:56.757 00:30:56.757 03:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:56.757 03:25:59 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:56.757 03:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:56.757 03:25:59 -- common/autotest_common.sh@10 -- # set +x 00:30:56.757 INFO: Setting log level to 40 00:30:56.757 INFO: Setting log level to 40 00:30:56.757 INFO: Setting log level to 40 00:30:56.757 [2024-11-27 03:25:59.360001] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:56.757 03:25:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:56.757 03:25:59 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:30:56.757 03:25:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:56.757 03:25:59 -- common/autotest_common.sh@10 -- # set +x 00:30:57.015 03:25:59 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:30:57.015 03:25:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:57.015 03:25:59 -- common/autotest_common.sh@10 -- # set +x 00:31:00.299 Nvme0n1 00:31:00.299 03:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.299 03:26:02 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:00.299 03:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.299 03:26:02 -- common/autotest_common.sh@10 -- # set +x 00:31:00.299 03:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.299 03:26:02 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:00.299 03:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.299 03:26:02 -- common/autotest_common.sh@10 -- # set +x 00:31:00.299 03:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.299 03:26:02 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:00.299 03:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.299 03:26:02 -- common/autotest_common.sh@10 -- # set +x 00:31:00.299 [2024-11-27 03:26:02.255095] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:00.299 03:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.299 03:26:02 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:00.299 03:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.299 03:26:02 -- common/autotest_common.sh@10 -- # set +x 00:31:00.299 [2024-11-27 03:26:02.262824] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:00.299 [ 00:31:00.299 { 00:31:00.299 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:00.299 "subtype": "Discovery", 00:31:00.299 "listen_addresses": [], 00:31:00.299 "allow_any_host": true, 00:31:00.299 "hosts": [] 00:31:00.299 }, 00:31:00.299 { 00:31:00.299 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:00.299 "subtype": "NVMe", 00:31:00.299 "listen_addresses": [ 00:31:00.299 { 00:31:00.299 "transport": "TCP", 00:31:00.299 "trtype": "TCP", 00:31:00.299 "adrfam": "IPv4", 00:31:00.299 "traddr": "10.0.0.2", 00:31:00.299 "trsvcid": "4420" 00:31:00.299 } 00:31:00.299 ], 00:31:00.299 "allow_any_host": true, 00:31:00.299 "hosts": [], 00:31:00.299 "serial_number": "SPDK00000000000001", 00:31:00.299 "model_number": "SPDK bdev Controller", 00:31:00.299 "max_namespaces": 1, 00:31:00.299 "min_cntlid": 1, 00:31:00.299 "max_cntlid": 65519, 00:31:00.299 "namespaces": [ 00:31:00.299 { 00:31:00.299 "nsid": 1, 00:31:00.299 "bdev_name": "Nvme0n1", 00:31:00.299 "name": "Nvme0n1", 00:31:00.299 "nguid": "947B3A7133C34E879B95A97C5B0C5D55", 00:31:00.299 "uuid": "947b3a71-33c3-4e87-9b95-a97c5b0c5d55" 00:31:00.299 } 00:31:00.299 ] 00:31:00.299 } 00:31:00.299 ] 00:31:00.299 03:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.299 03:26:02 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:00.300 03:26:02 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:00.300 03:26:02 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:00.300 EAL: No free 2048 kB hugepages reported on node 1 00:31:00.300 03:26:02 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:00.300 03:26:02 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:00.300 03:26:02 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:00.300 03:26:02 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:00.300 EAL: No free 2048 kB hugepages reported on node 1 00:31:00.300 03:26:02 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:00.300 03:26:02 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:00.300 03:26:02 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:00.300 03:26:02 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:00.300 03:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:00.300 03:26:02 -- common/autotest_common.sh@10 -- # set +x 00:31:00.300 03:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:00.300 03:26:02 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:00.300 03:26:02 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:00.300 03:26:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:00.300 03:26:02 -- nvmf/common.sh@116 -- # sync 00:31:00.300 03:26:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:00.300 03:26:02 -- nvmf/common.sh@119 -- # set +e 00:31:00.300 03:26:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:00.300 03:26:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:00.300 rmmod nvme_tcp 00:31:00.300 rmmod nvme_fabrics 00:31:00.300 rmmod nvme_keyring 00:31:00.300 03:26:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:00.300 03:26:02 -- nvmf/common.sh@123 -- # set -e 00:31:00.300 03:26:02 -- nvmf/common.sh@124 -- # return 0 00:31:00.300 03:26:02 -- nvmf/common.sh@477 -- # '[' -n 2593897 ']' 00:31:00.300 03:26:02 -- nvmf/common.sh@478 -- # killprocess 2593897 00:31:00.300 03:26:02 -- common/autotest_common.sh@936 -- # '[' -z 2593897 ']' 00:31:00.300 03:26:02 -- common/autotest_common.sh@940 -- # kill -0 2593897 00:31:00.300 03:26:02 -- common/autotest_common.sh@941 -- # uname 00:31:00.300 03:26:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:00.300 03:26:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2593897 00:31:00.300 03:26:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:00.300 03:26:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:00.300 03:26:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2593897' 00:31:00.300 killing process with pid 2593897 00:31:00.300 03:26:02 -- common/autotest_common.sh@955 -- # kill 2593897 00:31:00.300 [2024-11-27 03:26:02.789150] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:00.300 03:26:02 -- common/autotest_common.sh@960 -- # wait 2593897 00:31:02.207 03:26:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:02.207 03:26:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:02.207 03:26:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:02.207 03:26:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:02.207 03:26:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:02.207 03:26:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:02.207 03:26:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:02.207 03:26:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:04.113 03:26:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:04.113 00:31:04.113 real 0m18.144s 00:31:04.113 user 0m27.229s 00:31:04.113 sys 0m2.236s 00:31:04.113 03:26:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:04.113 03:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:04.113 ************************************ 00:31:04.113 END TEST nvmf_identify_passthru 00:31:04.113 ************************************ 00:31:04.113 03:26:06 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:04.113 03:26:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:04.113 03:26:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:04.113 03:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:04.113 ************************************ 00:31:04.113 START TEST nvmf_dif 00:31:04.113 ************************************ 00:31:04.113 03:26:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:04.113 * Looking for test storage... 00:31:04.113 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:04.113 03:26:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:04.113 03:26:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:04.113 03:26:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:04.113 03:26:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:04.113 03:26:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:04.113 03:26:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:04.113 03:26:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:04.113 03:26:06 -- scripts/common.sh@335 -- # IFS=.-: 00:31:04.113 03:26:06 -- scripts/common.sh@335 -- # read -ra ver1 00:31:04.113 03:26:06 -- scripts/common.sh@336 -- # IFS=.-: 00:31:04.113 03:26:06 -- scripts/common.sh@336 -- # read -ra ver2 00:31:04.113 03:26:06 -- scripts/common.sh@337 -- # local 'op=<' 00:31:04.113 03:26:06 -- scripts/common.sh@339 -- # ver1_l=2 00:31:04.113 03:26:06 -- scripts/common.sh@340 -- # ver2_l=1 00:31:04.113 03:26:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:04.113 03:26:06 -- scripts/common.sh@343 -- # case "$op" in 00:31:04.113 03:26:06 -- scripts/common.sh@344 -- # : 1 00:31:04.113 03:26:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:04.113 03:26:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:04.113 03:26:06 -- scripts/common.sh@364 -- # decimal 1 00:31:04.113 03:26:06 -- scripts/common.sh@352 -- # local d=1 00:31:04.113 03:26:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:04.113 03:26:06 -- scripts/common.sh@354 -- # echo 1 00:31:04.113 03:26:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:04.113 03:26:06 -- scripts/common.sh@365 -- # decimal 2 00:31:04.113 03:26:06 -- scripts/common.sh@352 -- # local d=2 00:31:04.113 03:26:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:04.113 03:26:06 -- scripts/common.sh@354 -- # echo 2 00:31:04.113 03:26:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:04.113 03:26:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:04.113 03:26:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:04.113 03:26:06 -- scripts/common.sh@367 -- # return 0 00:31:04.114 03:26:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:04.114 03:26:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:04.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:04.114 --rc genhtml_branch_coverage=1 00:31:04.114 --rc genhtml_function_coverage=1 00:31:04.114 --rc genhtml_legend=1 00:31:04.114 --rc geninfo_all_blocks=1 00:31:04.114 --rc geninfo_unexecuted_blocks=1 00:31:04.114 00:31:04.114 ' 00:31:04.114 03:26:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:04.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:04.114 --rc genhtml_branch_coverage=1 00:31:04.114 --rc genhtml_function_coverage=1 00:31:04.114 --rc genhtml_legend=1 00:31:04.114 --rc geninfo_all_blocks=1 00:31:04.114 --rc geninfo_unexecuted_blocks=1 00:31:04.114 00:31:04.114 ' 00:31:04.114 03:26:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:04.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:04.114 --rc genhtml_branch_coverage=1 00:31:04.114 --rc genhtml_function_coverage=1 00:31:04.114 --rc genhtml_legend=1 00:31:04.114 --rc geninfo_all_blocks=1 00:31:04.114 --rc geninfo_unexecuted_blocks=1 00:31:04.114 00:31:04.114 ' 00:31:04.114 03:26:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:04.114 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:04.114 --rc genhtml_branch_coverage=1 00:31:04.114 --rc genhtml_function_coverage=1 00:31:04.114 --rc genhtml_legend=1 00:31:04.114 --rc geninfo_all_blocks=1 00:31:04.114 --rc geninfo_unexecuted_blocks=1 00:31:04.114 00:31:04.114 ' 00:31:04.114 03:26:06 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:04.114 03:26:06 -- nvmf/common.sh@7 -- # uname -s 00:31:04.114 03:26:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:04.114 03:26:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:04.114 03:26:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:04.114 03:26:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:04.114 03:26:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:04.114 03:26:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:04.114 03:26:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:04.114 03:26:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:04.114 03:26:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:04.114 03:26:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:04.114 03:26:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:04.114 03:26:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:04.114 03:26:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:04.114 03:26:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:04.114 03:26:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:04.114 03:26:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:04.114 03:26:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:04.114 03:26:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:04.114 03:26:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:04.114 03:26:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:04.114 03:26:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:04.114 03:26:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:04.114 03:26:06 -- paths/export.sh@5 -- # export PATH 00:31:04.114 03:26:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:04.114 03:26:06 -- nvmf/common.sh@46 -- # : 0 00:31:04.114 03:26:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:04.114 03:26:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:04.114 03:26:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:04.114 03:26:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:04.114 03:26:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:04.114 03:26:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:04.114 03:26:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:04.114 03:26:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:04.114 03:26:06 -- target/dif.sh@15 -- # NULL_META=16 00:31:04.114 03:26:06 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:04.114 03:26:06 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:04.114 03:26:06 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:04.114 03:26:06 -- target/dif.sh@135 -- # nvmftestinit 00:31:04.114 03:26:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:04.114 03:26:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:04.114 03:26:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:04.114 03:26:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:04.114 03:26:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:04.114 03:26:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:04.114 03:26:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:04.114 03:26:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:04.114 03:26:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:04.114 03:26:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:04.114 03:26:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:04.114 03:26:06 -- common/autotest_common.sh@10 -- # set +x 00:31:06.072 03:26:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:06.072 03:26:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:06.072 03:26:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:06.072 03:26:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:06.072 03:26:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:06.072 03:26:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:06.072 03:26:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:06.072 03:26:08 -- nvmf/common.sh@294 -- # net_devs=() 00:31:06.072 03:26:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:06.072 03:26:08 -- nvmf/common.sh@295 -- # e810=() 00:31:06.072 03:26:08 -- nvmf/common.sh@295 -- # local -ga e810 00:31:06.072 03:26:08 -- nvmf/common.sh@296 -- # x722=() 00:31:06.072 03:26:08 -- nvmf/common.sh@296 -- # local -ga x722 00:31:06.072 03:26:08 -- nvmf/common.sh@297 -- # mlx=() 00:31:06.072 03:26:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:06.072 03:26:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:06.072 03:26:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:06.072 03:26:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:06.072 03:26:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:06.072 03:26:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:06.072 03:26:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:06.072 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:06.072 03:26:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:06.072 03:26:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:06.072 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:06.072 03:26:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:06.072 03:26:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:06.072 03:26:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:06.072 03:26:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:06.072 03:26:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:06.073 03:26:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:06.073 03:26:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:06.073 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:06.073 03:26:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:06.073 03:26:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:06.073 03:26:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:06.073 03:26:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:06.073 03:26:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:06.073 03:26:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:06.073 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:06.073 03:26:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:06.073 03:26:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:06.073 03:26:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:06.073 03:26:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:06.073 03:26:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:06.073 03:26:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:06.073 03:26:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:06.073 03:26:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:06.073 03:26:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:06.073 03:26:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:06.073 03:26:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:06.073 03:26:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:06.073 03:26:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:06.073 03:26:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:06.073 03:26:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:06.073 03:26:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:06.073 03:26:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:06.073 03:26:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:06.073 03:26:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:06.073 03:26:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:06.073 03:26:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:06.073 03:26:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:06.073 03:26:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:06.331 03:26:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:06.331 03:26:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:06.331 03:26:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:06.331 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:06.331 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.337 ms 00:31:06.331 00:31:06.331 --- 10.0.0.2 ping statistics --- 00:31:06.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:06.331 rtt min/avg/max/mdev = 0.337/0.337/0.337/0.000 ms 00:31:06.331 03:26:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:06.331 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:06.331 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:31:06.331 00:31:06.331 --- 10.0.0.1 ping statistics --- 00:31:06.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:06.331 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:31:06.331 03:26:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:06.331 03:26:08 -- nvmf/common.sh@410 -- # return 0 00:31:06.331 03:26:08 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:06.331 03:26:08 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:07.706 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:07.706 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:07.706 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:07.706 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:07.706 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:07.706 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:07.706 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:07.706 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:07.706 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:07.706 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:07.706 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:07.706 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:07.706 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:07.706 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:07.706 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:07.706 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:07.706 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:07.706 03:26:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:07.706 03:26:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:07.706 03:26:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:07.706 03:26:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:07.706 03:26:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:07.706 03:26:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:07.706 03:26:10 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:07.706 03:26:10 -- target/dif.sh@137 -- # nvmfappstart 00:31:07.706 03:26:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:07.706 03:26:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:07.706 03:26:10 -- common/autotest_common.sh@10 -- # set +x 00:31:07.706 03:26:10 -- nvmf/common.sh@469 -- # nvmfpid=2597153 00:31:07.706 03:26:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:07.706 03:26:10 -- nvmf/common.sh@470 -- # waitforlisten 2597153 00:31:07.706 03:26:10 -- common/autotest_common.sh@829 -- # '[' -z 2597153 ']' 00:31:07.706 03:26:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:07.706 03:26:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:07.706 03:26:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:07.706 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:07.706 03:26:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:07.706 03:26:10 -- common/autotest_common.sh@10 -- # set +x 00:31:07.706 [2024-11-27 03:26:10.168114] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:07.706 [2024-11-27 03:26:10.168222] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:07.706 EAL: No free 2048 kB hugepages reported on node 1 00:31:07.706 [2024-11-27 03:26:10.240365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:07.965 [2024-11-27 03:26:10.333219] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:07.965 [2024-11-27 03:26:10.333374] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:07.965 [2024-11-27 03:26:10.333390] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:07.965 [2024-11-27 03:26:10.333403] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:07.965 [2024-11-27 03:26:10.333428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:08.900 03:26:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:08.900 03:26:11 -- common/autotest_common.sh@862 -- # return 0 00:31:08.900 03:26:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:08.900 03:26:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:08.900 03:26:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.900 03:26:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:08.900 03:26:11 -- target/dif.sh@139 -- # create_transport 00:31:08.900 03:26:11 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:08.900 03:26:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:08.900 03:26:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.900 [2024-11-27 03:26:11.235932] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:08.900 03:26:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:08.900 03:26:11 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:08.900 03:26:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:08.900 03:26:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:08.900 03:26:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.900 ************************************ 00:31:08.900 START TEST fio_dif_1_default 00:31:08.900 ************************************ 00:31:08.900 03:26:11 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:08.900 03:26:11 -- target/dif.sh@86 -- # create_subsystems 0 00:31:08.900 03:26:11 -- target/dif.sh@28 -- # local sub 00:31:08.900 03:26:11 -- target/dif.sh@30 -- # for sub in "$@" 00:31:08.900 03:26:11 -- target/dif.sh@31 -- # create_subsystem 0 00:31:08.900 03:26:11 -- target/dif.sh@18 -- # local sub_id=0 00:31:08.900 03:26:11 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:08.900 03:26:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:08.900 03:26:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.900 bdev_null0 00:31:08.900 03:26:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:08.900 03:26:11 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:08.900 03:26:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:08.900 03:26:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.900 03:26:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:08.900 03:26:11 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:08.900 03:26:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:08.900 03:26:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.900 03:26:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:08.900 03:26:11 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:08.900 03:26:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:08.900 03:26:11 -- common/autotest_common.sh@10 -- # set +x 00:31:08.900 [2024-11-27 03:26:11.272206] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:08.900 03:26:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:08.900 03:26:11 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:08.900 03:26:11 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:08.900 03:26:11 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:08.900 03:26:11 -- nvmf/common.sh@520 -- # config=() 00:31:08.900 03:26:11 -- nvmf/common.sh@520 -- # local subsystem config 00:31:08.900 03:26:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:08.900 03:26:11 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:08.900 03:26:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:08.900 { 00:31:08.900 "params": { 00:31:08.900 "name": "Nvme$subsystem", 00:31:08.900 "trtype": "$TEST_TRANSPORT", 00:31:08.900 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:08.900 "adrfam": "ipv4", 00:31:08.901 "trsvcid": "$NVMF_PORT", 00:31:08.901 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:08.901 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:08.901 "hdgst": ${hdgst:-false}, 00:31:08.901 "ddgst": ${ddgst:-false} 00:31:08.901 }, 00:31:08.901 "method": "bdev_nvme_attach_controller" 00:31:08.901 } 00:31:08.901 EOF 00:31:08.901 )") 00:31:08.901 03:26:11 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:08.901 03:26:11 -- target/dif.sh@82 -- # gen_fio_conf 00:31:08.901 03:26:11 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:08.901 03:26:11 -- target/dif.sh@54 -- # local file 00:31:08.901 03:26:11 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:08.901 03:26:11 -- target/dif.sh@56 -- # cat 00:31:08.901 03:26:11 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:08.901 03:26:11 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:08.901 03:26:11 -- common/autotest_common.sh@1330 -- # shift 00:31:08.901 03:26:11 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:08.901 03:26:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:08.901 03:26:11 -- nvmf/common.sh@542 -- # cat 00:31:08.901 03:26:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:08.901 03:26:11 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:08.901 03:26:11 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:08.901 03:26:11 -- target/dif.sh@72 -- # (( file <= files )) 00:31:08.901 03:26:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:08.901 03:26:11 -- nvmf/common.sh@544 -- # jq . 00:31:08.901 03:26:11 -- nvmf/common.sh@545 -- # IFS=, 00:31:08.901 03:26:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:08.901 "params": { 00:31:08.901 "name": "Nvme0", 00:31:08.901 "trtype": "tcp", 00:31:08.901 "traddr": "10.0.0.2", 00:31:08.901 "adrfam": "ipv4", 00:31:08.901 "trsvcid": "4420", 00:31:08.901 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:08.901 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:08.901 "hdgst": false, 00:31:08.901 "ddgst": false 00:31:08.901 }, 00:31:08.901 "method": "bdev_nvme_attach_controller" 00:31:08.901 }' 00:31:08.901 03:26:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:08.901 03:26:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:08.901 03:26:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:08.901 03:26:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:08.901 03:26:11 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:08.901 03:26:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:08.901 03:26:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:08.901 03:26:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:08.901 03:26:11 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:08.901 03:26:11 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:09.159 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:09.159 fio-3.35 00:31:09.159 Starting 1 thread 00:31:09.159 EAL: No free 2048 kB hugepages reported on node 1 00:31:09.417 [2024-11-27 03:26:11.907488] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:09.417 [2024-11-27 03:26:11.907597] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:21.634 00:31:21.634 filename0: (groupid=0, jobs=1): err= 0: pid=2597516: Wed Nov 27 03:26:22 2024 00:31:21.634 read: IOPS=141, BW=568KiB/s (581kB/s)(5680KiB/10003msec) 00:31:21.634 slat (nsec): min=3969, max=60100, avg=9363.28, stdev=3031.56 00:31:21.634 clat (usec): min=563, max=48527, avg=28146.90, stdev=18942.60 00:31:21.634 lat (usec): min=571, max=48556, avg=28156.26, stdev=18942.61 00:31:21.634 clat percentiles (usec): 00:31:21.634 | 1.00th=[ 586], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 619], 00:31:21.634 | 30.00th=[ 676], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:21.634 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:21.634 | 99.00th=[41157], 99.50th=[41157], 99.90th=[48497], 99.95th=[48497], 00:31:21.634 | 99.99th=[48497] 00:31:21.634 bw ( KiB/s): min= 384, max= 768, per=100.00%, avg=572.63, stdev=183.79, samples=19 00:31:21.634 iops : min= 96, max= 192, avg=143.16, stdev=45.95, samples=19 00:31:21.634 lat (usec) : 750=31.55%, 1000=0.56% 00:31:21.634 lat (msec) : 50=67.89% 00:31:21.634 cpu : usr=91.23%, sys=8.46%, ctx=21, majf=0, minf=278 00:31:21.634 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:21.634 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.634 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:21.634 issued rwts: total=1420,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:21.634 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:21.634 00:31:21.634 Run status group 0 (all jobs): 00:31:21.634 READ: bw=568KiB/s (581kB/s), 568KiB/s-568KiB/s (581kB/s-581kB/s), io=5680KiB (5816kB), run=10003-10003msec 00:31:21.634 03:26:22 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:21.634 03:26:22 -- target/dif.sh@43 -- # local sub 00:31:21.634 03:26:22 -- target/dif.sh@45 -- # for sub in "$@" 00:31:21.634 03:26:22 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:21.634 03:26:22 -- target/dif.sh@36 -- # local sub_id=0 00:31:21.634 03:26:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 03:26:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 00:31:21.634 real 0m10.993s 00:31:21.634 user 0m10.132s 00:31:21.634 sys 0m1.140s 00:31:21.634 03:26:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 ************************************ 00:31:21.634 END TEST fio_dif_1_default 00:31:21.634 ************************************ 00:31:21.634 03:26:22 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:21.634 03:26:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:21.634 03:26:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 ************************************ 00:31:21.634 START TEST fio_dif_1_multi_subsystems 00:31:21.634 ************************************ 00:31:21.634 03:26:22 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:21.634 03:26:22 -- target/dif.sh@92 -- # local files=1 00:31:21.634 03:26:22 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:21.634 03:26:22 -- target/dif.sh@28 -- # local sub 00:31:21.634 03:26:22 -- target/dif.sh@30 -- # for sub in "$@" 00:31:21.634 03:26:22 -- target/dif.sh@31 -- # create_subsystem 0 00:31:21.634 03:26:22 -- target/dif.sh@18 -- # local sub_id=0 00:31:21.634 03:26:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 bdev_null0 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 03:26:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 03:26:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 03:26:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 [2024-11-27 03:26:22.289636] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 03:26:22 -- target/dif.sh@30 -- # for sub in "$@" 00:31:21.634 03:26:22 -- target/dif.sh@31 -- # create_subsystem 1 00:31:21.634 03:26:22 -- target/dif.sh@18 -- # local sub_id=1 00:31:21.634 03:26:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 bdev_null1 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 03:26:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 03:26:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 03:26:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:21.634 03:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:21.634 03:26:22 -- common/autotest_common.sh@10 -- # set +x 00:31:21.634 03:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:21.634 03:26:22 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:21.634 03:26:22 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:21.634 03:26:22 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:21.634 03:26:22 -- nvmf/common.sh@520 -- # config=() 00:31:21.634 03:26:22 -- nvmf/common.sh@520 -- # local subsystem config 00:31:21.634 03:26:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:21.634 03:26:22 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:21.634 03:26:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:21.634 { 00:31:21.634 "params": { 00:31:21.634 "name": "Nvme$subsystem", 00:31:21.634 "trtype": "$TEST_TRANSPORT", 00:31:21.634 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:21.634 "adrfam": "ipv4", 00:31:21.634 "trsvcid": "$NVMF_PORT", 00:31:21.634 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:21.634 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:21.634 "hdgst": ${hdgst:-false}, 00:31:21.634 "ddgst": ${ddgst:-false} 00:31:21.634 }, 00:31:21.634 "method": "bdev_nvme_attach_controller" 00:31:21.634 } 00:31:21.634 EOF 00:31:21.634 )") 00:31:21.634 03:26:22 -- target/dif.sh@82 -- # gen_fio_conf 00:31:21.634 03:26:22 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:21.634 03:26:22 -- target/dif.sh@54 -- # local file 00:31:21.634 03:26:22 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:21.634 03:26:22 -- target/dif.sh@56 -- # cat 00:31:21.634 03:26:22 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:21.634 03:26:22 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:21.634 03:26:22 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:21.634 03:26:22 -- common/autotest_common.sh@1330 -- # shift 00:31:21.634 03:26:22 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:21.634 03:26:22 -- nvmf/common.sh@542 -- # cat 00:31:21.634 03:26:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:21.634 03:26:22 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:21.634 03:26:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:21.634 03:26:22 -- target/dif.sh@72 -- # (( file <= files )) 00:31:21.634 03:26:22 -- target/dif.sh@73 -- # cat 00:31:21.634 03:26:22 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:21.634 03:26:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:21.634 03:26:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:21.634 03:26:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:21.634 { 00:31:21.634 "params": { 00:31:21.634 "name": "Nvme$subsystem", 00:31:21.634 "trtype": "$TEST_TRANSPORT", 00:31:21.634 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:21.634 "adrfam": "ipv4", 00:31:21.634 "trsvcid": "$NVMF_PORT", 00:31:21.634 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:21.634 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:21.634 "hdgst": ${hdgst:-false}, 00:31:21.634 "ddgst": ${ddgst:-false} 00:31:21.634 }, 00:31:21.634 "method": "bdev_nvme_attach_controller" 00:31:21.634 } 00:31:21.634 EOF 00:31:21.634 )") 00:31:21.634 03:26:22 -- nvmf/common.sh@542 -- # cat 00:31:21.634 03:26:22 -- target/dif.sh@72 -- # (( file++ )) 00:31:21.635 03:26:22 -- target/dif.sh@72 -- # (( file <= files )) 00:31:21.635 03:26:22 -- nvmf/common.sh@544 -- # jq . 00:31:21.635 03:26:22 -- nvmf/common.sh@545 -- # IFS=, 00:31:21.635 03:26:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:21.635 "params": { 00:31:21.635 "name": "Nvme0", 00:31:21.635 "trtype": "tcp", 00:31:21.635 "traddr": "10.0.0.2", 00:31:21.635 "adrfam": "ipv4", 00:31:21.635 "trsvcid": "4420", 00:31:21.635 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:21.635 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:21.635 "hdgst": false, 00:31:21.635 "ddgst": false 00:31:21.635 }, 00:31:21.635 "method": "bdev_nvme_attach_controller" 00:31:21.635 },{ 00:31:21.635 "params": { 00:31:21.635 "name": "Nvme1", 00:31:21.635 "trtype": "tcp", 00:31:21.635 "traddr": "10.0.0.2", 00:31:21.635 "adrfam": "ipv4", 00:31:21.635 "trsvcid": "4420", 00:31:21.635 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:21.635 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:21.635 "hdgst": false, 00:31:21.635 "ddgst": false 00:31:21.635 }, 00:31:21.635 "method": "bdev_nvme_attach_controller" 00:31:21.635 }' 00:31:21.635 03:26:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:21.635 03:26:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:21.635 03:26:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:21.635 03:26:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:21.635 03:26:22 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:21.635 03:26:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:21.635 03:26:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:21.635 03:26:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:21.635 03:26:22 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:21.635 03:26:22 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:21.635 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:21.635 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:21.635 fio-3.35 00:31:21.635 Starting 2 threads 00:31:21.635 EAL: No free 2048 kB hugepages reported on node 1 00:31:21.635 [2024-11-27 03:26:23.162245] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:21.635 [2024-11-27 03:26:23.162319] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:31.620 00:31:31.621 filename0: (groupid=0, jobs=1): err= 0: pid=2598953: Wed Nov 27 03:26:33 2024 00:31:31.621 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10018msec) 00:31:31.621 slat (nsec): min=4509, max=28728, avg=9815.28, stdev=2724.08 00:31:31.621 clat (usec): min=40755, max=47174, avg=41026.43, stdev=429.98 00:31:31.621 lat (usec): min=40763, max=47202, avg=41036.24, stdev=430.31 00:31:31.621 clat percentiles (usec): 00:31:31.621 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:31.621 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:31.621 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:31.621 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46924], 99.95th=[46924], 00:31:31.621 | 99.99th=[46924] 00:31:31.621 bw ( KiB/s): min= 384, max= 416, per=33.79%, avg=388.80, stdev=11.72, samples=20 00:31:31.621 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:31:31.621 lat (msec) : 50=100.00% 00:31:31.621 cpu : usr=95.39%, sys=4.33%, ctx=14, majf=0, minf=148 00:31:31.621 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:31.621 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:31.621 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:31.621 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:31.621 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:31.621 filename1: (groupid=0, jobs=1): err= 0: pid=2598954: Wed Nov 27 03:26:33 2024 00:31:31.621 read: IOPS=189, BW=758KiB/s (777kB/s)(7600KiB/10020msec) 00:31:31.621 slat (usec): min=5, max=104, avg= 9.70, stdev= 3.28 00:31:31.621 clat (usec): min=540, max=45869, avg=21060.25, stdev=20381.83 00:31:31.621 lat (usec): min=548, max=45897, avg=21069.96, stdev=20381.62 00:31:31.621 clat percentiles (usec): 00:31:31.621 | 1.00th=[ 570], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 611], 00:31:31.621 | 30.00th=[ 627], 40.00th=[ 676], 50.00th=[40633], 60.00th=[41157], 00:31:31.621 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:31.621 | 99.00th=[42206], 99.50th=[42206], 99.90th=[45876], 99.95th=[45876], 00:31:31.621 | 99.99th=[45876] 00:31:31.621 bw ( KiB/s): min= 704, max= 768, per=66.02%, avg=758.40, stdev=21.02, samples=20 00:31:31.621 iops : min= 176, max= 192, avg=189.60, stdev= 5.26, samples=20 00:31:31.621 lat (usec) : 750=46.79%, 1000=2.79% 00:31:31.621 lat (msec) : 2=0.32%, 50=50.11% 00:31:31.621 cpu : usr=95.22%, sys=4.48%, ctx=14, majf=0, minf=227 00:31:31.621 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:31.621 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:31.621 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:31.621 issued rwts: total=1900,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:31.621 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:31.621 00:31:31.621 Run status group 0 (all jobs): 00:31:31.621 READ: bw=1148KiB/s (1176kB/s), 390KiB/s-758KiB/s (399kB/s-777kB/s), io=11.2MiB (11.8MB), run=10018-10020msec 00:31:31.621 03:26:33 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:31.621 03:26:33 -- target/dif.sh@43 -- # local sub 00:31:31.621 03:26:33 -- target/dif.sh@45 -- # for sub in "$@" 00:31:31.621 03:26:33 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:31.621 03:26:33 -- target/dif.sh@36 -- # local sub_id=0 00:31:31.621 03:26:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:31.621 03:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 03:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.621 03:26:33 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:31.621 03:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 03:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.621 03:26:33 -- target/dif.sh@45 -- # for sub in "$@" 00:31:31.621 03:26:33 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:31.621 03:26:33 -- target/dif.sh@36 -- # local sub_id=1 00:31:31.621 03:26:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:31.621 03:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 03:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.621 03:26:33 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:31.621 03:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 03:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.621 00:31:31.621 real 0m11.328s 00:31:31.621 user 0m20.409s 00:31:31.621 sys 0m1.238s 00:31:31.621 03:26:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 ************************************ 00:31:31.621 END TEST fio_dif_1_multi_subsystems 00:31:31.621 ************************************ 00:31:31.621 03:26:33 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:31.621 03:26:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:31.621 03:26:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 ************************************ 00:31:31.621 START TEST fio_dif_rand_params 00:31:31.621 ************************************ 00:31:31.621 03:26:33 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:31.621 03:26:33 -- target/dif.sh@100 -- # local NULL_DIF 00:31:31.621 03:26:33 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:31.621 03:26:33 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:31.621 03:26:33 -- target/dif.sh@103 -- # bs=128k 00:31:31.621 03:26:33 -- target/dif.sh@103 -- # numjobs=3 00:31:31.621 03:26:33 -- target/dif.sh@103 -- # iodepth=3 00:31:31.621 03:26:33 -- target/dif.sh@103 -- # runtime=5 00:31:31.621 03:26:33 -- target/dif.sh@105 -- # create_subsystems 0 00:31:31.621 03:26:33 -- target/dif.sh@28 -- # local sub 00:31:31.621 03:26:33 -- target/dif.sh@30 -- # for sub in "$@" 00:31:31.621 03:26:33 -- target/dif.sh@31 -- # create_subsystem 0 00:31:31.621 03:26:33 -- target/dif.sh@18 -- # local sub_id=0 00:31:31.621 03:26:33 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:31.621 03:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 bdev_null0 00:31:31.621 03:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.621 03:26:33 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:31.621 03:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 03:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.621 03:26:33 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:31.621 03:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 03:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.621 03:26:33 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:31.621 03:26:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:31.621 03:26:33 -- common/autotest_common.sh@10 -- # set +x 00:31:31.621 [2024-11-27 03:26:33.642445] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:31.621 03:26:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:31.621 03:26:33 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:31.621 03:26:33 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:31.621 03:26:33 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:31.621 03:26:33 -- nvmf/common.sh@520 -- # config=() 00:31:31.621 03:26:33 -- nvmf/common.sh@520 -- # local subsystem config 00:31:31.621 03:26:33 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:31.621 03:26:33 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:31.621 { 00:31:31.621 "params": { 00:31:31.621 "name": "Nvme$subsystem", 00:31:31.621 "trtype": "$TEST_TRANSPORT", 00:31:31.621 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:31.621 "adrfam": "ipv4", 00:31:31.621 "trsvcid": "$NVMF_PORT", 00:31:31.621 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:31.621 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:31.621 "hdgst": ${hdgst:-false}, 00:31:31.621 "ddgst": ${ddgst:-false} 00:31:31.621 }, 00:31:31.621 "method": "bdev_nvme_attach_controller" 00:31:31.621 } 00:31:31.621 EOF 00:31:31.621 )") 00:31:31.621 03:26:33 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.621 03:26:33 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.621 03:26:33 -- target/dif.sh@82 -- # gen_fio_conf 00:31:31.621 03:26:33 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:31.621 03:26:33 -- target/dif.sh@54 -- # local file 00:31:31.621 03:26:33 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:31.621 03:26:33 -- target/dif.sh@56 -- # cat 00:31:31.621 03:26:33 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:31.621 03:26:33 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.621 03:26:33 -- common/autotest_common.sh@1330 -- # shift 00:31:31.621 03:26:33 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:31.621 03:26:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:31.621 03:26:33 -- nvmf/common.sh@542 -- # cat 00:31:31.621 03:26:33 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:31.621 03:26:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.621 03:26:33 -- target/dif.sh@72 -- # (( file <= files )) 00:31:31.621 03:26:33 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:31.621 03:26:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:31.621 03:26:33 -- nvmf/common.sh@544 -- # jq . 00:31:31.621 03:26:33 -- nvmf/common.sh@545 -- # IFS=, 00:31:31.621 03:26:33 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:31.621 "params": { 00:31:31.621 "name": "Nvme0", 00:31:31.621 "trtype": "tcp", 00:31:31.621 "traddr": "10.0.0.2", 00:31:31.621 "adrfam": "ipv4", 00:31:31.622 "trsvcid": "4420", 00:31:31.622 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:31.622 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:31.622 "hdgst": false, 00:31:31.622 "ddgst": false 00:31:31.622 }, 00:31:31.622 "method": "bdev_nvme_attach_controller" 00:31:31.622 }' 00:31:31.622 03:26:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:31.622 03:26:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:31.622 03:26:33 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:31.622 03:26:33 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:31.622 03:26:33 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:31.622 03:26:33 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:31.622 03:26:33 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:31.622 03:26:33 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:31.622 03:26:33 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:31.622 03:26:33 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:31.622 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:31.622 ... 00:31:31.622 fio-3.35 00:31:31.622 Starting 3 threads 00:31:31.622 EAL: No free 2048 kB hugepages reported on node 1 00:31:31.882 [2024-11-27 03:26:34.389151] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:31.882 [2024-11-27 03:26:34.389231] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:37.147 00:31:37.147 filename0: (groupid=0, jobs=1): err= 0: pid=2600392: Wed Nov 27 03:26:39 2024 00:31:37.147 read: IOPS=231, BW=28.9MiB/s (30.3MB/s)(146MiB/5046msec) 00:31:37.147 slat (nsec): min=4152, max=61859, avg=14450.87, stdev=4517.02 00:31:37.147 clat (usec): min=4721, max=56704, avg=12903.35, stdev=4602.20 00:31:37.147 lat (usec): min=4730, max=56717, avg=12917.80, stdev=4602.57 00:31:37.147 clat percentiles (usec): 00:31:37.147 | 1.00th=[ 5080], 5.00th=[ 8356], 10.00th=[ 9765], 20.00th=[10945], 00:31:37.147 | 30.00th=[11469], 40.00th=[11994], 50.00th=[12387], 60.00th=[12911], 00:31:37.147 | 70.00th=[13698], 80.00th=[14615], 90.00th=[15664], 95.00th=[16450], 00:31:37.147 | 99.00th=[45876], 99.50th=[48497], 99.90th=[55313], 99.95th=[56886], 00:31:37.147 | 99.99th=[56886] 00:31:37.147 bw ( KiB/s): min=26368, max=33280, per=32.90%, avg=29849.60, stdev=2023.68, samples=10 00:31:37.147 iops : min= 206, max= 260, avg=233.20, stdev=15.81, samples=10 00:31:37.147 lat (msec) : 10=11.82%, 20=86.99%, 50=0.86%, 100=0.34% 00:31:37.147 cpu : usr=86.03%, sys=9.22%, ctx=237, majf=0, minf=133 00:31:37.147 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:37.147 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.147 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.147 issued rwts: total=1168,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.147 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:37.147 filename0: (groupid=0, jobs=1): err= 0: pid=2600393: Wed Nov 27 03:26:39 2024 00:31:37.147 read: IOPS=229, BW=28.6MiB/s (30.0MB/s)(145MiB/5047msec) 00:31:37.147 slat (nsec): min=4036, max=52279, avg=16456.88, stdev=5407.58 00:31:37.147 clat (usec): min=4402, max=53218, avg=13039.67, stdev=5451.32 00:31:37.147 lat (usec): min=4414, max=53232, avg=13056.13, stdev=5451.07 00:31:37.147 clat percentiles (usec): 00:31:37.147 | 1.00th=[ 5276], 5.00th=[ 8979], 10.00th=[10290], 20.00th=[10945], 00:31:37.147 | 30.00th=[11469], 40.00th=[11863], 50.00th=[12387], 60.00th=[12911], 00:31:37.147 | 70.00th=[13435], 80.00th=[14091], 90.00th=[14877], 95.00th=[15664], 00:31:37.147 | 99.00th=[47973], 99.50th=[50070], 99.90th=[52691], 99.95th=[53216], 00:31:37.147 | 99.99th=[53216] 00:31:37.147 bw ( KiB/s): min=25600, max=31488, per=32.54%, avg=29516.80, stdev=2037.48, samples=10 00:31:37.148 iops : min= 200, max= 246, avg=230.60, stdev=15.92, samples=10 00:31:37.148 lat (msec) : 10=7.44%, 20=90.57%, 50=1.56%, 100=0.43% 00:31:37.148 cpu : usr=87.77%, sys=8.78%, ctx=641, majf=0, minf=118 00:31:37.148 IO depths : 1=0.3%, 2=99.7%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:37.148 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.148 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.148 issued rwts: total=1156,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.148 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:37.148 filename0: (groupid=0, jobs=1): err= 0: pid=2600394: Wed Nov 27 03:26:39 2024 00:31:37.148 read: IOPS=248, BW=31.0MiB/s (32.5MB/s)(157MiB/5046msec) 00:31:37.148 slat (nsec): min=3891, max=54821, avg=13830.44, stdev=2459.57 00:31:37.148 clat (usec): min=4598, max=55240, avg=12029.94, stdev=5446.99 00:31:37.148 lat (usec): min=4611, max=55254, avg=12043.77, stdev=5446.84 00:31:37.148 clat percentiles (usec): 00:31:37.148 | 1.00th=[ 5407], 5.00th=[ 8717], 10.00th=[ 9634], 20.00th=[10159], 00:31:37.148 | 30.00th=[10552], 40.00th=[10945], 50.00th=[11207], 60.00th=[11600], 00:31:37.148 | 70.00th=[12125], 80.00th=[12911], 90.00th=[13829], 95.00th=[14484], 00:31:37.148 | 99.00th=[49021], 99.50th=[51643], 99.90th=[54264], 99.95th=[55313], 00:31:37.148 | 99.99th=[55313] 00:31:37.148 bw ( KiB/s): min=25138, max=36096, per=35.28%, avg=32005.00, stdev=3194.58, samples=10 00:31:37.148 iops : min= 196, max= 282, avg=250.00, stdev=25.05, samples=10 00:31:37.148 lat (msec) : 10=16.04%, 20=82.12%, 50=1.04%, 100=0.80% 00:31:37.148 cpu : usr=93.62%, sys=5.89%, ctx=14, majf=0, minf=82 00:31:37.148 IO depths : 1=0.8%, 2=99.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:37.148 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.148 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.148 issued rwts: total=1253,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.148 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:37.148 00:31:37.148 Run status group 0 (all jobs): 00:31:37.148 READ: bw=88.6MiB/s (92.9MB/s), 28.6MiB/s-31.0MiB/s (30.0MB/s-32.5MB/s), io=447MiB (469MB), run=5046-5047msec 00:31:37.148 03:26:39 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:37.148 03:26:39 -- target/dif.sh@43 -- # local sub 00:31:37.148 03:26:39 -- target/dif.sh@45 -- # for sub in "$@" 00:31:37.148 03:26:39 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:37.148 03:26:39 -- target/dif.sh@36 -- # local sub_id=0 00:31:37.148 03:26:39 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:37.148 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.148 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.148 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.148 03:26:39 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:37.148 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.148 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.148 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.148 03:26:39 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:37.148 03:26:39 -- target/dif.sh@109 -- # bs=4k 00:31:37.148 03:26:39 -- target/dif.sh@109 -- # numjobs=8 00:31:37.148 03:26:39 -- target/dif.sh@109 -- # iodepth=16 00:31:37.148 03:26:39 -- target/dif.sh@109 -- # runtime= 00:31:37.148 03:26:39 -- target/dif.sh@109 -- # files=2 00:31:37.148 03:26:39 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:37.148 03:26:39 -- target/dif.sh@28 -- # local sub 00:31:37.148 03:26:39 -- target/dif.sh@30 -- # for sub in "$@" 00:31:37.148 03:26:39 -- target/dif.sh@31 -- # create_subsystem 0 00:31:37.148 03:26:39 -- target/dif.sh@18 -- # local sub_id=0 00:31:37.148 03:26:39 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:37.148 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.148 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.408 bdev_null0 00:31:37.408 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.408 03:26:39 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:37.408 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.408 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.408 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.408 03:26:39 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:37.408 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.408 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.408 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.408 03:26:39 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:37.408 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.408 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.408 [2024-11-27 03:26:39.787446] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:37.408 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.408 03:26:39 -- target/dif.sh@30 -- # for sub in "$@" 00:31:37.408 03:26:39 -- target/dif.sh@31 -- # create_subsystem 1 00:31:37.408 03:26:39 -- target/dif.sh@18 -- # local sub_id=1 00:31:37.408 03:26:39 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:37.408 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.408 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.408 bdev_null1 00:31:37.408 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.408 03:26:39 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:37.408 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.408 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.408 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.408 03:26:39 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:37.408 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.408 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.408 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.408 03:26:39 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:37.408 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.408 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.408 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.409 03:26:39 -- target/dif.sh@30 -- # for sub in "$@" 00:31:37.409 03:26:39 -- target/dif.sh@31 -- # create_subsystem 2 00:31:37.409 03:26:39 -- target/dif.sh@18 -- # local sub_id=2 00:31:37.409 03:26:39 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:37.409 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.409 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.409 bdev_null2 00:31:37.409 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.409 03:26:39 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:37.409 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.409 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.409 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.409 03:26:39 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:37.409 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.409 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.409 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.409 03:26:39 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:37.409 03:26:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.409 03:26:39 -- common/autotest_common.sh@10 -- # set +x 00:31:37.409 03:26:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.409 03:26:39 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:37.409 03:26:39 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:37.409 03:26:39 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:37.409 03:26:39 -- nvmf/common.sh@520 -- # config=() 00:31:37.409 03:26:39 -- nvmf/common.sh@520 -- # local subsystem config 00:31:37.409 03:26:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:37.409 03:26:39 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:37.409 03:26:39 -- target/dif.sh@82 -- # gen_fio_conf 00:31:37.409 03:26:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:37.409 { 00:31:37.409 "params": { 00:31:37.409 "name": "Nvme$subsystem", 00:31:37.409 "trtype": "$TEST_TRANSPORT", 00:31:37.409 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:37.409 "adrfam": "ipv4", 00:31:37.409 "trsvcid": "$NVMF_PORT", 00:31:37.409 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:37.409 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:37.409 "hdgst": ${hdgst:-false}, 00:31:37.409 "ddgst": ${ddgst:-false} 00:31:37.409 }, 00:31:37.409 "method": "bdev_nvme_attach_controller" 00:31:37.409 } 00:31:37.409 EOF 00:31:37.409 )") 00:31:37.409 03:26:39 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:37.409 03:26:39 -- target/dif.sh@54 -- # local file 00:31:37.409 03:26:39 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:37.409 03:26:39 -- target/dif.sh@56 -- # cat 00:31:37.409 03:26:39 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:37.409 03:26:39 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:37.409 03:26:39 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:37.409 03:26:39 -- common/autotest_common.sh@1330 -- # shift 00:31:37.409 03:26:39 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:37.409 03:26:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:37.409 03:26:39 -- nvmf/common.sh@542 -- # cat 00:31:37.409 03:26:39 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:37.409 03:26:39 -- target/dif.sh@72 -- # (( file <= files )) 00:31:37.409 03:26:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:37.409 03:26:39 -- target/dif.sh@73 -- # cat 00:31:37.409 03:26:39 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:37.409 03:26:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:37.409 03:26:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:37.409 03:26:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:37.409 { 00:31:37.409 "params": { 00:31:37.409 "name": "Nvme$subsystem", 00:31:37.409 "trtype": "$TEST_TRANSPORT", 00:31:37.409 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:37.409 "adrfam": "ipv4", 00:31:37.409 "trsvcid": "$NVMF_PORT", 00:31:37.409 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:37.409 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:37.409 "hdgst": ${hdgst:-false}, 00:31:37.409 "ddgst": ${ddgst:-false} 00:31:37.409 }, 00:31:37.409 "method": "bdev_nvme_attach_controller" 00:31:37.409 } 00:31:37.409 EOF 00:31:37.409 )") 00:31:37.409 03:26:39 -- target/dif.sh@72 -- # (( file++ )) 00:31:37.409 03:26:39 -- target/dif.sh@72 -- # (( file <= files )) 00:31:37.409 03:26:39 -- target/dif.sh@73 -- # cat 00:31:37.409 03:26:39 -- nvmf/common.sh@542 -- # cat 00:31:37.409 03:26:39 -- target/dif.sh@72 -- # (( file++ )) 00:31:37.409 03:26:39 -- target/dif.sh@72 -- # (( file <= files )) 00:31:37.409 03:26:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:37.409 03:26:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:37.409 { 00:31:37.409 "params": { 00:31:37.409 "name": "Nvme$subsystem", 00:31:37.409 "trtype": "$TEST_TRANSPORT", 00:31:37.409 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:37.409 "adrfam": "ipv4", 00:31:37.409 "trsvcid": "$NVMF_PORT", 00:31:37.409 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:37.409 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:37.409 "hdgst": ${hdgst:-false}, 00:31:37.409 "ddgst": ${ddgst:-false} 00:31:37.409 }, 00:31:37.409 "method": "bdev_nvme_attach_controller" 00:31:37.409 } 00:31:37.409 EOF 00:31:37.409 )") 00:31:37.409 03:26:39 -- nvmf/common.sh@542 -- # cat 00:31:37.409 03:26:39 -- nvmf/common.sh@544 -- # jq . 00:31:37.409 03:26:39 -- nvmf/common.sh@545 -- # IFS=, 00:31:37.409 03:26:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:37.409 "params": { 00:31:37.409 "name": "Nvme0", 00:31:37.409 "trtype": "tcp", 00:31:37.409 "traddr": "10.0.0.2", 00:31:37.409 "adrfam": "ipv4", 00:31:37.409 "trsvcid": "4420", 00:31:37.409 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:37.409 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:37.409 "hdgst": false, 00:31:37.409 "ddgst": false 00:31:37.409 }, 00:31:37.409 "method": "bdev_nvme_attach_controller" 00:31:37.409 },{ 00:31:37.409 "params": { 00:31:37.409 "name": "Nvme1", 00:31:37.409 "trtype": "tcp", 00:31:37.409 "traddr": "10.0.0.2", 00:31:37.409 "adrfam": "ipv4", 00:31:37.409 "trsvcid": "4420", 00:31:37.409 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:37.409 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:37.409 "hdgst": false, 00:31:37.409 "ddgst": false 00:31:37.409 }, 00:31:37.409 "method": "bdev_nvme_attach_controller" 00:31:37.409 },{ 00:31:37.409 "params": { 00:31:37.409 "name": "Nvme2", 00:31:37.409 "trtype": "tcp", 00:31:37.409 "traddr": "10.0.0.2", 00:31:37.409 "adrfam": "ipv4", 00:31:37.409 "trsvcid": "4420", 00:31:37.410 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:37.410 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:37.410 "hdgst": false, 00:31:37.410 "ddgst": false 00:31:37.410 }, 00:31:37.410 "method": "bdev_nvme_attach_controller" 00:31:37.410 }' 00:31:37.410 03:26:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:37.410 03:26:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:37.410 03:26:39 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:37.410 03:26:39 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:37.410 03:26:39 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:37.410 03:26:39 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:37.410 03:26:39 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:37.410 03:26:39 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:37.410 03:26:39 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:37.410 03:26:39 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:37.668 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:37.668 ... 00:31:37.668 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:37.668 ... 00:31:37.668 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:37.668 ... 00:31:37.668 fio-3.35 00:31:37.668 Starting 24 threads 00:31:37.668 EAL: No free 2048 kB hugepages reported on node 1 00:31:38.603 [2024-11-27 03:26:40.995234] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:38.603 [2024-11-27 03:26:40.995283] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:50.809 00:31:50.809 filename0: (groupid=0, jobs=1): err= 0: pid=2601283: Wed Nov 27 03:26:51 2024 00:31:50.809 read: IOPS=63, BW=252KiB/s (258kB/s)(2552KiB/10114msec) 00:31:50.809 slat (nsec): min=3949, max=71277, avg=10968.46, stdev=5921.34 00:31:50.809 clat (msec): min=10, max=495, avg=251.91, stdev=85.83 00:31:50.809 lat (msec): min=10, max=495, avg=251.92, stdev=85.83 00:31:50.809 clat percentiles (msec): 00:31:50.809 | 1.00th=[ 11], 5.00th=[ 64], 10.00th=[ 138], 20.00th=[ 201], 00:31:50.809 | 30.00th=[ 226], 40.00th=[ 247], 50.00th=[ 255], 60.00th=[ 279], 00:31:50.809 | 70.00th=[ 313], 80.00th=[ 330], 90.00th=[ 338], 95.00th=[ 347], 00:31:50.809 | 99.00th=[ 418], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], 00:31:50.809 | 99.99th=[ 498] 00:31:50.809 bw ( KiB/s): min= 128, max= 640, per=5.70%, avg=248.80, stdev=106.82, samples=20 00:31:50.809 iops : min= 32, max= 160, avg=62.20, stdev=26.71, samples=20 00:31:50.809 lat (msec) : 20=2.51%, 50=1.10%, 100=4.23%, 250=37.62%, 500=54.55% 00:31:50.809 cpu : usr=98.72%, sys=0.88%, ctx=17, majf=0, minf=73 00:31:50.809 IO depths : 1=0.2%, 2=0.3%, 4=6.1%, 8=80.9%, 16=12.5%, 32=0.0%, >=64=0.0% 00:31:50.809 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 complete : 0=0.0%, 4=88.7%, 8=6.0%, 16=5.3%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 issued rwts: total=638,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.809 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.809 filename0: (groupid=0, jobs=1): err= 0: pid=2601284: Wed Nov 27 03:26:51 2024 00:31:50.809 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10081msec) 00:31:50.809 slat (usec): min=8, max=150, avg=47.56, stdev=30.45 00:31:50.809 clat (msec): min=296, max=538, avg=402.78, stdev=51.92 00:31:50.809 lat (msec): min=296, max=538, avg=402.83, stdev=51.93 00:31:50.809 clat percentiles (msec): 00:31:50.809 | 1.00th=[ 296], 5.00th=[ 309], 10.00th=[ 334], 20.00th=[ 347], 00:31:50.809 | 30.00th=[ 393], 40.00th=[ 401], 50.00th=[ 409], 60.00th=[ 414], 00:31:50.809 | 70.00th=[ 418], 80.00th=[ 430], 90.00th=[ 451], 95.00th=[ 498], 00:31:50.809 | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], 00:31:50.809 | 99.99th=[ 542] 00:31:50.809 bw ( KiB/s): min= 128, max= 256, per=3.52%, avg=153.60, stdev=52.53, samples=20 00:31:50.809 iops : min= 32, max= 64, avg=38.40, stdev=13.13, samples=20 00:31:50.809 lat (msec) : 500=96.00%, 750=4.00% 00:31:50.809 cpu : usr=98.75%, sys=0.80%, ctx=25, majf=0, minf=58 00:31:50.809 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:50.809 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.809 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.809 filename0: (groupid=0, jobs=1): err= 0: pid=2601285: Wed Nov 27 03:26:51 2024 00:31:50.809 read: IOPS=56, BW=228KiB/s (233kB/s)(2304KiB/10111msec) 00:31:50.809 slat (usec): min=4, max=132, avg=18.88, stdev=20.00 00:31:50.809 clat (msec): min=57, max=411, avg=279.83, stdev=83.28 00:31:50.809 lat (msec): min=57, max=411, avg=279.85, stdev=83.28 00:31:50.809 clat percentiles (msec): 00:31:50.809 | 1.00th=[ 58], 5.00th=[ 136], 10.00th=[ 144], 20.00th=[ 178], 00:31:50.809 | 30.00th=[ 255], 40.00th=[ 300], 50.00th=[ 321], 60.00th=[ 326], 00:31:50.809 | 70.00th=[ 338], 80.00th=[ 342], 90.00th=[ 355], 95.00th=[ 359], 00:31:50.809 | 99.00th=[ 359], 99.50th=[ 384], 99.90th=[ 414], 99.95th=[ 414], 00:31:50.809 | 99.99th=[ 414] 00:31:50.809 bw ( KiB/s): min= 128, max= 384, per=5.13%, avg=224.00, stdev=74.33, samples=20 00:31:50.809 iops : min= 32, max= 96, avg=56.00, stdev=18.58, samples=20 00:31:50.809 lat (msec) : 100=2.78%, 250=26.04%, 500=71.18% 00:31:50.809 cpu : usr=98.67%, sys=0.83%, ctx=39, majf=0, minf=43 00:31:50.809 IO depths : 1=0.9%, 2=7.1%, 4=25.0%, 8=55.4%, 16=11.6%, 32=0.0%, >=64=0.0% 00:31:50.809 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.809 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.809 filename0: (groupid=0, jobs=1): err= 0: pid=2601286: Wed Nov 27 03:26:51 2024 00:31:50.809 read: IOPS=45, BW=184KiB/s (188kB/s)(1856KiB/10098msec) 00:31:50.809 slat (usec): min=8, max=112, avg=24.36, stdev=18.12 00:31:50.809 clat (msec): min=150, max=675, avg=346.93, stdev=80.50 00:31:50.809 lat (msec): min=150, max=675, avg=346.95, stdev=80.49 00:31:50.809 clat percentiles (msec): 00:31:50.809 | 1.00th=[ 155], 5.00th=[ 188], 10.00th=[ 243], 20.00th=[ 300], 00:31:50.809 | 30.00th=[ 317], 40.00th=[ 334], 50.00th=[ 351], 60.00th=[ 368], 00:31:50.809 | 70.00th=[ 401], 80.00th=[ 414], 90.00th=[ 418], 95.00th=[ 451], 00:31:50.809 | 99.00th=[ 609], 99.50th=[ 659], 99.90th=[ 676], 99.95th=[ 676], 00:31:50.809 | 99.99th=[ 676] 00:31:50.809 bw ( KiB/s): min= 112, max= 256, per=4.12%, avg=179.20, stdev=56.77, samples=20 00:31:50.809 iops : min= 28, max= 64, avg=44.80, stdev=14.19, samples=20 00:31:50.809 lat (msec) : 250=11.64%, 500=87.07%, 750=1.29% 00:31:50.809 cpu : usr=98.61%, sys=0.98%, ctx=17, majf=0, minf=77 00:31:50.809 IO depths : 1=2.4%, 2=8.6%, 4=25.0%, 8=53.9%, 16=10.1%, 32=0.0%, >=64=0.0% 00:31:50.809 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.809 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.809 filename0: (groupid=0, jobs=1): err= 0: pid=2601287: Wed Nov 27 03:26:51 2024 00:31:50.809 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10081msec) 00:31:50.809 slat (nsec): min=8286, max=81558, avg=28369.38, stdev=14775.02 00:31:50.809 clat (msec): min=296, max=538, avg=402.94, stdev=51.95 00:31:50.809 lat (msec): min=296, max=538, avg=402.96, stdev=51.95 00:31:50.809 clat percentiles (msec): 00:31:50.809 | 1.00th=[ 296], 5.00th=[ 309], 10.00th=[ 334], 20.00th=[ 347], 00:31:50.809 | 30.00th=[ 393], 40.00th=[ 401], 50.00th=[ 409], 60.00th=[ 414], 00:31:50.809 | 70.00th=[ 418], 80.00th=[ 430], 90.00th=[ 451], 95.00th=[ 498], 00:31:50.809 | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], 00:31:50.809 | 99.99th=[ 542] 00:31:50.809 bw ( KiB/s): min= 128, max= 256, per=3.52%, avg=153.60, stdev=52.53, samples=20 00:31:50.809 iops : min= 32, max= 64, avg=38.40, stdev=13.13, samples=20 00:31:50.809 lat (msec) : 500=96.00%, 750=4.00% 00:31:50.809 cpu : usr=98.62%, sys=0.83%, ctx=41, majf=0, minf=46 00:31:50.809 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:50.809 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.809 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.809 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.809 filename0: (groupid=0, jobs=1): err= 0: pid=2601288: Wed Nov 27 03:26:51 2024 00:31:50.809 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10049msec) 00:31:50.809 slat (usec): min=7, max=146, avg=103.06, stdev=22.81 00:31:50.809 clat (msec): min=271, max=533, avg=401.04, stdev=54.02 00:31:50.809 lat (msec): min=271, max=534, avg=401.14, stdev=54.02 00:31:50.809 clat percentiles (msec): 00:31:50.810 | 1.00th=[ 271], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 347], 00:31:50.810 | 30.00th=[ 393], 40.00th=[ 401], 50.00th=[ 409], 60.00th=[ 409], 00:31:50.810 | 70.00th=[ 414], 80.00th=[ 430], 90.00th=[ 451], 95.00th=[ 498], 00:31:50.810 | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], 00:31:50.810 | 99.99th=[ 535] 00:31:50.810 bw ( KiB/s): min= 128, max= 256, per=3.52%, avg=153.60, stdev=52.53, samples=20 00:31:50.810 iops : min= 32, max= 64, avg=38.40, stdev=13.13, samples=20 00:31:50.810 lat (msec) : 500=96.00%, 750=4.00% 00:31:50.810 cpu : usr=98.26%, sys=1.12%, ctx=35, majf=0, minf=61 00:31:50.810 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:50.810 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.810 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.810 filename0: (groupid=0, jobs=1): err= 0: pid=2601289: Wed Nov 27 03:26:51 2024 00:31:50.810 read: IOPS=41, BW=165KiB/s (169kB/s)(1664KiB/10103msec) 00:31:50.810 slat (usec): min=6, max=162, avg=55.86, stdev=39.28 00:31:50.810 clat (msec): min=187, max=649, avg=387.96, stdev=76.46 00:31:50.810 lat (msec): min=187, max=649, avg=388.02, stdev=76.48 00:31:50.810 clat percentiles (msec): 00:31:50.810 | 1.00th=[ 188], 5.00th=[ 241], 10.00th=[ 296], 20.00th=[ 334], 00:31:50.810 | 30.00th=[ 359], 40.00th=[ 393], 50.00th=[ 405], 60.00th=[ 409], 00:31:50.810 | 70.00th=[ 418], 80.00th=[ 435], 90.00th=[ 472], 95.00th=[ 498], 00:31:50.810 | 99.00th=[ 542], 99.50th=[ 600], 99.90th=[ 651], 99.95th=[ 651], 00:31:50.810 | 99.99th=[ 651] 00:31:50.810 bw ( KiB/s): min= 128, max= 256, per=3.68%, avg=160.00, stdev=55.18, samples=20 00:31:50.810 iops : min= 32, max= 64, avg=40.00, stdev=13.80, samples=20 00:31:50.810 lat (msec) : 250=7.69%, 500=87.98%, 750=4.33% 00:31:50.810 cpu : usr=98.74%, sys=0.74%, ctx=24, majf=0, minf=51 00:31:50.810 IO depths : 1=3.6%, 2=9.9%, 4=25.0%, 8=52.6%, 16=8.9%, 32=0.0%, >=64=0.0% 00:31:50.810 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.810 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.810 filename0: (groupid=0, jobs=1): err= 0: pid=2601290: Wed Nov 27 03:26:51 2024 00:31:50.810 read: IOPS=44, BW=177KiB/s (182kB/s)(1792KiB/10099msec) 00:31:50.810 slat (usec): min=8, max=129, avg=37.74, stdev=30.00 00:31:50.810 clat (msec): min=188, max=482, avg=359.26, stdev=63.16 00:31:50.810 lat (msec): min=188, max=482, avg=359.30, stdev=63.16 00:31:50.810 clat percentiles (msec): 00:31:50.810 | 1.00th=[ 188], 5.00th=[ 243], 10.00th=[ 255], 20.00th=[ 309], 00:31:50.810 | 30.00th=[ 334], 40.00th=[ 351], 50.00th=[ 368], 60.00th=[ 393], 00:31:50.810 | 70.00th=[ 409], 80.00th=[ 414], 90.00th=[ 418], 95.00th=[ 430], 00:31:50.810 | 99.00th=[ 451], 99.50th=[ 477], 99.90th=[ 485], 99.95th=[ 485], 00:31:50.810 | 99.99th=[ 485] 00:31:50.810 bw ( KiB/s): min= 128, max= 256, per=3.96%, avg=172.80, stdev=57.95, samples=20 00:31:50.810 iops : min= 32, max= 64, avg=43.20, stdev=14.49, samples=20 00:31:50.810 lat (msec) : 250=7.14%, 500=92.86% 00:31:50.810 cpu : usr=98.54%, sys=1.02%, ctx=27, majf=0, minf=40 00:31:50.810 IO depths : 1=2.5%, 2=8.7%, 4=25.0%, 8=53.8%, 16=10.0%, 32=0.0%, >=64=0.0% 00:31:50.810 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 issued rwts: total=448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.810 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.810 filename1: (groupid=0, jobs=1): err= 0: pid=2601291: Wed Nov 27 03:26:51 2024 00:31:50.810 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10044msec) 00:31:50.810 slat (nsec): min=8225, max=75145, avg=29458.03, stdev=12669.04 00:31:50.810 clat (msec): min=296, max=538, avg=401.48, stdev=53.23 00:31:50.810 lat (msec): min=296, max=538, avg=401.51, stdev=53.23 00:31:50.810 clat percentiles (msec): 00:31:50.810 | 1.00th=[ 296], 5.00th=[ 309], 10.00th=[ 334], 20.00th=[ 347], 00:31:50.810 | 30.00th=[ 388], 40.00th=[ 401], 50.00th=[ 409], 60.00th=[ 409], 00:31:50.810 | 70.00th=[ 418], 80.00th=[ 430], 90.00th=[ 451], 95.00th=[ 498], 00:31:50.810 | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 542], 99.95th=[ 542], 00:31:50.810 | 99.99th=[ 542] 00:31:50.810 bw ( KiB/s): min= 128, max= 256, per=3.52%, avg=153.60, stdev=50.70, samples=20 00:31:50.810 iops : min= 32, max= 64, avg=38.40, stdev=12.68, samples=20 00:31:50.810 lat (msec) : 500=96.00%, 750=4.00% 00:31:50.810 cpu : usr=98.81%, sys=0.70%, ctx=15, majf=0, minf=41 00:31:50.810 IO depths : 1=5.5%, 2=11.8%, 4=25.0%, 8=50.8%, 16=7.0%, 32=0.0%, >=64=0.0% 00:31:50.810 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.810 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.810 filename1: (groupid=0, jobs=1): err= 0: pid=2601292: Wed Nov 27 03:26:51 2024 00:31:50.810 read: IOPS=44, BW=177KiB/s (182kB/s)(1792KiB/10099msec) 00:31:50.810 slat (nsec): min=7325, max=98320, avg=27618.02, stdev=14870.48 00:31:50.810 clat (msec): min=187, max=473, avg=359.31, stdev=64.12 00:31:50.810 lat (msec): min=187, max=473, avg=359.34, stdev=64.13 00:31:50.810 clat percentiles (msec): 00:31:50.810 | 1.00th=[ 188], 5.00th=[ 241], 10.00th=[ 255], 20.00th=[ 309], 00:31:50.810 | 30.00th=[ 334], 40.00th=[ 347], 50.00th=[ 359], 60.00th=[ 393], 00:31:50.810 | 70.00th=[ 409], 80.00th=[ 414], 90.00th=[ 418], 95.00th=[ 451], 00:31:50.810 | 99.00th=[ 456], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], 00:31:50.810 | 99.99th=[ 472] 00:31:50.810 bw ( KiB/s): min= 128, max= 256, per=3.96%, avg=172.80, stdev=57.95, samples=20 00:31:50.810 iops : min= 32, max= 64, avg=43.20, stdev=14.49, samples=20 00:31:50.810 lat (msec) : 250=7.59%, 500=92.41% 00:31:50.810 cpu : usr=98.57%, sys=0.91%, ctx=41, majf=0, minf=33 00:31:50.810 IO depths : 1=4.0%, 2=10.3%, 4=25.0%, 8=52.2%, 16=8.5%, 32=0.0%, >=64=0.0% 00:31:50.810 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 issued rwts: total=448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.810 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.810 filename1: (groupid=0, jobs=1): err= 0: pid=2601293: Wed Nov 27 03:26:51 2024 00:31:50.810 read: IOPS=45, BW=184KiB/s (188kB/s)(1856KiB/10103msec) 00:31:50.810 slat (nsec): min=9027, max=75516, avg=24016.90, stdev=9209.32 00:31:50.810 clat (msec): min=105, max=451, avg=348.00, stdev=72.56 00:31:50.810 lat (msec): min=105, max=451, avg=348.02, stdev=72.56 00:31:50.810 clat percentiles (msec): 00:31:50.810 | 1.00th=[ 106], 5.00th=[ 188], 10.00th=[ 255], 20.00th=[ 309], 00:31:50.810 | 30.00th=[ 321], 40.00th=[ 338], 50.00th=[ 347], 60.00th=[ 388], 00:31:50.810 | 70.00th=[ 405], 80.00th=[ 409], 90.00th=[ 418], 95.00th=[ 430], 00:31:50.810 | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], 00:31:50.810 | 99.99th=[ 451] 00:31:50.810 bw ( KiB/s): min= 128, max= 256, per=4.12%, avg=179.20, stdev=52.58, samples=20 00:31:50.810 iops : min= 32, max= 64, avg=44.80, stdev=13.15, samples=20 00:31:50.810 lat (msec) : 250=9.91%, 500=90.09% 00:31:50.810 cpu : usr=98.42%, sys=1.01%, ctx=13, majf=0, minf=56 00:31:50.810 IO depths : 1=0.2%, 2=4.7%, 4=19.8%, 8=62.9%, 16=12.3%, 32=0.0%, >=64=0.0% 00:31:50.810 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 complete : 0=0.0%, 4=92.7%, 8=1.7%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 issued rwts: total=464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.810 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.810 filename1: (groupid=0, jobs=1): err= 0: pid=2601294: Wed Nov 27 03:26:51 2024 00:31:50.810 read: IOPS=39, BW=159KiB/s (162kB/s)(1600KiB/10087msec) 00:31:50.810 slat (nsec): min=4954, max=51385, avg=26688.75, stdev=10301.70 00:31:50.810 clat (msec): min=179, max=649, avg=403.24, stdev=62.95 00:31:50.810 lat (msec): min=179, max=649, avg=403.27, stdev=62.94 00:31:50.810 clat percentiles (msec): 00:31:50.810 | 1.00th=[ 262], 5.00th=[ 296], 10.00th=[ 334], 20.00th=[ 347], 00:31:50.810 | 30.00th=[ 388], 40.00th=[ 401], 50.00th=[ 409], 60.00th=[ 414], 00:31:50.810 | 70.00th=[ 418], 80.00th=[ 435], 90.00th=[ 468], 95.00th=[ 498], 00:31:50.810 | 99.00th=[ 609], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], 00:31:50.810 | 99.99th=[ 651] 00:31:50.810 bw ( KiB/s): min= 128, max= 256, per=3.52%, avg=153.60, stdev=48.81, samples=20 00:31:50.810 iops : min= 32, max= 64, avg=38.40, stdev=12.20, samples=20 00:31:50.810 lat (msec) : 250=0.50%, 500=94.50%, 750=5.00% 00:31:50.810 cpu : usr=98.88%, sys=0.72%, ctx=20, majf=0, minf=50 00:31:50.810 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:31:50.810 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.810 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.810 filename1: (groupid=0, jobs=1): err= 0: pid=2601295: Wed Nov 27 03:26:51 2024 00:31:50.810 read: IOPS=42, BW=172KiB/s (176kB/s)(1728KiB/10056msec) 00:31:50.810 slat (nsec): min=7574, max=44900, avg=16891.01, stdev=8440.83 00:31:50.810 clat (msec): min=94, max=548, avg=372.27, stdev=76.09 00:31:50.810 lat (msec): min=94, max=548, avg=372.28, stdev=76.09 00:31:50.810 clat percentiles (msec): 00:31:50.810 | 1.00th=[ 95], 5.00th=[ 271], 10.00th=[ 296], 20.00th=[ 326], 00:31:50.810 | 30.00th=[ 355], 40.00th=[ 384], 50.00th=[ 401], 60.00th=[ 405], 00:31:50.810 | 70.00th=[ 409], 80.00th=[ 414], 90.00th=[ 418], 95.00th=[ 430], 00:31:50.810 | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], 00:31:50.810 | 99.99th=[ 550] 00:31:50.810 bw ( KiB/s): min= 128, max= 256, per=3.82%, avg=166.40, stdev=60.18, samples=20 00:31:50.810 iops : min= 32, max= 64, avg=41.60, stdev=15.05, samples=20 00:31:50.810 lat (msec) : 100=3.70%, 500=92.59%, 750=3.70% 00:31:50.810 cpu : usr=98.72%, sys=0.90%, ctx=16, majf=0, minf=54 00:31:50.810 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:50.810 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.810 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.811 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.811 filename1: (groupid=0, jobs=1): err= 0: pid=2601296: Wed Nov 27 03:26:51 2024 00:31:50.811 read: IOPS=42, BW=171KiB/s (176kB/s)(1728KiB/10078msec) 00:31:50.811 slat (usec): min=8, max=112, avg=32.36, stdev=19.64 00:31:50.811 clat (msec): min=216, max=591, avg=371.89, stdev=54.09 00:31:50.811 lat (msec): min=216, max=591, avg=371.92, stdev=54.10 00:31:50.811 clat percentiles (msec): 00:31:50.811 | 1.00th=[ 255], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 326], 00:31:50.811 | 30.00th=[ 338], 40.00th=[ 355], 50.00th=[ 384], 60.00th=[ 401], 00:31:50.811 | 70.00th=[ 409], 80.00th=[ 414], 90.00th=[ 430], 95.00th=[ 451], 00:31:50.811 | 99.00th=[ 472], 99.50th=[ 489], 99.90th=[ 592], 99.95th=[ 592], 00:31:50.811 | 99.99th=[ 592] 00:31:50.811 bw ( KiB/s): min= 128, max= 256, per=3.82%, avg=166.40, stdev=53.55, samples=20 00:31:50.811 iops : min= 32, max= 64, avg=41.60, stdev=13.39, samples=20 00:31:50.811 lat (msec) : 250=0.46%, 500=99.07%, 750=0.46% 00:31:50.811 cpu : usr=98.86%, sys=0.70%, ctx=19, majf=0, minf=52 00:31:50.811 IO depths : 1=2.5%, 2=8.8%, 4=25.0%, 8=53.7%, 16=10.0%, 32=0.0%, >=64=0.0% 00:31:50.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 issued rwts: total=432,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.811 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.811 filename1: (groupid=0, jobs=1): err= 0: pid=2601297: Wed Nov 27 03:26:51 2024 00:31:50.811 read: IOPS=61, BW=248KiB/s (254kB/s)(2496KiB/10076msec) 00:31:50.811 slat (nsec): min=4618, max=43701, avg=11047.17, stdev=5044.24 00:31:50.811 clat (msec): min=12, max=358, avg=258.23, stdev=97.30 00:31:50.811 lat (msec): min=12, max=358, avg=258.25, stdev=97.29 00:31:50.811 clat percentiles (msec): 00:31:50.811 | 1.00th=[ 13], 5.00th=[ 69], 10.00th=[ 108], 20.00th=[ 150], 00:31:50.811 | 30.00th=[ 178], 40.00th=[ 259], 50.00th=[ 300], 60.00th=[ 321], 00:31:50.811 | 70.00th=[ 334], 80.00th=[ 342], 90.00th=[ 355], 95.00th=[ 359], 00:31:50.811 | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], 00:31:50.811 | 99.99th=[ 359] 00:31:50.811 bw ( KiB/s): min= 128, max= 513, per=5.59%, avg=243.25, stdev=101.01, samples=20 00:31:50.811 iops : min= 32, max= 128, avg=60.80, stdev=25.22, samples=20 00:31:50.811 lat (msec) : 20=2.56%, 100=5.13%, 250=28.21%, 500=64.10% 00:31:50.811 cpu : usr=98.54%, sys=1.04%, ctx=18, majf=0, minf=37 00:31:50.811 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:50.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 issued rwts: total=624,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.811 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.811 filename1: (groupid=0, jobs=1): err= 0: pid=2601298: Wed Nov 27 03:26:51 2024 00:31:50.811 read: IOPS=52, BW=209KiB/s (214kB/s)(2112KiB/10114msec) 00:31:50.811 slat (nsec): min=5696, max=95945, avg=18563.96, stdev=17411.14 00:31:50.811 clat (msec): min=74, max=678, avg=306.19, stdev=90.63 00:31:50.811 lat (msec): min=74, max=678, avg=306.21, stdev=90.63 00:31:50.811 clat percentiles (msec): 00:31:50.811 | 1.00th=[ 79], 5.00th=[ 150], 10.00th=[ 165], 20.00th=[ 255], 00:31:50.811 | 30.00th=[ 296], 40.00th=[ 321], 50.00th=[ 326], 60.00th=[ 338], 00:31:50.811 | 70.00th=[ 351], 80.00th=[ 384], 90.00th=[ 405], 95.00th=[ 409], 00:31:50.811 | 99.00th=[ 418], 99.50th=[ 659], 99.90th=[ 676], 99.95th=[ 676], 00:31:50.811 | 99.99th=[ 676] 00:31:50.811 bw ( KiB/s): min= 128, max= 384, per=4.69%, avg=204.80, stdev=76.58, samples=20 00:31:50.811 iops : min= 32, max= 96, avg=51.20, stdev=19.14, samples=20 00:31:50.811 lat (msec) : 100=3.03%, 250=15.91%, 500=80.30%, 750=0.76% 00:31:50.811 cpu : usr=98.85%, sys=0.67%, ctx=27, majf=0, minf=57 00:31:50.811 IO depths : 1=5.7%, 2=11.9%, 4=25.0%, 8=50.6%, 16=6.8%, 32=0.0%, >=64=0.0% 00:31:50.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 issued rwts: total=528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.811 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.811 filename2: (groupid=0, jobs=1): err= 0: pid=2601299: Wed Nov 27 03:26:51 2024 00:31:50.811 read: IOPS=39, BW=159KiB/s (163kB/s)(1600KiB/10081msec) 00:31:50.811 slat (nsec): min=8269, max=71709, avg=29580.99, stdev=13916.61 00:31:50.811 clat (msec): min=179, max=649, avg=402.96, stdev=62.82 00:31:50.811 lat (msec): min=179, max=649, avg=402.99, stdev=62.82 00:31:50.811 clat percentiles (msec): 00:31:50.811 | 1.00th=[ 284], 5.00th=[ 296], 10.00th=[ 330], 20.00th=[ 347], 00:31:50.811 | 30.00th=[ 388], 40.00th=[ 401], 50.00th=[ 409], 60.00th=[ 414], 00:31:50.811 | 70.00th=[ 418], 80.00th=[ 435], 90.00th=[ 468], 95.00th=[ 498], 00:31:50.811 | 99.00th=[ 609], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], 00:31:50.811 | 99.99th=[ 651] 00:31:50.811 bw ( KiB/s): min= 128, max= 256, per=3.52%, avg=153.60, stdev=48.81, samples=20 00:31:50.811 iops : min= 32, max= 64, avg=38.40, stdev=12.20, samples=20 00:31:50.811 lat (msec) : 250=0.50%, 500=94.50%, 750=5.00% 00:31:50.811 cpu : usr=99.01%, sys=0.57%, ctx=14, majf=0, minf=45 00:31:50.811 IO depths : 1=3.5%, 2=9.8%, 4=25.0%, 8=52.8%, 16=9.0%, 32=0.0%, >=64=0.0% 00:31:50.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.811 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.811 filename2: (groupid=0, jobs=1): err= 0: pid=2601300: Wed Nov 27 03:26:51 2024 00:31:50.811 read: IOPS=39, BW=159KiB/s (162kB/s)(1600KiB/10083msec) 00:31:50.811 slat (usec): min=5, max=146, avg=80.92, stdev=35.55 00:31:50.811 clat (msec): min=294, max=599, avg=401.45, stdev=55.71 00:31:50.811 lat (msec): min=294, max=599, avg=401.53, stdev=55.71 00:31:50.811 clat percentiles (msec): 00:31:50.811 | 1.00th=[ 296], 5.00th=[ 305], 10.00th=[ 334], 20.00th=[ 347], 00:31:50.811 | 30.00th=[ 384], 40.00th=[ 401], 50.00th=[ 409], 60.00th=[ 414], 00:31:50.811 | 70.00th=[ 418], 80.00th=[ 439], 90.00th=[ 451], 95.00th=[ 493], 00:31:50.811 | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 600], 99.95th=[ 600], 00:31:50.811 | 99.99th=[ 600] 00:31:50.811 bw ( KiB/s): min= 128, max= 256, per=3.52%, avg=153.60, stdev=50.70, samples=20 00:31:50.811 iops : min= 32, max= 64, avg=38.40, stdev=12.68, samples=20 00:31:50.811 lat (msec) : 500=95.50%, 750=4.50% 00:31:50.811 cpu : usr=98.13%, sys=1.17%, ctx=59, majf=0, minf=57 00:31:50.811 IO depths : 1=4.5%, 2=10.8%, 4=25.0%, 8=51.7%, 16=8.0%, 32=0.0%, >=64=0.0% 00:31:50.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 issued rwts: total=400,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.811 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.811 filename2: (groupid=0, jobs=1): err= 0: pid=2601301: Wed Nov 27 03:26:51 2024 00:31:50.811 read: IOPS=44, BW=178KiB/s (182kB/s)(1792KiB/10063msec) 00:31:50.811 slat (usec): min=6, max=115, avg=26.53, stdev=15.56 00:31:50.811 clat (msec): min=188, max=451, avg=359.13, stdev=62.54 00:31:50.811 lat (msec): min=188, max=451, avg=359.16, stdev=62.54 00:31:50.811 clat percentiles (msec): 00:31:50.811 | 1.00th=[ 188], 5.00th=[ 241], 10.00th=[ 255], 20.00th=[ 309], 00:31:50.811 | 30.00th=[ 334], 40.00th=[ 351], 50.00th=[ 359], 60.00th=[ 393], 00:31:50.811 | 70.00th=[ 409], 80.00th=[ 414], 90.00th=[ 418], 95.00th=[ 430], 00:31:50.811 | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], 00:31:50.811 | 99.99th=[ 451] 00:31:50.811 bw ( KiB/s): min= 128, max= 256, per=3.96%, avg=172.80, stdev=62.64, samples=20 00:31:50.811 iops : min= 32, max= 64, avg=43.20, stdev=15.66, samples=20 00:31:50.811 lat (msec) : 250=7.14%, 500=92.86% 00:31:50.811 cpu : usr=98.41%, sys=1.03%, ctx=100, majf=0, minf=41 00:31:50.811 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:50.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 issued rwts: total=448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.811 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.811 filename2: (groupid=0, jobs=1): err= 0: pid=2601302: Wed Nov 27 03:26:51 2024 00:31:50.811 read: IOPS=44, BW=178KiB/s (182kB/s)(1792KiB/10086msec) 00:31:50.811 slat (usec): min=8, max=137, avg=35.35, stdev=33.57 00:31:50.811 clat (msec): min=88, max=691, avg=359.72, stdev=93.03 00:31:50.811 lat (msec): min=88, max=691, avg=359.75, stdev=93.03 00:31:50.811 clat percentiles (msec): 00:31:50.811 | 1.00th=[ 89], 5.00th=[ 140], 10.00th=[ 271], 20.00th=[ 296], 00:31:50.811 | 30.00th=[ 326], 40.00th=[ 347], 50.00th=[ 393], 60.00th=[ 401], 00:31:50.811 | 70.00th=[ 409], 80.00th=[ 414], 90.00th=[ 418], 95.00th=[ 430], 00:31:50.811 | 99.00th=[ 659], 99.50th=[ 676], 99.90th=[ 693], 99.95th=[ 693], 00:31:50.811 | 99.99th=[ 693] 00:31:50.811 bw ( KiB/s): min= 128, max= 256, per=3.96%, avg=172.80, stdev=57.95, samples=20 00:31:50.811 iops : min= 32, max= 64, avg=43.20, stdev=14.49, samples=20 00:31:50.811 lat (msec) : 100=2.23%, 250=7.14%, 500=86.16%, 750=4.46% 00:31:50.811 cpu : usr=98.37%, sys=0.99%, ctx=120, majf=0, minf=47 00:31:50.811 IO depths : 1=4.0%, 2=9.8%, 4=23.7%, 8=54.0%, 16=8.5%, 32=0.0%, >=64=0.0% 00:31:50.811 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 complete : 0=0.0%, 4=93.6%, 8=0.6%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.811 issued rwts: total=448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.811 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.811 filename2: (groupid=0, jobs=1): err= 0: pid=2601303: Wed Nov 27 03:26:51 2024 00:31:50.811 read: IOPS=44, BW=177KiB/s (182kB/s)(1792KiB/10099msec) 00:31:50.811 slat (nsec): min=8021, max=92457, avg=26893.53, stdev=16187.67 00:31:50.811 clat (msec): min=187, max=477, avg=359.33, stdev=66.74 00:31:50.811 lat (msec): min=187, max=477, avg=359.36, stdev=66.74 00:31:50.811 clat percentiles (msec): 00:31:50.811 | 1.00th=[ 188], 5.00th=[ 234], 10.00th=[ 255], 20.00th=[ 309], 00:31:50.811 | 30.00th=[ 326], 40.00th=[ 347], 50.00th=[ 384], 60.00th=[ 401], 00:31:50.811 | 70.00th=[ 409], 80.00th=[ 414], 90.00th=[ 418], 95.00th=[ 451], 00:31:50.811 | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 477], 99.95th=[ 477], 00:31:50.811 | 99.99th=[ 477] 00:31:50.811 bw ( KiB/s): min= 128, max= 256, per=3.96%, avg=172.80, stdev=57.71, samples=20 00:31:50.811 iops : min= 32, max= 64, avg=43.20, stdev=14.43, samples=20 00:31:50.811 lat (msec) : 250=9.38%, 500=90.62% 00:31:50.812 cpu : usr=98.47%, sys=0.90%, ctx=33, majf=0, minf=44 00:31:50.812 IO depths : 1=4.9%, 2=10.7%, 4=23.7%, 8=53.1%, 16=7.6%, 32=0.0%, >=64=0.0% 00:31:50.812 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.812 complete : 0=0.0%, 4=93.6%, 8=0.6%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.812 issued rwts: total=448,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.812 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.812 filename2: (groupid=0, jobs=1): err= 0: pid=2601304: Wed Nov 27 03:26:51 2024 00:31:50.812 read: IOPS=48, BW=192KiB/s (197kB/s)(1944KiB/10111msec) 00:31:50.812 slat (usec): min=5, max=140, avg=50.62, stdev=38.95 00:31:50.812 clat (msec): min=56, max=471, avg=331.33, stdev=84.86 00:31:50.812 lat (msec): min=56, max=471, avg=331.39, stdev=84.87 00:31:50.812 clat percentiles (msec): 00:31:50.812 | 1.00th=[ 57], 5.00th=[ 144], 10.00th=[ 243], 20.00th=[ 296], 00:31:50.812 | 30.00th=[ 313], 40.00th=[ 317], 50.00th=[ 334], 60.00th=[ 347], 00:31:50.812 | 70.00th=[ 393], 80.00th=[ 409], 90.00th=[ 418], 95.00th=[ 451], 00:31:50.812 | 99.00th=[ 460], 99.50th=[ 468], 99.90th=[ 472], 99.95th=[ 472], 00:31:50.812 | 99.99th=[ 472] 00:31:50.812 bw ( KiB/s): min= 128, max= 384, per=4.32%, avg=188.00, stdev=69.43, samples=20 00:31:50.812 iops : min= 32, max= 96, avg=47.00, stdev=17.36, samples=20 00:31:50.812 lat (msec) : 100=3.29%, 250=8.23%, 500=88.48% 00:31:50.812 cpu : usr=98.66%, sys=0.87%, ctx=25, majf=0, minf=46 00:31:50.812 IO depths : 1=2.9%, 2=7.2%, 4=19.1%, 8=61.1%, 16=9.7%, 32=0.0%, >=64=0.0% 00:31:50.812 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.812 complete : 0=0.0%, 4=92.3%, 8=2.1%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.812 issued rwts: total=486,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.812 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.812 filename2: (groupid=0, jobs=1): err= 0: pid=2601305: Wed Nov 27 03:26:51 2024 00:31:50.812 read: IOPS=47, BW=190KiB/s (194kB/s)(1920KiB/10111msec) 00:31:50.812 slat (usec): min=5, max=158, avg=60.06, stdev=47.54 00:31:50.812 clat (msec): min=153, max=489, avg=335.45, stdev=74.90 00:31:50.812 lat (msec): min=153, max=489, avg=335.51, stdev=74.93 00:31:50.812 clat percentiles (msec): 00:31:50.812 | 1.00th=[ 155], 5.00th=[ 167], 10.00th=[ 201], 20.00th=[ 271], 00:31:50.812 | 30.00th=[ 317], 40.00th=[ 326], 50.00th=[ 351], 60.00th=[ 359], 00:31:50.812 | 70.00th=[ 384], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 414], 00:31:50.812 | 99.00th=[ 418], 99.50th=[ 472], 99.90th=[ 489], 99.95th=[ 489], 00:31:50.812 | 99.99th=[ 489] 00:31:50.812 bw ( KiB/s): min= 128, max= 256, per=4.25%, avg=185.60, stdev=62.38, samples=20 00:31:50.812 iops : min= 32, max= 64, avg=46.40, stdev=15.59, samples=20 00:31:50.812 lat (msec) : 250=13.33%, 500=86.67% 00:31:50.812 cpu : usr=98.53%, sys=0.92%, ctx=38, majf=0, minf=72 00:31:50.812 IO depths : 1=4.2%, 2=10.4%, 4=25.0%, 8=52.1%, 16=8.3%, 32=0.0%, >=64=0.0% 00:31:50.812 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.812 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.812 issued rwts: total=480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.812 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.812 filename2: (groupid=0, jobs=1): err= 0: pid=2601306: Wed Nov 27 03:26:51 2024 00:31:50.812 read: IOPS=41, BW=165KiB/s (169kB/s)(1664KiB/10085msec) 00:31:50.812 slat (usec): min=5, max=107, avg=29.09, stdev=16.88 00:31:50.812 clat (msec): min=182, max=536, avg=387.65, stdev=72.72 00:31:50.812 lat (msec): min=182, max=536, avg=387.67, stdev=72.72 00:31:50.812 clat percentiles (msec): 00:31:50.812 | 1.00th=[ 184], 5.00th=[ 255], 10.00th=[ 296], 20.00th=[ 338], 00:31:50.812 | 30.00th=[ 368], 40.00th=[ 393], 50.00th=[ 409], 60.00th=[ 409], 00:31:50.812 | 70.00th=[ 414], 80.00th=[ 418], 90.00th=[ 451], 95.00th=[ 535], 00:31:50.812 | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], 00:31:50.812 | 99.99th=[ 535] 00:31:50.812 bw ( KiB/s): min= 128, max= 256, per=3.68%, avg=160.00, stdev=49.79, samples=20 00:31:50.812 iops : min= 32, max= 64, avg=40.00, stdev=12.45, samples=20 00:31:50.812 lat (msec) : 250=3.85%, 500=88.94%, 750=7.21% 00:31:50.812 cpu : usr=98.87%, sys=0.65%, ctx=34, majf=0, minf=53 00:31:50.812 IO depths : 1=1.2%, 2=7.5%, 4=25.0%, 8=55.0%, 16=11.3%, 32=0.0%, >=64=0.0% 00:31:50.812 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.812 complete : 0=0.0%, 4=94.4%, 8=0.0%, 16=5.6%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:50.812 issued rwts: total=416,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:50.812 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:50.812 00:31:50.812 Run status group 0 (all jobs): 00:31:50.812 READ: bw=4349KiB/s (4453kB/s), 159KiB/s-252KiB/s (162kB/s-258kB/s), io=43.0MiB (45.0MB), run=10044-10114msec 00:31:50.812 03:26:51 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:31:50.812 03:26:51 -- target/dif.sh@43 -- # local sub 00:31:50.812 03:26:51 -- target/dif.sh@45 -- # for sub in "$@" 00:31:50.812 03:26:51 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:50.812 03:26:51 -- target/dif.sh@36 -- # local sub_id=0 00:31:50.812 03:26:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@45 -- # for sub in "$@" 00:31:50.812 03:26:51 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:50.812 03:26:51 -- target/dif.sh@36 -- # local sub_id=1 00:31:50.812 03:26:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@45 -- # for sub in "$@" 00:31:50.812 03:26:51 -- target/dif.sh@46 -- # destroy_subsystem 2 00:31:50.812 03:26:51 -- target/dif.sh@36 -- # local sub_id=2 00:31:50.812 03:26:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@115 -- # NULL_DIF=1 00:31:50.812 03:26:51 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:31:50.812 03:26:51 -- target/dif.sh@115 -- # numjobs=2 00:31:50.812 03:26:51 -- target/dif.sh@115 -- # iodepth=8 00:31:50.812 03:26:51 -- target/dif.sh@115 -- # runtime=5 00:31:50.812 03:26:51 -- target/dif.sh@115 -- # files=1 00:31:50.812 03:26:51 -- target/dif.sh@117 -- # create_subsystems 0 1 00:31:50.812 03:26:51 -- target/dif.sh@28 -- # local sub 00:31:50.812 03:26:51 -- target/dif.sh@30 -- # for sub in "$@" 00:31:50.812 03:26:51 -- target/dif.sh@31 -- # create_subsystem 0 00:31:50.812 03:26:51 -- target/dif.sh@18 -- # local sub_id=0 00:31:50.812 03:26:51 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 bdev_null0 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 [2024-11-27 03:26:51.601101] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@30 -- # for sub in "$@" 00:31:50.812 03:26:51 -- target/dif.sh@31 -- # create_subsystem 1 00:31:50.812 03:26:51 -- target/dif.sh@18 -- # local sub_id=1 00:31:50.812 03:26:51 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 bdev_null1 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:50.812 03:26:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:50.812 03:26:51 -- common/autotest_common.sh@10 -- # set +x 00:31:50.812 03:26:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:50.812 03:26:51 -- target/dif.sh@118 -- # fio /dev/fd/62 00:31:50.812 03:26:51 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:31:50.812 03:26:51 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:50.813 03:26:51 -- nvmf/common.sh@520 -- # config=() 00:31:50.813 03:26:51 -- nvmf/common.sh@520 -- # local subsystem config 00:31:50.813 03:26:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:50.813 03:26:51 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:50.813 03:26:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:50.813 { 00:31:50.813 "params": { 00:31:50.813 "name": "Nvme$subsystem", 00:31:50.813 "trtype": "$TEST_TRANSPORT", 00:31:50.813 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:50.813 "adrfam": "ipv4", 00:31:50.813 "trsvcid": "$NVMF_PORT", 00:31:50.813 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:50.813 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:50.813 "hdgst": ${hdgst:-false}, 00:31:50.813 "ddgst": ${ddgst:-false} 00:31:50.813 }, 00:31:50.813 "method": "bdev_nvme_attach_controller" 00:31:50.813 } 00:31:50.813 EOF 00:31:50.813 )") 00:31:50.813 03:26:51 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:50.813 03:26:51 -- target/dif.sh@82 -- # gen_fio_conf 00:31:50.813 03:26:51 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:50.813 03:26:51 -- target/dif.sh@54 -- # local file 00:31:50.813 03:26:51 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:50.813 03:26:51 -- target/dif.sh@56 -- # cat 00:31:50.813 03:26:51 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:50.813 03:26:51 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:50.813 03:26:51 -- common/autotest_common.sh@1330 -- # shift 00:31:50.813 03:26:51 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:50.813 03:26:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:50.813 03:26:51 -- nvmf/common.sh@542 -- # cat 00:31:50.813 03:26:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:50.813 03:26:51 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:50.813 03:26:51 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:50.813 03:26:51 -- target/dif.sh@72 -- # (( file <= files )) 00:31:50.813 03:26:51 -- target/dif.sh@73 -- # cat 00:31:50.813 03:26:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:50.813 03:26:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:50.813 03:26:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:50.813 { 00:31:50.813 "params": { 00:31:50.813 "name": "Nvme$subsystem", 00:31:50.813 "trtype": "$TEST_TRANSPORT", 00:31:50.813 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:50.813 "adrfam": "ipv4", 00:31:50.813 "trsvcid": "$NVMF_PORT", 00:31:50.813 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:50.813 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:50.813 "hdgst": ${hdgst:-false}, 00:31:50.813 "ddgst": ${ddgst:-false} 00:31:50.813 }, 00:31:50.813 "method": "bdev_nvme_attach_controller" 00:31:50.813 } 00:31:50.813 EOF 00:31:50.813 )") 00:31:50.813 03:26:51 -- nvmf/common.sh@542 -- # cat 00:31:50.813 03:26:51 -- target/dif.sh@72 -- # (( file++ )) 00:31:50.813 03:26:51 -- target/dif.sh@72 -- # (( file <= files )) 00:31:50.813 03:26:51 -- nvmf/common.sh@544 -- # jq . 00:31:50.813 03:26:51 -- nvmf/common.sh@545 -- # IFS=, 00:31:50.813 03:26:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:50.813 "params": { 00:31:50.813 "name": "Nvme0", 00:31:50.813 "trtype": "tcp", 00:31:50.813 "traddr": "10.0.0.2", 00:31:50.813 "adrfam": "ipv4", 00:31:50.813 "trsvcid": "4420", 00:31:50.813 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:50.813 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:50.813 "hdgst": false, 00:31:50.813 "ddgst": false 00:31:50.813 }, 00:31:50.813 "method": "bdev_nvme_attach_controller" 00:31:50.813 },{ 00:31:50.813 "params": { 00:31:50.813 "name": "Nvme1", 00:31:50.813 "trtype": "tcp", 00:31:50.813 "traddr": "10.0.0.2", 00:31:50.813 "adrfam": "ipv4", 00:31:50.813 "trsvcid": "4420", 00:31:50.813 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:50.813 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:50.813 "hdgst": false, 00:31:50.813 "ddgst": false 00:31:50.813 }, 00:31:50.813 "method": "bdev_nvme_attach_controller" 00:31:50.813 }' 00:31:50.813 03:26:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:50.813 03:26:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:50.813 03:26:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:50.813 03:26:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:50.813 03:26:51 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:50.813 03:26:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:50.813 03:26:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:50.813 03:26:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:50.813 03:26:51 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:50.813 03:26:51 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:50.813 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:50.813 ... 00:31:50.813 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:50.813 ... 00:31:50.813 fio-3.35 00:31:50.813 Starting 4 threads 00:31:50.813 EAL: No free 2048 kB hugepages reported on node 1 00:31:50.813 [2024-11-27 03:26:52.536184] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:50.813 [2024-11-27 03:26:52.536273] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:56.076 00:31:56.076 filename0: (groupid=0, jobs=1): err= 0: pid=2602728: Wed Nov 27 03:26:57 2024 00:31:56.076 read: IOPS=1775, BW=13.9MiB/s (14.5MB/s)(69.4MiB/5001msec) 00:31:56.076 slat (nsec): min=6983, max=82367, avg=19401.91, stdev=10098.52 00:31:56.076 clat (usec): min=974, max=8217, avg=4436.62, stdev=565.79 00:31:56.076 lat (usec): min=987, max=8232, avg=4456.02, stdev=566.08 00:31:56.076 clat percentiles (usec): 00:31:56.076 | 1.00th=[ 2966], 5.00th=[ 3720], 10.00th=[ 3916], 20.00th=[ 4146], 00:31:56.076 | 30.00th=[ 4228], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4555], 00:31:56.076 | 70.00th=[ 4621], 80.00th=[ 4686], 90.00th=[ 4817], 95.00th=[ 5014], 00:31:56.076 | 99.00th=[ 6783], 99.50th=[ 7308], 99.90th=[ 7701], 99.95th=[ 7963], 00:31:56.076 | 99.99th=[ 8225] 00:31:56.076 bw ( KiB/s): min=13632, max=14864, per=25.11%, avg=14154.67, stdev=464.00, samples=9 00:31:56.076 iops : min= 1704, max= 1858, avg=1769.33, stdev=58.00, samples=9 00:31:56.076 lat (usec) : 1000=0.01% 00:31:56.076 lat (msec) : 2=0.39%, 4=11.51%, 10=88.09% 00:31:56.076 cpu : usr=95.48%, sys=4.04%, ctx=7, majf=0, minf=46 00:31:56.076 IO depths : 1=0.3%, 2=15.8%, 4=56.8%, 8=27.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.076 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.076 complete : 0=0.0%, 4=91.9%, 8=8.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.077 issued rwts: total=8881,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.077 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:56.077 filename0: (groupid=0, jobs=1): err= 0: pid=2602729: Wed Nov 27 03:26:57 2024 00:31:56.077 read: IOPS=1779, BW=13.9MiB/s (14.6MB/s)(69.6MiB/5002msec) 00:31:56.077 slat (nsec): min=6887, max=87816, avg=19858.60, stdev=10196.16 00:31:56.077 clat (usec): min=975, max=7950, avg=4420.68, stdev=570.96 00:31:56.077 lat (usec): min=987, max=7974, avg=4440.53, stdev=571.43 00:31:56.077 clat percentiles (usec): 00:31:56.077 | 1.00th=[ 2474], 5.00th=[ 3687], 10.00th=[ 3916], 20.00th=[ 4146], 00:31:56.077 | 30.00th=[ 4228], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4490], 00:31:56.077 | 70.00th=[ 4621], 80.00th=[ 4686], 90.00th=[ 4817], 95.00th=[ 5145], 00:31:56.077 | 99.00th=[ 6521], 99.50th=[ 6980], 99.90th=[ 7701], 99.95th=[ 7767], 00:31:56.077 | 99.99th=[ 7963] 00:31:56.077 bw ( KiB/s): min=13584, max=14976, per=25.25%, avg=14232.00, stdev=502.31, samples=10 00:31:56.077 iops : min= 1698, max= 1872, avg=1779.00, stdev=62.79, samples=10 00:31:56.077 lat (usec) : 1000=0.01% 00:31:56.077 lat (msec) : 2=0.57%, 4=11.25%, 10=88.16% 00:31:56.077 cpu : usr=95.74%, sys=3.80%, ctx=12, majf=0, minf=85 00:31:56.077 IO depths : 1=0.6%, 2=17.9%, 4=55.3%, 8=26.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.077 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.077 complete : 0=0.0%, 4=91.4%, 8=8.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.077 issued rwts: total=8903,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.077 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:56.077 filename1: (groupid=0, jobs=1): err= 0: pid=2602730: Wed Nov 27 03:26:57 2024 00:31:56.077 read: IOPS=1739, BW=13.6MiB/s (14.3MB/s)(68.5MiB/5042msec) 00:31:56.077 slat (nsec): min=7109, max=88554, avg=20381.80, stdev=10252.67 00:31:56.077 clat (usec): min=790, max=44853, avg=4512.25, stdev=1246.40 00:31:56.077 lat (usec): min=802, max=44893, avg=4532.63, stdev=1246.36 00:31:56.077 clat percentiles (usec): 00:31:56.077 | 1.00th=[ 1893], 5.00th=[ 3720], 10.00th=[ 4015], 20.00th=[ 4178], 00:31:56.077 | 30.00th=[ 4293], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4555], 00:31:56.077 | 70.00th=[ 4621], 80.00th=[ 4752], 90.00th=[ 4948], 95.00th=[ 5538], 00:31:56.077 | 99.00th=[ 7177], 99.50th=[ 7635], 99.90th=[ 8356], 99.95th=[44827], 00:31:56.077 | 99.99th=[44827] 00:31:56.077 bw ( KiB/s): min=13360, max=15024, per=24.89%, avg=14028.20, stdev=603.18, samples=10 00:31:56.077 iops : min= 1670, max= 1878, avg=1753.50, stdev=75.43, samples=10 00:31:56.077 lat (usec) : 1000=0.13% 00:31:56.077 lat (msec) : 2=0.92%, 4=8.47%, 10=90.41%, 50=0.07% 00:31:56.077 cpu : usr=96.19%, sys=3.33%, ctx=10, majf=0, minf=127 00:31:56.077 IO depths : 1=0.1%, 2=18.2%, 4=54.9%, 8=26.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.077 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.077 complete : 0=0.0%, 4=91.5%, 8=8.5%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.077 issued rwts: total=8772,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.077 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:56.077 filename1: (groupid=0, jobs=1): err= 0: pid=2602731: Wed Nov 27 03:26:57 2024 00:31:56.077 read: IOPS=1791, BW=14.0MiB/s (14.7MB/s)(70.0MiB/5004msec) 00:31:56.077 slat (nsec): min=5171, max=81694, avg=19937.04, stdev=9518.48 00:31:56.077 clat (usec): min=926, max=8554, avg=4396.16, stdev=550.99 00:31:56.077 lat (usec): min=944, max=8584, avg=4416.10, stdev=552.27 00:31:56.077 clat percentiles (usec): 00:31:56.077 | 1.00th=[ 2769], 5.00th=[ 3589], 10.00th=[ 3884], 20.00th=[ 4113], 00:31:56.077 | 30.00th=[ 4228], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4490], 00:31:56.077 | 70.00th=[ 4621], 80.00th=[ 4686], 90.00th=[ 4817], 95.00th=[ 4948], 00:31:56.077 | 99.00th=[ 6390], 99.50th=[ 7373], 99.90th=[ 7963], 99.95th=[ 8094], 00:31:56.077 | 99.99th=[ 8586] 00:31:56.077 bw ( KiB/s): min=13616, max=15248, per=25.43%, avg=14332.40, stdev=624.24, samples=10 00:31:56.077 iops : min= 1702, max= 1906, avg=1791.50, stdev=78.02, samples=10 00:31:56.077 lat (usec) : 1000=0.03% 00:31:56.077 lat (msec) : 2=0.35%, 4=13.45%, 10=86.17% 00:31:56.077 cpu : usr=95.50%, sys=3.98%, ctx=10, majf=0, minf=94 00:31:56.077 IO depths : 1=0.5%, 2=15.7%, 4=57.3%, 8=26.5%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:56.077 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.077 complete : 0=0.0%, 4=91.6%, 8=8.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:56.077 issued rwts: total=8964,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:56.077 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:56.077 00:31:56.077 Run status group 0 (all jobs): 00:31:56.077 READ: bw=55.0MiB/s (57.7MB/s), 13.6MiB/s-14.0MiB/s (14.3MB/s-14.7MB/s), io=278MiB (291MB), run=5001-5042msec 00:31:56.077 03:26:57 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:31:56.077 03:26:57 -- target/dif.sh@43 -- # local sub 00:31:56.077 03:26:57 -- target/dif.sh@45 -- # for sub in "$@" 00:31:56.077 03:26:57 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:56.077 03:26:57 -- target/dif.sh@36 -- # local sub_id=0 00:31:56.077 03:26:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:56.077 03:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.077 03:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 03:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.077 03:26:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:56.077 03:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.077 03:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 03:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.077 03:26:57 -- target/dif.sh@45 -- # for sub in "$@" 00:31:56.077 03:26:57 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:56.077 03:26:57 -- target/dif.sh@36 -- # local sub_id=1 00:31:56.077 03:26:57 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:56.077 03:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.077 03:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 03:26:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.077 03:26:57 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:56.077 03:26:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.077 03:26:57 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 03:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.077 00:31:56.077 real 0m24.388s 00:31:56.077 user 4m35.952s 00:31:56.077 sys 0m5.021s 00:31:56.077 03:26:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:56.077 03:26:58 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 ************************************ 00:31:56.077 END TEST fio_dif_rand_params 00:31:56.077 ************************************ 00:31:56.077 03:26:58 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:31:56.077 03:26:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:56.077 03:26:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:56.077 03:26:58 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 ************************************ 00:31:56.077 START TEST fio_dif_digest 00:31:56.077 ************************************ 00:31:56.077 03:26:58 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:31:56.077 03:26:58 -- target/dif.sh@123 -- # local NULL_DIF 00:31:56.077 03:26:58 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:31:56.077 03:26:58 -- target/dif.sh@125 -- # local hdgst ddgst 00:31:56.077 03:26:58 -- target/dif.sh@127 -- # NULL_DIF=3 00:31:56.077 03:26:58 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:31:56.077 03:26:58 -- target/dif.sh@127 -- # numjobs=3 00:31:56.077 03:26:58 -- target/dif.sh@127 -- # iodepth=3 00:31:56.077 03:26:58 -- target/dif.sh@127 -- # runtime=10 00:31:56.077 03:26:58 -- target/dif.sh@128 -- # hdgst=true 00:31:56.077 03:26:58 -- target/dif.sh@128 -- # ddgst=true 00:31:56.077 03:26:58 -- target/dif.sh@130 -- # create_subsystems 0 00:31:56.077 03:26:58 -- target/dif.sh@28 -- # local sub 00:31:56.077 03:26:58 -- target/dif.sh@30 -- # for sub in "$@" 00:31:56.077 03:26:58 -- target/dif.sh@31 -- # create_subsystem 0 00:31:56.077 03:26:58 -- target/dif.sh@18 -- # local sub_id=0 00:31:56.077 03:26:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:56.077 03:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.077 03:26:58 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 bdev_null0 00:31:56.077 03:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.077 03:26:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:56.077 03:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.077 03:26:58 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 03:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.077 03:26:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:56.077 03:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.077 03:26:58 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 03:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.077 03:26:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:56.077 03:26:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:56.077 03:26:58 -- common/autotest_common.sh@10 -- # set +x 00:31:56.077 [2024-11-27 03:26:58.058944] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:56.077 03:26:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:56.077 03:26:58 -- target/dif.sh@131 -- # fio /dev/fd/62 00:31:56.077 03:26:58 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:31:56.077 03:26:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:56.077 03:26:58 -- nvmf/common.sh@520 -- # config=() 00:31:56.077 03:26:58 -- nvmf/common.sh@520 -- # local subsystem config 00:31:56.077 03:26:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:56.077 03:26:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:56.077 { 00:31:56.077 "params": { 00:31:56.077 "name": "Nvme$subsystem", 00:31:56.077 "trtype": "$TEST_TRANSPORT", 00:31:56.077 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:56.077 "adrfam": "ipv4", 00:31:56.077 "trsvcid": "$NVMF_PORT", 00:31:56.077 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:56.077 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:56.077 "hdgst": ${hdgst:-false}, 00:31:56.077 "ddgst": ${ddgst:-false} 00:31:56.077 }, 00:31:56.077 "method": "bdev_nvme_attach_controller" 00:31:56.077 } 00:31:56.077 EOF 00:31:56.077 )") 00:31:56.078 03:26:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:56.078 03:26:58 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:56.078 03:26:58 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:56.078 03:26:58 -- target/dif.sh@82 -- # gen_fio_conf 00:31:56.078 03:26:58 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:56.078 03:26:58 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:56.078 03:26:58 -- target/dif.sh@54 -- # local file 00:31:56.078 03:26:58 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:56.078 03:26:58 -- target/dif.sh@56 -- # cat 00:31:56.078 03:26:58 -- common/autotest_common.sh@1330 -- # shift 00:31:56.078 03:26:58 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:56.078 03:26:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:56.078 03:26:58 -- nvmf/common.sh@542 -- # cat 00:31:56.078 03:26:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:56.078 03:26:58 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:56.078 03:26:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:56.078 03:26:58 -- target/dif.sh@72 -- # (( file <= files )) 00:31:56.078 03:26:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:56.078 03:26:58 -- nvmf/common.sh@544 -- # jq . 00:31:56.078 03:26:58 -- nvmf/common.sh@545 -- # IFS=, 00:31:56.078 03:26:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:56.078 "params": { 00:31:56.078 "name": "Nvme0", 00:31:56.078 "trtype": "tcp", 00:31:56.078 "traddr": "10.0.0.2", 00:31:56.078 "adrfam": "ipv4", 00:31:56.078 "trsvcid": "4420", 00:31:56.078 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:56.078 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:56.078 "hdgst": true, 00:31:56.078 "ddgst": true 00:31:56.078 }, 00:31:56.078 "method": "bdev_nvme_attach_controller" 00:31:56.078 }' 00:31:56.078 03:26:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:56.078 03:26:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:56.078 03:26:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:56.078 03:26:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:56.078 03:26:58 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:56.078 03:26:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:56.078 03:26:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:56.078 03:26:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:56.078 03:26:58 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:56.078 03:26:58 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:56.078 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:56.078 ... 00:31:56.078 fio-3.35 00:31:56.078 Starting 3 threads 00:31:56.078 EAL: No free 2048 kB hugepages reported on node 1 00:31:56.336 [2024-11-27 03:26:58.743782] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:56.336 [2024-11-27 03:26:58.743864] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:06.298 00:32:06.298 filename0: (groupid=0, jobs=1): err= 0: pid=2603571: Wed Nov 27 03:27:08 2024 00:32:06.298 read: IOPS=221, BW=27.7MiB/s (29.1MB/s)(279MiB/10047msec) 00:32:06.298 slat (nsec): min=5125, max=39943, avg=16591.63, stdev=3448.01 00:32:06.298 clat (usec): min=10409, max=51096, avg=13476.97, stdev=1441.47 00:32:06.298 lat (usec): min=10446, max=51114, avg=13493.56, stdev=1441.44 00:32:06.298 clat percentiles (usec): 00:32:06.298 | 1.00th=[11076], 5.00th=[11863], 10.00th=[12256], 20.00th=[12649], 00:32:06.298 | 30.00th=[12911], 40.00th=[13173], 50.00th=[13435], 60.00th=[13698], 00:32:06.298 | 70.00th=[13960], 80.00th=[14222], 90.00th=[14615], 95.00th=[15008], 00:32:06.298 | 99.00th=[15926], 99.50th=[16450], 99.90th=[20055], 99.95th=[46924], 00:32:06.298 | 99.99th=[51119] 00:32:06.298 bw ( KiB/s): min=27648, max=29440, per=34.89%, avg=28505.60, stdev=507.09, samples=20 00:32:06.298 iops : min= 216, max= 230, avg=222.70, stdev= 3.96, samples=20 00:32:06.298 lat (msec) : 20=99.78%, 50=0.18%, 100=0.04% 00:32:06.298 cpu : usr=94.10%, sys=4.91%, ctx=393, majf=0, minf=139 00:32:06.298 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.298 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.298 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.298 issued rwts: total=2230,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.298 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:06.298 filename0: (groupid=0, jobs=1): err= 0: pid=2603572: Wed Nov 27 03:27:08 2024 00:32:06.298 read: IOPS=209, BW=26.2MiB/s (27.5MB/s)(263MiB/10045msec) 00:32:06.298 slat (nsec): min=4458, max=75217, avg=17062.18, stdev=4139.07 00:32:06.298 clat (usec): min=10998, max=54541, avg=14274.99, stdev=1567.27 00:32:06.298 lat (usec): min=11017, max=54562, avg=14292.05, stdev=1567.44 00:32:06.299 clat percentiles (usec): 00:32:06.299 | 1.00th=[11994], 5.00th=[12649], 10.00th=[13042], 20.00th=[13435], 00:32:06.299 | 30.00th=[13829], 40.00th=[13960], 50.00th=[14222], 60.00th=[14353], 00:32:06.299 | 70.00th=[14746], 80.00th=[15008], 90.00th=[15401], 95.00th=[15795], 00:32:06.299 | 99.00th=[16909], 99.50th=[17171], 99.90th=[21103], 99.95th=[52691], 00:32:06.299 | 99.99th=[54789] 00:32:06.299 bw ( KiB/s): min=26112, max=27904, per=32.96%, avg=26921.00, stdev=495.95, samples=20 00:32:06.299 iops : min= 204, max= 218, avg=210.30, stdev= 3.91, samples=20 00:32:06.299 lat (msec) : 20=99.76%, 50=0.14%, 100=0.10% 00:32:06.299 cpu : usr=94.83%, sys=4.68%, ctx=18, majf=0, minf=226 00:32:06.299 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.299 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.299 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.299 issued rwts: total=2105,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.299 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:06.299 filename0: (groupid=0, jobs=1): err= 0: pid=2603574: Wed Nov 27 03:27:08 2024 00:32:06.299 read: IOPS=206, BW=25.8MiB/s (27.1MB/s)(260MiB/10046msec) 00:32:06.299 slat (nsec): min=4419, max=51304, avg=17684.03, stdev=5014.21 00:32:06.299 clat (usec): min=11392, max=52141, avg=14469.32, stdev=1447.68 00:32:06.299 lat (usec): min=11406, max=52156, avg=14487.00, stdev=1447.69 00:32:06.299 clat percentiles (usec): 00:32:06.299 | 1.00th=[12256], 5.00th=[13042], 10.00th=[13304], 20.00th=[13698], 00:32:06.299 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14353], 60.00th=[14615], 00:32:06.299 | 70.00th=[14877], 80.00th=[15270], 90.00th=[15664], 95.00th=[15926], 00:32:06.299 | 99.00th=[16909], 99.50th=[17433], 99.90th=[21103], 99.95th=[47449], 00:32:06.299 | 99.99th=[52167] 00:32:06.299 bw ( KiB/s): min=25856, max=27392, per=32.50%, avg=26547.20, stdev=416.12, samples=20 00:32:06.299 iops : min= 202, max= 214, avg=207.40, stdev= 3.25, samples=20 00:32:06.299 lat (msec) : 20=99.81%, 50=0.14%, 100=0.05% 00:32:06.299 cpu : usr=90.73%, sys=6.46%, ctx=539, majf=0, minf=166 00:32:06.299 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:06.299 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.299 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.299 issued rwts: total=2077,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.299 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:06.299 00:32:06.299 Run status group 0 (all jobs): 00:32:06.299 READ: bw=79.8MiB/s (83.7MB/s), 25.8MiB/s-27.7MiB/s (27.1MB/s-29.1MB/s), io=802MiB (840MB), run=10045-10047msec 00:32:06.557 03:27:09 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:06.557 03:27:09 -- target/dif.sh@43 -- # local sub 00:32:06.557 03:27:09 -- target/dif.sh@45 -- # for sub in "$@" 00:32:06.557 03:27:09 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:06.557 03:27:09 -- target/dif.sh@36 -- # local sub_id=0 00:32:06.557 03:27:09 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:06.557 03:27:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.557 03:27:09 -- common/autotest_common.sh@10 -- # set +x 00:32:06.557 03:27:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.557 03:27:09 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:06.557 03:27:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.557 03:27:09 -- common/autotest_common.sh@10 -- # set +x 00:32:06.557 03:27:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.557 00:32:06.557 real 0m11.082s 00:32:06.557 user 0m29.145s 00:32:06.557 sys 0m1.903s 00:32:06.557 03:27:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:06.557 03:27:09 -- common/autotest_common.sh@10 -- # set +x 00:32:06.557 ************************************ 00:32:06.557 END TEST fio_dif_digest 00:32:06.557 ************************************ 00:32:06.557 03:27:09 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:06.557 03:27:09 -- target/dif.sh@147 -- # nvmftestfini 00:32:06.557 03:27:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:06.557 03:27:09 -- nvmf/common.sh@116 -- # sync 00:32:06.557 03:27:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:06.557 03:27:09 -- nvmf/common.sh@119 -- # set +e 00:32:06.557 03:27:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:06.557 03:27:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:06.557 rmmod nvme_tcp 00:32:06.557 rmmod nvme_fabrics 00:32:06.557 rmmod nvme_keyring 00:32:06.815 03:27:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:06.815 03:27:09 -- nvmf/common.sh@123 -- # set -e 00:32:06.815 03:27:09 -- nvmf/common.sh@124 -- # return 0 00:32:06.815 03:27:09 -- nvmf/common.sh@477 -- # '[' -n 2597153 ']' 00:32:06.815 03:27:09 -- nvmf/common.sh@478 -- # killprocess 2597153 00:32:06.815 03:27:09 -- common/autotest_common.sh@936 -- # '[' -z 2597153 ']' 00:32:06.815 03:27:09 -- common/autotest_common.sh@940 -- # kill -0 2597153 00:32:06.815 03:27:09 -- common/autotest_common.sh@941 -- # uname 00:32:06.815 03:27:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:06.815 03:27:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2597153 00:32:06.815 03:27:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:06.815 03:27:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:06.815 03:27:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2597153' 00:32:06.815 killing process with pid 2597153 00:32:06.815 03:27:09 -- common/autotest_common.sh@955 -- # kill 2597153 00:32:06.815 03:27:09 -- common/autotest_common.sh@960 -- # wait 2597153 00:32:07.073 03:27:09 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:07.073 03:27:09 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:08.007 Waiting for block devices as requested 00:32:08.007 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:08.266 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:08.266 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:08.523 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:08.523 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:08.523 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:08.523 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:08.781 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:08.781 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:08.781 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:08.781 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:09.040 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:09.040 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:09.040 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:09.040 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:09.299 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:09.299 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:09.299 03:27:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:09.299 03:27:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:09.299 03:27:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:09.299 03:27:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:09.299 03:27:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:09.299 03:27:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:09.299 03:27:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:11.870 03:27:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:11.870 00:32:11.870 real 1m7.509s 00:32:11.870 user 6m33.436s 00:32:11.870 sys 0m15.986s 00:32:11.870 03:27:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:11.870 03:27:13 -- common/autotest_common.sh@10 -- # set +x 00:32:11.870 ************************************ 00:32:11.870 END TEST nvmf_dif 00:32:11.870 ************************************ 00:32:11.870 03:27:13 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:11.870 03:27:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:11.870 03:27:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:11.870 03:27:13 -- common/autotest_common.sh@10 -- # set +x 00:32:11.870 ************************************ 00:32:11.870 START TEST nvmf_abort_qd_sizes 00:32:11.870 ************************************ 00:32:11.870 03:27:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:11.870 * Looking for test storage... 00:32:11.870 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:11.870 03:27:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:11.870 03:27:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:11.870 03:27:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:11.870 03:27:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:11.870 03:27:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:11.870 03:27:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:11.870 03:27:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:11.870 03:27:14 -- scripts/common.sh@335 -- # IFS=.-: 00:32:11.870 03:27:14 -- scripts/common.sh@335 -- # read -ra ver1 00:32:11.870 03:27:14 -- scripts/common.sh@336 -- # IFS=.-: 00:32:11.870 03:27:14 -- scripts/common.sh@336 -- # read -ra ver2 00:32:11.870 03:27:14 -- scripts/common.sh@337 -- # local 'op=<' 00:32:11.870 03:27:14 -- scripts/common.sh@339 -- # ver1_l=2 00:32:11.870 03:27:14 -- scripts/common.sh@340 -- # ver2_l=1 00:32:11.870 03:27:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:11.870 03:27:14 -- scripts/common.sh@343 -- # case "$op" in 00:32:11.870 03:27:14 -- scripts/common.sh@344 -- # : 1 00:32:11.870 03:27:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:11.870 03:27:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:11.870 03:27:14 -- scripts/common.sh@364 -- # decimal 1 00:32:11.870 03:27:14 -- scripts/common.sh@352 -- # local d=1 00:32:11.870 03:27:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:11.870 03:27:14 -- scripts/common.sh@354 -- # echo 1 00:32:11.870 03:27:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:11.870 03:27:14 -- scripts/common.sh@365 -- # decimal 2 00:32:11.870 03:27:14 -- scripts/common.sh@352 -- # local d=2 00:32:11.870 03:27:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:11.870 03:27:14 -- scripts/common.sh@354 -- # echo 2 00:32:11.870 03:27:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:11.870 03:27:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:11.870 03:27:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:11.870 03:27:14 -- scripts/common.sh@367 -- # return 0 00:32:11.871 03:27:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:11.871 03:27:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:11.871 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:11.871 --rc genhtml_branch_coverage=1 00:32:11.871 --rc genhtml_function_coverage=1 00:32:11.871 --rc genhtml_legend=1 00:32:11.871 --rc geninfo_all_blocks=1 00:32:11.871 --rc geninfo_unexecuted_blocks=1 00:32:11.871 00:32:11.871 ' 00:32:11.871 03:27:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:11.871 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:11.871 --rc genhtml_branch_coverage=1 00:32:11.871 --rc genhtml_function_coverage=1 00:32:11.871 --rc genhtml_legend=1 00:32:11.871 --rc geninfo_all_blocks=1 00:32:11.871 --rc geninfo_unexecuted_blocks=1 00:32:11.871 00:32:11.871 ' 00:32:11.871 03:27:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:11.871 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:11.871 --rc genhtml_branch_coverage=1 00:32:11.871 --rc genhtml_function_coverage=1 00:32:11.871 --rc genhtml_legend=1 00:32:11.871 --rc geninfo_all_blocks=1 00:32:11.871 --rc geninfo_unexecuted_blocks=1 00:32:11.871 00:32:11.871 ' 00:32:11.871 03:27:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:11.871 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:11.871 --rc genhtml_branch_coverage=1 00:32:11.871 --rc genhtml_function_coverage=1 00:32:11.871 --rc genhtml_legend=1 00:32:11.871 --rc geninfo_all_blocks=1 00:32:11.871 --rc geninfo_unexecuted_blocks=1 00:32:11.871 00:32:11.871 ' 00:32:11.871 03:27:14 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:11.871 03:27:14 -- nvmf/common.sh@7 -- # uname -s 00:32:11.871 03:27:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:11.871 03:27:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:11.871 03:27:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:11.871 03:27:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:11.871 03:27:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:11.871 03:27:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:11.871 03:27:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:11.871 03:27:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:11.871 03:27:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:11.871 03:27:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:11.871 03:27:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:11.871 03:27:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:11.871 03:27:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:11.871 03:27:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:11.871 03:27:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:11.871 03:27:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:11.871 03:27:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:11.871 03:27:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:11.871 03:27:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:11.871 03:27:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:11.871 03:27:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:11.871 03:27:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:11.871 03:27:14 -- paths/export.sh@5 -- # export PATH 00:32:11.871 03:27:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:11.871 03:27:14 -- nvmf/common.sh@46 -- # : 0 00:32:11.871 03:27:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:11.871 03:27:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:11.871 03:27:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:11.871 03:27:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:11.871 03:27:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:11.871 03:27:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:11.871 03:27:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:11.871 03:27:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:11.871 03:27:14 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:11.871 03:27:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:11.871 03:27:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:11.871 03:27:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:11.871 03:27:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:11.871 03:27:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:11.871 03:27:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:11.871 03:27:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:11.871 03:27:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:11.871 03:27:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:11.871 03:27:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:11.871 03:27:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:11.871 03:27:14 -- common/autotest_common.sh@10 -- # set +x 00:32:13.779 03:27:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:13.779 03:27:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:13.779 03:27:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:13.779 03:27:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:13.779 03:27:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:13.779 03:27:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:13.779 03:27:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:13.779 03:27:16 -- nvmf/common.sh@294 -- # net_devs=() 00:32:13.779 03:27:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:13.779 03:27:16 -- nvmf/common.sh@295 -- # e810=() 00:32:13.779 03:27:16 -- nvmf/common.sh@295 -- # local -ga e810 00:32:13.779 03:27:16 -- nvmf/common.sh@296 -- # x722=() 00:32:13.779 03:27:16 -- nvmf/common.sh@296 -- # local -ga x722 00:32:13.779 03:27:16 -- nvmf/common.sh@297 -- # mlx=() 00:32:13.779 03:27:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:13.779 03:27:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:13.779 03:27:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:13.779 03:27:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:13.779 03:27:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:13.779 03:27:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:13.779 03:27:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:13.779 03:27:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:13.779 03:27:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:13.779 03:27:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:13.779 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:13.779 03:27:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:13.779 03:27:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:13.779 03:27:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:13.779 03:27:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:13.780 03:27:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:13.780 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:13.780 03:27:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:13.780 03:27:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:13.780 03:27:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:13.780 03:27:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:13.780 03:27:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:13.780 03:27:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:13.780 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:13.780 03:27:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:13.780 03:27:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:13.780 03:27:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:13.780 03:27:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:13.780 03:27:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:13.780 03:27:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:13.780 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:13.780 03:27:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:13.780 03:27:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:13.780 03:27:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:13.780 03:27:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:13.780 03:27:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:13.780 03:27:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:13.780 03:27:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:13.780 03:27:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:13.780 03:27:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:13.780 03:27:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:13.780 03:27:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:13.780 03:27:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:13.780 03:27:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:13.780 03:27:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:13.780 03:27:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:13.780 03:27:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:13.780 03:27:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:13.780 03:27:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:13.780 03:27:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:13.780 03:27:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:13.780 03:27:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:13.780 03:27:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:13.780 03:27:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:13.780 03:27:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:13.780 03:27:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:13.780 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:13.780 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:32:13.780 00:32:13.780 --- 10.0.0.2 ping statistics --- 00:32:13.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:13.780 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:32:13.780 03:27:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:13.780 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:13.780 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:32:13.780 00:32:13.780 --- 10.0.0.1 ping statistics --- 00:32:13.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:13.780 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:32:13.780 03:27:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:13.780 03:27:16 -- nvmf/common.sh@410 -- # return 0 00:32:13.780 03:27:16 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:13.780 03:27:16 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:15.159 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:15.159 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:15.159 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:15.159 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:15.159 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:15.159 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:15.159 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:15.159 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:15.159 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:15.159 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:15.159 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:15.159 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:15.159 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:15.159 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:15.159 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:15.159 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:16.096 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:16.096 03:27:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:16.096 03:27:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:16.096 03:27:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:16.096 03:27:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:16.096 03:27:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:16.096 03:27:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:16.096 03:27:18 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:16.096 03:27:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:16.096 03:27:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:16.096 03:27:18 -- common/autotest_common.sh@10 -- # set +x 00:32:16.096 03:27:18 -- nvmf/common.sh@469 -- # nvmfpid=2609144 00:32:16.096 03:27:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:16.096 03:27:18 -- nvmf/common.sh@470 -- # waitforlisten 2609144 00:32:16.096 03:27:18 -- common/autotest_common.sh@829 -- # '[' -z 2609144 ']' 00:32:16.096 03:27:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:16.096 03:27:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:16.096 03:27:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:16.096 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:16.096 03:27:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:16.096 03:27:18 -- common/autotest_common.sh@10 -- # set +x 00:32:16.096 [2024-11-27 03:27:18.612798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:32:16.096 [2024-11-27 03:27:18.612877] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:16.096 EAL: No free 2048 kB hugepages reported on node 1 00:32:16.096 [2024-11-27 03:27:18.677343] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:16.356 [2024-11-27 03:27:18.762896] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:16.356 [2024-11-27 03:27:18.763042] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:16.356 [2024-11-27 03:27:18.763059] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:16.356 [2024-11-27 03:27:18.763071] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:16.356 [2024-11-27 03:27:18.763128] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:16.356 [2024-11-27 03:27:18.763187] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:16.356 [2024-11-27 03:27:18.763252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:16.356 [2024-11-27 03:27:18.763254] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:17.294 03:27:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:17.294 03:27:19 -- common/autotest_common.sh@862 -- # return 0 00:32:17.294 03:27:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:17.294 03:27:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:17.294 03:27:19 -- common/autotest_common.sh@10 -- # set +x 00:32:17.294 03:27:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:17.294 03:27:19 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:17.294 03:27:19 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:17.294 03:27:19 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:17.294 03:27:19 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:17.294 03:27:19 -- scripts/common.sh@312 -- # local nvmes 00:32:17.294 03:27:19 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:17.294 03:27:19 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:17.294 03:27:19 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:17.294 03:27:19 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:17.294 03:27:19 -- scripts/common.sh@322 -- # uname -s 00:32:17.294 03:27:19 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:17.294 03:27:19 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:17.294 03:27:19 -- scripts/common.sh@327 -- # (( 1 )) 00:32:17.294 03:27:19 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:17.294 03:27:19 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:17.294 03:27:19 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:17.294 03:27:19 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:17.294 03:27:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:17.294 03:27:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:17.294 03:27:19 -- common/autotest_common.sh@10 -- # set +x 00:32:17.294 ************************************ 00:32:17.294 START TEST spdk_target_abort 00:32:17.294 ************************************ 00:32:17.294 03:27:19 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:17.294 03:27:19 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:17.294 03:27:19 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:17.294 03:27:19 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:17.294 03:27:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:17.294 03:27:19 -- common/autotest_common.sh@10 -- # set +x 00:32:19.827 spdk_targetn1 00:32:19.827 03:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.827 03:27:22 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:19.827 03:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.827 03:27:22 -- common/autotest_common.sh@10 -- # set +x 00:32:19.827 [2024-11-27 03:27:22.434566] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:19.827 03:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:19.827 03:27:22 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:19.827 03:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:19.827 03:27:22 -- common/autotest_common.sh@10 -- # set +x 00:32:20.085 03:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:20.085 03:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.085 03:27:22 -- common/autotest_common.sh@10 -- # set +x 00:32:20.085 03:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:20.085 03:27:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:20.085 03:27:22 -- common/autotest_common.sh@10 -- # set +x 00:32:20.085 [2024-11-27 03:27:22.466855] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:20.085 03:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:20.085 03:27:22 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:20.085 EAL: No free 2048 kB hugepages reported on node 1 00:32:23.370 Initializing NVMe Controllers 00:32:23.370 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:23.370 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:23.370 Initialization complete. Launching workers. 00:32:23.370 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 10888, failed: 0 00:32:23.370 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1240, failed to submit 9648 00:32:23.370 success 690, unsuccess 550, failed 0 00:32:23.370 03:27:25 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:23.370 03:27:25 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:23.370 EAL: No free 2048 kB hugepages reported on node 1 00:32:26.658 Initializing NVMe Controllers 00:32:26.658 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:26.658 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:26.658 Initialization complete. Launching workers. 00:32:26.658 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8617, failed: 0 00:32:26.658 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1219, failed to submit 7398 00:32:26.658 success 378, unsuccess 841, failed 0 00:32:26.658 03:27:29 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:26.658 03:27:29 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:26.658 EAL: No free 2048 kB hugepages reported on node 1 00:32:29.948 Initializing NVMe Controllers 00:32:29.948 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:29.948 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:29.948 Initialization complete. Launching workers. 00:32:29.948 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 30744, failed: 0 00:32:29.948 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2711, failed to submit 28033 00:32:29.948 success 511, unsuccess 2200, failed 0 00:32:29.948 03:27:32 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:29.948 03:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:29.948 03:27:32 -- common/autotest_common.sh@10 -- # set +x 00:32:29.948 03:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:29.948 03:27:32 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:29.948 03:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:29.948 03:27:32 -- common/autotest_common.sh@10 -- # set +x 00:32:31.326 03:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:31.326 03:27:33 -- target/abort_qd_sizes.sh@62 -- # killprocess 2609144 00:32:31.326 03:27:33 -- common/autotest_common.sh@936 -- # '[' -z 2609144 ']' 00:32:31.326 03:27:33 -- common/autotest_common.sh@940 -- # kill -0 2609144 00:32:31.326 03:27:33 -- common/autotest_common.sh@941 -- # uname 00:32:31.326 03:27:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:31.326 03:27:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2609144 00:32:31.326 03:27:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:31.326 03:27:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:31.326 03:27:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2609144' 00:32:31.326 killing process with pid 2609144 00:32:31.326 03:27:33 -- common/autotest_common.sh@955 -- # kill 2609144 00:32:31.326 03:27:33 -- common/autotest_common.sh@960 -- # wait 2609144 00:32:31.326 00:32:31.326 real 0m14.339s 00:32:31.326 user 0m57.056s 00:32:31.326 sys 0m2.448s 00:32:31.326 03:27:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:31.326 03:27:33 -- common/autotest_common.sh@10 -- # set +x 00:32:31.326 ************************************ 00:32:31.326 END TEST spdk_target_abort 00:32:31.326 ************************************ 00:32:31.584 03:27:33 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:31.584 03:27:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:31.584 03:27:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:31.584 03:27:33 -- common/autotest_common.sh@10 -- # set +x 00:32:31.584 ************************************ 00:32:31.584 START TEST kernel_target_abort 00:32:31.584 ************************************ 00:32:31.584 03:27:33 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:31.584 03:27:33 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:31.584 03:27:33 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:31.584 03:27:33 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:31.584 03:27:33 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:31.584 03:27:33 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:31.584 03:27:33 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:31.584 03:27:33 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:31.584 03:27:33 -- nvmf/common.sh@627 -- # local block nvme 00:32:31.584 03:27:33 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:31.584 03:27:33 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:31.584 03:27:33 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:31.584 03:27:33 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:32.519 Waiting for block devices as requested 00:32:32.519 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:32.778 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:32.778 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:32.778 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:33.038 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:33.038 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:33.038 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:33.038 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:33.298 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:33.298 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:33.298 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:33.298 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:33.556 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:33.556 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:33.556 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:33.556 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:33.815 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:33.815 03:27:36 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:33.815 03:27:36 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:33.815 03:27:36 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:33.815 03:27:36 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:33.815 03:27:36 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:33.815 No valid GPT data, bailing 00:32:33.815 03:27:36 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:33.815 03:27:36 -- scripts/common.sh@393 -- # pt= 00:32:33.815 03:27:36 -- scripts/common.sh@394 -- # return 1 00:32:33.815 03:27:36 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:33.815 03:27:36 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:33.815 03:27:36 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:33.815 03:27:36 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:33.815 03:27:36 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:33.815 03:27:36 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:33.815 03:27:36 -- nvmf/common.sh@654 -- # echo 1 00:32:33.815 03:27:36 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:33.815 03:27:36 -- nvmf/common.sh@656 -- # echo 1 00:32:33.815 03:27:36 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:33.815 03:27:36 -- nvmf/common.sh@663 -- # echo tcp 00:32:33.815 03:27:36 -- nvmf/common.sh@664 -- # echo 4420 00:32:33.815 03:27:36 -- nvmf/common.sh@665 -- # echo ipv4 00:32:33.815 03:27:36 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:34.075 03:27:36 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:34.075 00:32:34.075 Discovery Log Number of Records 2, Generation counter 2 00:32:34.075 =====Discovery Log Entry 0====== 00:32:34.075 trtype: tcp 00:32:34.075 adrfam: ipv4 00:32:34.075 subtype: current discovery subsystem 00:32:34.075 treq: not specified, sq flow control disable supported 00:32:34.075 portid: 1 00:32:34.075 trsvcid: 4420 00:32:34.075 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:34.075 traddr: 10.0.0.1 00:32:34.075 eflags: none 00:32:34.075 sectype: none 00:32:34.075 =====Discovery Log Entry 1====== 00:32:34.075 trtype: tcp 00:32:34.075 adrfam: ipv4 00:32:34.075 subtype: nvme subsystem 00:32:34.075 treq: not specified, sq flow control disable supported 00:32:34.075 portid: 1 00:32:34.075 trsvcid: 4420 00:32:34.075 subnqn: kernel_target 00:32:34.075 traddr: 10.0.0.1 00:32:34.075 eflags: none 00:32:34.075 sectype: none 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:34.075 03:27:36 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:34.075 EAL: No free 2048 kB hugepages reported on node 1 00:32:37.364 Initializing NVMe Controllers 00:32:37.364 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:37.364 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:37.364 Initialization complete. Launching workers. 00:32:37.364 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 45995, failed: 0 00:32:37.364 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 45995, failed to submit 0 00:32:37.364 success 0, unsuccess 45995, failed 0 00:32:37.364 03:27:39 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:37.364 03:27:39 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:37.364 EAL: No free 2048 kB hugepages reported on node 1 00:32:40.653 Initializing NVMe Controllers 00:32:40.653 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:40.653 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:40.653 Initialization complete. Launching workers. 00:32:40.653 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 81679, failed: 0 00:32:40.653 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20598, failed to submit 61081 00:32:40.653 success 0, unsuccess 20598, failed 0 00:32:40.653 03:27:42 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:40.653 03:27:42 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:40.653 EAL: No free 2048 kB hugepages reported on node 1 00:32:43.943 Initializing NVMe Controllers 00:32:43.943 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:43.943 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:43.943 Initialization complete. Launching workers. 00:32:43.943 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79429, failed: 0 00:32:43.943 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19842, failed to submit 59587 00:32:43.943 success 0, unsuccess 19842, failed 0 00:32:43.943 03:27:45 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:32:43.943 03:27:45 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:32:43.943 03:27:45 -- nvmf/common.sh@677 -- # echo 0 00:32:43.943 03:27:45 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:32:43.944 03:27:45 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:43.944 03:27:45 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:43.944 03:27:45 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:43.944 03:27:45 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:32:43.944 03:27:45 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:32:43.944 00:32:43.944 real 0m11.904s 00:32:43.944 user 0m5.841s 00:32:43.944 sys 0m2.329s 00:32:43.944 03:27:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:43.944 03:27:45 -- common/autotest_common.sh@10 -- # set +x 00:32:43.944 ************************************ 00:32:43.944 END TEST kernel_target_abort 00:32:43.944 ************************************ 00:32:43.944 03:27:45 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:32:43.944 03:27:45 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:32:43.944 03:27:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:43.944 03:27:45 -- nvmf/common.sh@116 -- # sync 00:32:43.944 03:27:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:43.944 03:27:45 -- nvmf/common.sh@119 -- # set +e 00:32:43.944 03:27:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:43.944 03:27:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:43.944 rmmod nvme_tcp 00:32:43.944 rmmod nvme_fabrics 00:32:43.944 rmmod nvme_keyring 00:32:43.944 03:27:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:43.944 03:27:45 -- nvmf/common.sh@123 -- # set -e 00:32:43.944 03:27:45 -- nvmf/common.sh@124 -- # return 0 00:32:43.944 03:27:45 -- nvmf/common.sh@477 -- # '[' -n 2609144 ']' 00:32:43.944 03:27:45 -- nvmf/common.sh@478 -- # killprocess 2609144 00:32:43.944 03:27:45 -- common/autotest_common.sh@936 -- # '[' -z 2609144 ']' 00:32:43.944 03:27:45 -- common/autotest_common.sh@940 -- # kill -0 2609144 00:32:43.944 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2609144) - No such process 00:32:43.944 03:27:45 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2609144 is not found' 00:32:43.944 Process with pid 2609144 is not found 00:32:43.944 03:27:45 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:43.944 03:27:45 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:44.511 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:44.511 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:44.511 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:44.511 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:44.511 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:44.511 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:44.771 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:44.771 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:44.771 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:44.771 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:44.771 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:44.771 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:44.771 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:44.771 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:44.771 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:44.771 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:44.771 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:44.771 03:27:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:44.771 03:27:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:44.771 03:27:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:44.771 03:27:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:44.771 03:27:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:44.771 03:27:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:44.771 03:27:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:47.304 03:27:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:47.304 00:32:47.304 real 0m35.461s 00:32:47.304 user 1m5.317s 00:32:47.304 sys 0m8.219s 00:32:47.304 03:27:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:47.304 03:27:49 -- common/autotest_common.sh@10 -- # set +x 00:32:47.304 ************************************ 00:32:47.304 END TEST nvmf_abort_qd_sizes 00:32:47.304 ************************************ 00:32:47.304 03:27:49 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:32:47.304 03:27:49 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:32:47.304 03:27:49 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:32:47.304 03:27:49 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:32:47.304 03:27:49 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:32:47.304 03:27:49 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:32:47.304 03:27:49 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:32:47.304 03:27:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:47.304 03:27:49 -- common/autotest_common.sh@10 -- # set +x 00:32:47.304 03:27:49 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:32:47.304 03:27:49 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:32:47.304 03:27:49 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:32:47.304 03:27:49 -- common/autotest_common.sh@10 -- # set +x 00:32:48.681 INFO: APP EXITING 00:32:48.681 INFO: killing all VMs 00:32:48.681 INFO: killing vhost app 00:32:48.681 INFO: EXIT DONE 00:32:49.615 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:49.615 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:49.615 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:49.615 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:49.615 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:49.615 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:49.873 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:49.873 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:49.873 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:49.873 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:49.873 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:49.873 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:49.873 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:49.873 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:49.873 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:49.873 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:49.873 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:51.251 Cleaning 00:32:51.251 Removing: /var/run/dpdk/spdk0/config 00:32:51.251 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:32:51.251 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:32:51.251 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:32:51.251 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:32:51.251 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:32:51.251 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:32:51.251 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:32:51.251 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:32:51.251 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:32:51.251 Removing: /var/run/dpdk/spdk0/hugepage_info 00:32:51.251 Removing: /var/run/dpdk/spdk1/config 00:32:51.251 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:32:51.251 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:32:51.251 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:32:51.251 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:32:51.251 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:32:51.251 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:32:51.251 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:32:51.251 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:32:51.251 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:32:51.251 Removing: /var/run/dpdk/spdk1/hugepage_info 00:32:51.251 Removing: /var/run/dpdk/spdk1/mp_socket 00:32:51.251 Removing: /var/run/dpdk/spdk2/config 00:32:51.251 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:32:51.251 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:32:51.251 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:32:51.251 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:32:51.251 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:32:51.251 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:32:51.251 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:32:51.251 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:32:51.251 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:32:51.251 Removing: /var/run/dpdk/spdk2/hugepage_info 00:32:51.251 Removing: /var/run/dpdk/spdk3/config 00:32:51.251 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:32:51.251 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:32:51.251 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:32:51.251 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:32:51.251 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:32:51.251 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:32:51.252 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:32:51.252 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:32:51.252 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:32:51.252 Removing: /var/run/dpdk/spdk3/hugepage_info 00:32:51.252 Removing: /var/run/dpdk/spdk4/config 00:32:51.252 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:32:51.252 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:32:51.252 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:32:51.252 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:32:51.252 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:32:51.252 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:32:51.252 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:32:51.252 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:32:51.252 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:32:51.252 Removing: /var/run/dpdk/spdk4/hugepage_info 00:32:51.252 Removing: /dev/shm/bdev_svc_trace.1 00:32:51.252 Removing: /dev/shm/nvmf_trace.0 00:32:51.252 Removing: /dev/shm/spdk_tgt_trace.pid2328976 00:32:51.252 Removing: /var/run/dpdk/spdk0 00:32:51.252 Removing: /var/run/dpdk/spdk1 00:32:51.252 Removing: /var/run/dpdk/spdk2 00:32:51.252 Removing: /var/run/dpdk/spdk3 00:32:51.252 Removing: /var/run/dpdk/spdk4 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2326721 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2327784 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2328976 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2329473 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2330823 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2331775 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2332094 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2332299 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2332647 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2332974 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2333137 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2333292 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2333487 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2334049 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2336524 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2336800 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2337097 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2337238 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2337545 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2337685 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2338000 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2338138 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2338438 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2338500 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2338744 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2338813 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2339272 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2339426 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2339628 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2339932 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2339952 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2340058 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2340279 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2340433 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2340579 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2340768 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2341006 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2341160 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2341300 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2341478 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2341723 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2341888 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2342028 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2342187 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2342448 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2342609 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2342753 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2342913 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2343165 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2343335 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2343474 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2343635 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2343892 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2344051 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2344201 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2344356 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2344619 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2344776 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2344921 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2345083 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2345341 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2345502 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2345649 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2345803 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2346071 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2346227 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2346385 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2346543 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2346802 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2346961 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2347110 00:32:51.252 Removing: /var/run/dpdk/spdk_pid2347340 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2347463 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2347684 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2349942 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2407494 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2410175 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2418035 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2421391 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2423897 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2424323 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2428332 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2428337 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2428901 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2429569 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2430245 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2430653 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2430663 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2430806 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2430943 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2430949 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2431628 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2432300 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2432857 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2433263 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2433399 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2433539 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2434610 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2435476 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2440965 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2441248 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2443935 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2448444 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2450682 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2457322 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2462883 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2464105 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2464793 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2475431 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2477686 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2480518 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2481844 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2483840 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2483992 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2484144 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2484416 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2485014 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2486386 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2487403 00:32:51.510 Removing: /var/run/dpdk/spdk_pid2487849 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2491470 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2494930 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2498583 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2523023 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2525862 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2529698 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2530667 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2531912 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2534498 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2537031 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2541419 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2541421 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2544368 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2544562 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2544766 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2545121 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2545170 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2546785 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2548002 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2549215 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2550430 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2551753 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2552992 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2556888 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2557229 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2558660 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2559425 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2563230 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2565390 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2569021 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2572650 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2576940 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2577356 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2577902 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2578324 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2578913 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2579350 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2579904 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2580453 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2583144 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2583390 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2587255 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2587434 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2589093 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2594253 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2594383 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2597334 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2598769 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2600206 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2601094 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2602543 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2603441 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2609583 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2609983 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2610387 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2611887 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2612276 00:32:51.511 Removing: /var/run/dpdk/spdk_pid2612687 00:32:51.511 Clean 00:32:51.781 killing process with pid 2298260 00:32:59.957 killing process with pid 2298257 00:32:59.957 killing process with pid 2298259 00:33:00.216 killing process with pid 2298258 00:33:00.216 03:28:02 -- common/autotest_common.sh@1446 -- # return 0 00:33:00.216 03:28:02 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:00.216 03:28:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:00.216 03:28:02 -- common/autotest_common.sh@10 -- # set +x 00:33:00.216 03:28:02 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:00.216 03:28:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:00.216 03:28:02 -- common/autotest_common.sh@10 -- # set +x 00:33:00.216 03:28:02 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:00.216 03:28:02 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:00.216 03:28:02 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:00.216 03:28:02 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:00.216 03:28:02 -- spdk/autotest.sh@383 -- # hostname 00:33:00.216 03:28:02 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:00.474 geninfo: WARNING: invalid characters removed from testname! 00:33:32.551 03:28:30 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:32.552 03:28:34 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:34.461 03:28:36 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:37.754 03:28:39 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:40.294 03:28:42 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:42.834 03:28:45 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:45.376 03:28:47 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:33:45.376 03:28:47 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:33:45.376 03:28:47 -- common/autotest_common.sh@1690 -- $ lcov --version 00:33:45.376 03:28:47 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:33:45.637 03:28:48 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:33:45.637 03:28:48 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:33:45.637 03:28:48 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:33:45.637 03:28:48 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:33:45.637 03:28:48 -- scripts/common.sh@335 -- $ IFS=.-: 00:33:45.637 03:28:48 -- scripts/common.sh@335 -- $ read -ra ver1 00:33:45.637 03:28:48 -- scripts/common.sh@336 -- $ IFS=.-: 00:33:45.637 03:28:48 -- scripts/common.sh@336 -- $ read -ra ver2 00:33:45.637 03:28:48 -- scripts/common.sh@337 -- $ local 'op=<' 00:33:45.637 03:28:48 -- scripts/common.sh@339 -- $ ver1_l=2 00:33:45.637 03:28:48 -- scripts/common.sh@340 -- $ ver2_l=1 00:33:45.637 03:28:48 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:33:45.637 03:28:48 -- scripts/common.sh@343 -- $ case "$op" in 00:33:45.637 03:28:48 -- scripts/common.sh@344 -- $ : 1 00:33:45.637 03:28:48 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:33:45.637 03:28:48 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:33:45.637 03:28:48 -- scripts/common.sh@364 -- $ decimal 1 00:33:45.637 03:28:48 -- scripts/common.sh@352 -- $ local d=1 00:33:45.637 03:28:48 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:33:45.637 03:28:48 -- scripts/common.sh@354 -- $ echo 1 00:33:45.637 03:28:48 -- scripts/common.sh@364 -- $ ver1[v]=1 00:33:45.637 03:28:48 -- scripts/common.sh@365 -- $ decimal 2 00:33:45.637 03:28:48 -- scripts/common.sh@352 -- $ local d=2 00:33:45.637 03:28:48 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:33:45.637 03:28:48 -- scripts/common.sh@354 -- $ echo 2 00:33:45.637 03:28:48 -- scripts/common.sh@365 -- $ ver2[v]=2 00:33:45.637 03:28:48 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:33:45.637 03:28:48 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:33:45.637 03:28:48 -- scripts/common.sh@367 -- $ return 0 00:33:45.637 03:28:48 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:33:45.637 03:28:48 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:33:45.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:45.637 --rc genhtml_branch_coverage=1 00:33:45.637 --rc genhtml_function_coverage=1 00:33:45.637 --rc genhtml_legend=1 00:33:45.637 --rc geninfo_all_blocks=1 00:33:45.637 --rc geninfo_unexecuted_blocks=1 00:33:45.637 00:33:45.637 ' 00:33:45.637 03:28:48 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:33:45.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:45.637 --rc genhtml_branch_coverage=1 00:33:45.637 --rc genhtml_function_coverage=1 00:33:45.637 --rc genhtml_legend=1 00:33:45.637 --rc geninfo_all_blocks=1 00:33:45.637 --rc geninfo_unexecuted_blocks=1 00:33:45.637 00:33:45.637 ' 00:33:45.637 03:28:48 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:33:45.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:45.637 --rc genhtml_branch_coverage=1 00:33:45.637 --rc genhtml_function_coverage=1 00:33:45.637 --rc genhtml_legend=1 00:33:45.637 --rc geninfo_all_blocks=1 00:33:45.637 --rc geninfo_unexecuted_blocks=1 00:33:45.637 00:33:45.637 ' 00:33:45.637 03:28:48 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:33:45.637 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:45.637 --rc genhtml_branch_coverage=1 00:33:45.637 --rc genhtml_function_coverage=1 00:33:45.637 --rc genhtml_legend=1 00:33:45.637 --rc geninfo_all_blocks=1 00:33:45.637 --rc geninfo_unexecuted_blocks=1 00:33:45.637 00:33:45.637 ' 00:33:45.637 03:28:48 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:45.637 03:28:48 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:33:45.637 03:28:48 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:45.637 03:28:48 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:45.637 03:28:48 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:45.637 03:28:48 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:45.637 03:28:48 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:45.637 03:28:48 -- paths/export.sh@5 -- $ export PATH 00:33:45.637 03:28:48 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:45.638 03:28:48 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:33:45.638 03:28:48 -- common/autobuild_common.sh@440 -- $ date +%s 00:33:45.638 03:28:48 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732674528.XXXXXX 00:33:45.638 03:28:48 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732674528.DlzdaZ 00:33:45.638 03:28:48 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:33:45.638 03:28:48 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:33:45.638 03:28:48 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:33:45.638 03:28:48 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:33:45.638 03:28:48 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:33:45.638 03:28:48 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:33:45.638 03:28:48 -- common/autobuild_common.sh@456 -- $ get_config_params 00:33:45.638 03:28:48 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:33:45.638 03:28:48 -- common/autotest_common.sh@10 -- $ set +x 00:33:45.638 03:28:48 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:33:45.638 03:28:48 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:33:45.638 03:28:48 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:45.638 03:28:48 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:33:45.638 03:28:48 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:33:45.638 03:28:48 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:33:45.638 03:28:48 -- spdk/autopackage.sh@19 -- $ timing_finish 00:33:45.638 03:28:48 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:33:45.638 03:28:48 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:33:45.638 03:28:48 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:45.638 03:28:48 -- spdk/autopackage.sh@20 -- $ exit 0 00:33:45.638 + [[ -n 2243160 ]] 00:33:45.638 + sudo kill 2243160 00:33:45.649 [Pipeline] } 00:33:45.668 [Pipeline] // stage 00:33:45.674 [Pipeline] } 00:33:45.693 [Pipeline] // timeout 00:33:45.699 [Pipeline] } 00:33:45.717 [Pipeline] // catchError 00:33:45.722 [Pipeline] } 00:33:45.741 [Pipeline] // wrap 00:33:45.747 [Pipeline] } 00:33:45.763 [Pipeline] // catchError 00:33:45.774 [Pipeline] stage 00:33:45.777 [Pipeline] { (Epilogue) 00:33:45.793 [Pipeline] catchError 00:33:45.795 [Pipeline] { 00:33:45.811 [Pipeline] echo 00:33:45.813 Cleanup processes 00:33:45.821 [Pipeline] sh 00:33:46.109 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:46.109 2625008 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:46.125 [Pipeline] sh 00:33:46.415 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:46.415 ++ grep -v 'sudo pgrep' 00:33:46.415 ++ awk '{print $1}' 00:33:46.415 + sudo kill -9 00:33:46.415 + true 00:33:46.428 [Pipeline] sh 00:33:46.715 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:33:56.719 [Pipeline] sh 00:33:57.003 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:33:57.004 Artifacts sizes are good 00:33:57.017 [Pipeline] archiveArtifacts 00:33:57.024 Archiving artifacts 00:33:57.197 [Pipeline] sh 00:33:57.527 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:33:57.542 [Pipeline] cleanWs 00:33:57.553 [WS-CLEANUP] Deleting project workspace... 00:33:57.553 [WS-CLEANUP] Deferred wipeout is used... 00:33:57.560 [WS-CLEANUP] done 00:33:57.562 [Pipeline] } 00:33:57.579 [Pipeline] // catchError 00:33:57.591 [Pipeline] sh 00:33:57.876 + logger -p user.info -t JENKINS-CI 00:33:57.884 [Pipeline] } 00:33:57.897 [Pipeline] // stage 00:33:57.902 [Pipeline] } 00:33:57.915 [Pipeline] // node 00:33:57.920 [Pipeline] End of Pipeline 00:33:57.958 Finished: SUCCESS